[Air-L] Extracting Twitter Data

[Guido Anselmi]

Hi

it used to be possible to gather older tweets for free through ad hoc
scrapers that leveraged a ' bug' in the advanced search, as far as i know
that particular issue has been patched very recently, so at the present
moment ( the last 2 days afaik) there is no way of getting what you want
for free. i have no doubt that a way of restoring previous access will be
found quickly but at the present moment the only way of getting what you
want is through screen scraping, probably using some kind of browser
emulation like Selenium which is kinda unwieldy.

there are multiple project of twitter scrapers on github, in the coming
weeks probably one of the will find a way to acquire data your best chance
is to bookmark them and wait

best
Guido

Il giorno mar 22 set 2020 alle ore 05:00 Mosallaeipour,Fatemeh <
fm455 at drexel.edu> ha scritto:

> Dear colleagues,
>
> I hope this email finds you all well and safe.
> Help needed! I am trying to download the videos and tweets shared in a
> specific period. I only need the information on public accounts that is
> accessible for any Twitter user: the name of the user who has shared it,
> the date, the video, and the tweet itself. I have been using the advanced
> search tool on Twitter, entering the date, and desired hashtags and
> accounts. It is a huge amount of data and I have to redo the process once
> more to get some more information and complete what I currently have. I
> have already looked for codes; however, a friend informed me that such
> information is only available for free, even with coding, for the last 30
> days. I am looking to retrieve data from last November though.
>
> Has anyone gone through the same obstacle? Is that true that the only way
> for me is to do it manually? If not, is there any code for R?
>
> I appreciate your help!
>
> Best,
>
> Afrooz Mosallaeipour
> Drexel University
> Ph.D. Student in Communication, Culture, & Media
>
> _______________________________________________
> The Air-L at listserv.aoir.org mailing list
> is provided by the Association of Internet Researchers http://aoir.org
> Subscribe, change options or unsubscribe at:
> http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
>
> Join the Association of Internet Researchers:
> http://www.aoir.org/
>