[Air-L] Twitter data collection tools

Libby Hemphill libbyh at gmail.com
Tue Nov 10 20:00:22 PST 2015


I wrote a script that gets you part way:
https://github.com/casmlab/user-timeline-tools

If you setup and run getUserTimeline.py, you'll have all the data you want,
just not in the format you want. If you keep going and run
parseUserTimeline.py, you'll end up with a MySQL table that has the info
you listed, but you'll also have a bunch of stuff you don't need.

Though, looking back at your list, I guess this doesn't get/save retweets,
but you could probably mod it to do so. It worked 3 months ago. Issues and
bug fixes welcome!

On Tue, Nov 10, 2015 at 9:33 PM, Deen Freelon <dfreelon at gmail.com> wrote:

> There are two basic ways to do this. You can use a programming module like
> Twarc (https://github.com/edsu/twarc) or Twitter for Python (
> https://pypi.python.org/pypi/twitter) to pull the data yourself, which is
> free but takes some time to learn how to do. The other option is to use an
> analytics platform like Discovertext or Crimson Hexagon, which is more
> user-friendly but more expensive.
>
> ~DEEN
>
> On 11/10/2015 9:59 PM, Gohar F. Khan wrote:
>
>> Hello list members:
>>
>> I am looking for tools which can help extract all possible Twitter
>> statistics (such as, number of tweets, followers, followings, mentions,
>> re-tweets, favorites) for a list of Twitter handlers (around 120
>> accounts). *In
>> particular, I look for a tool that can take the IDs as a single file and
>> provide the desired statistics for each ID. *
>>
>> The Webometrics Analyst has this functionality, but unfortunately it only
>> provides followers and followings data. I am also familiar with the
>> several
>> other tools including the ones mentioned in the Dean Freelon's curated
>> list
>> <
>> https://docs.google.com/document/d/1UaERzROI986HqcwrBDLaqGG8X_lYwctj6ek6ryqDOiQ/edit
>> >,
>> but
>> non of these can extract all the information I need. Some tools provide
>> more statistics, but they work with one ID at time.
>>
>> I will greatly appreciate any suggestions.
>>
>>
>> Thank you,
>>
>>
> --
> Deen Freelon, Ph.D.
> Assistant Professor
> American University School of Communication
> Office: McKinley 325
> http://dfreelon.org/
> @dfreelon
>
>
> _______________________________________________
> The Air-L at listserv.aoir.org mailing list
> is provided by the Association of Internet Researchers http://aoir.org
> Subscribe, change options or unsubscribe at:
> http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
>
> Join the Association of Internet Researchers:
> http://www.aoir.org/
>



More information about the Air-L mailing list