[Air-L] Twitter data collection tools

Libby Hemphill libbyh at gmail.com
Tue Nov 10 20:00:22 PST 2015

I wrote a script that gets you part way:

If you setup and run getUserTimeline.py, you'll have all the data you want,
just not in the format you want. If you keep going and run
parseUserTimeline.py, you'll end up with a MySQL table that has the info
you listed, but you'll also have a bunch of stuff you don't need.

Though, looking back at your list, I guess this doesn't get/save retweets,
but you could probably mod it to do so. It worked 3 months ago. Issues and
bug fixes welcome!

On Tue, Nov 10, 2015 at 9:33 PM, Deen Freelon <dfreelon at gmail.com> wrote:

> There are two basic ways to do this. You can use a programming module like
> Twarc (https://github.com/edsu/twarc) or Twitter for Python (
> https://pypi.python.org/pypi/twitter) to pull the data yourself, which is
> free but takes some time to learn how to do. The other option is to use an
> analytics platform like Discovertext or Crimson Hexagon, which is more
> user-friendly but more expensive.
> On 11/10/2015 9:59 PM, Gohar F. Khan wrote:
>> Hello list members:
>> I am looking for tools which can help extract all possible Twitter
>> statistics (such as, number of tweets, followers, followings, mentions,
>> re-tweets, favorites) for a list of Twitter handlers (around 120
>> accounts). *In
>> particular, I look for a tool that can take the IDs as a single file and
>> provide the desired statistics for each ID. *
>> The Webometrics Analyst has this functionality, but unfortunately it only
>> provides followers and followings data. I am also familiar with the
>> several
>> other tools including the ones mentioned in the Dean Freelon's curated
>> list
>> <
>> https://docs.google.com/document/d/1UaERzROI986HqcwrBDLaqGG8X_lYwctj6ek6ryqDOiQ/edit
>> >,
>> but
>> non of these can extract all the information I need. Some tools provide
>> more statistics, but they work with one ID at time.
>> I will greatly appreciate any suggestions.
>> Thank you,
> --
> Deen Freelon, Ph.D.
> Assistant Professor
> American University School of Communication
> Office: McKinley 325
> http://dfreelon.org/
> @dfreelon
> _______________________________________________
> The Air-L at listserv.aoir.org mailing list
> is provided by the Association of Internet Researchers http://aoir.org
> Subscribe, change options or unsubscribe at:
> http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
> Join the Association of Internet Researchers:
> http://www.aoir.org/

More information about the Air-L mailing list