[Air-L] Twitter data collection tools

Axel Bruns a.bruns at qut.edu.au
Wed Nov 11 15:51:19 PST 2015

G'day Gohar !

Thanks for this. As others have already pointed out, you won't be able to get all of those stats easily, and a number of them will be outdated almost as soon as you've gathered them. 

For small batches of general user details (as well as for most anything else that can be gathered through the Twitter APIs), though, I would very much recommend Erik Michaels-Ober's Ruby gem 't', which essentially provides a command-line interface to the Twitter API. It's available for Windows, Mac, and Linux, and while - like most things Ruby - it's not the easiest to install, it's very handy for quickly getting the profile information for a batch of a few hundred user handles (or IDs), for instance. Output can be forced to CSV format using the -c or --csv switch.

Details are at https://github.com/sferik/t, and Erik (@sferik) tends to be pretty helpful if you run into any trouble, too.

> Date: Wed, 11 Nov 2015 11:59:05 +0900
> From: "Gohar F. Khan" <gohar.feroz at gmail.com>
> To: air-l at listserv.aoir.org
> Subject: [Air-L] Twitter data collection tools
> Hello list members:
> I am looking for tools which can help extract all possible Twitter statistics
> (such as, number of tweets, followers, followings, mentions, re-tweets,
> favorites) for a list of Twitter handlers (around 120 accounts). *In
> particular, I look for a tool that can take the IDs as a single file and
> provide the desired statistics for each ID. *
> The Webometrics Analyst has this functionality, but unfortunately it only
> provides followers and followings data. I am also familiar with the several
> other tools including the ones mentioned in the Dean Freelon's curated list
> <https://docs.google.com/document/d/1UaERzROI986HqcwrBDLaqGG8X_lYwctj6ek6ryqD
> OiQ/edit>,
> but
> non of these can extract all the information I need. Some tools provide more
> statistics, but they work with one ID at time.
> I will greatly appreciate any suggestions.
> Thank you,
> --
> Gohar Feroz Khan, PhD
> Adjunct Faculty & Research Adviser
> Korea Advance Institute of Science & Technology (KAIST) Global Information
> and Telecommunication Technology Program (ITTP)
> 291 Daehak-ro, Yuseong-gu, Daejeon, South Korea.

Dr Axel Bruns                    a.bruns at qut.edu.au - @snurb_dot_info
ARC Future Fellow, 2014-17   http://www.amazon.com/author/axel.bruns/
Professor, Media & Communication     http://mappingonlinepublics.net/
QUT Digital Media Research Centre    http://qut.edu.au/research/dmrc/
Creative Industries Faculty, K412, KG              http://snurb.info/
Queensland University of Technology                   +61 7 3138 5548
GPO Box 2434, Brisbane, Qld 4001, Australia        CRICOS No.: 00213J

More information about the Air-L mailing list