[Air-L] Twitter data collection tools

[Stuart Shulman]

Gohar,

Retweets are not in the metadata payload.

The "favorites" in Twitter data refer to the number of favorites by that
user over the complete history of their Twitter account at the time they
wrote that Tweet.

The thing about RTs and favorites of a particular tweet is that they are
dynamic variables. When you look at a collected Tweet using the Twitter
display you see the counts for both live in realtime.

There is no method I know of to capture that data in the aggregate. There
are technical and legal barriers.

~Stu

Stu Shulman <https://twitter.com/StuartWShulman>
FC Massachusetts U14B, Head Coach
Amherst Regional High School, JV-B Head CoachMA Olympic Development
Program U12B, Assistant Coach



On Tue, Nov 10, 2015 at 11:00 PM, Libby Hemphill <libbyh at gmail.com> wrote:

> I wrote a script that gets you part way:
> https://github.com/casmlab/user-timeline-tools
>
> If you setup and run getUserTimeline.py, you'll have all the data you want,
> just not in the format you want. If you keep going and run
> parseUserTimeline.py, you'll end up with a MySQL table that has the info
> you listed, but you'll also have a bunch of stuff you don't need.
>
> Though, looking back at your list, I guess this doesn't get/save retweets,
> but you could probably mod it to do so. It worked 3 months ago. Issues and
> bug fixes welcome!
>
> On Tue, Nov 10, 2015 at 9:33 PM, Deen Freelon <dfreelon at gmail.com> wrote:
>
> > There are two basic ways to do this. You can use a programming module
> like
> > Twarc (https://github.com/edsu/twarc) or Twitter for Python (
> > https://pypi.python.org/pypi/twitter) to pull the data yourself, which
> is
> > free but takes some time to learn how to do. The other option is to use
> an
> > analytics platform like Discovertext or Crimson Hexagon, which is more
> > user-friendly but more expensive.
> >
> > ~DEEN
> >
> > On 11/10/2015 9:59 PM, Gohar F. Khan wrote:
> >
> >> Hello list members:
> >>
> >> I am looking for tools which can help extract all possible Twitter
> >> statistics (such as, number of tweets, followers, followings, mentions,
> >> re-tweets, favorites) for a list of Twitter handlers (around 120
> >> accounts). *In
> >> particular, I look for a tool that can take the IDs as a single file and
> >> provide the desired statistics for each ID. *
> >>
> >> The Webometrics Analyst has this functionality, but unfortunately it
> only
> >> provides followers and followings data. I am also familiar with the
> >> several
> >> other tools including the ones mentioned in the Dean Freelon's curated
> >> list
> >> <
> >>
> https://docs.google.com/document/d/1UaERzROI986HqcwrBDLaqGG8X_lYwctj6ek6ryqDOiQ/edit
> >> >,
> >> but
> >> non of these can extract all the information I need. Some tools provide
> >> more statistics, but they work with one ID at time.
> >>
> >> I will greatly appreciate any suggestions.
> >>
> >>
> >> Thank you,
> >>
> >>
> > --
> > Deen Freelon, Ph.D.
> > Assistant Professor
> > American University School of Communication
> > Office: McKinley 325
> > http://dfreelon.org/
> > @dfreelon
> >
> >
> > _______________________________________________
> > The Air-L at listserv.aoir.org mailing list
> > is provided by the Association of Internet Researchers http://aoir.org
> > Subscribe, change options or unsubscribe at:
> > http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
> >
> > Join the Association of Internet Researchers:
> > http://www.aoir.org/
> >
> _______________________________________________
> The Air-L at listserv.aoir.org mailing list
> is provided by the Association of Internet Researchers http://aoir.org
> Subscribe, change options or unsubscribe at:
> http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
>
> Join the Association of Internet Researchers:
> http://www.aoir.org/
>