[Air-L] suggestions for Twitter aggregating & analytic tools

Shulman, Stuart stu at texifter.com
Fri Sep 28 11:58:56 PDT 2012


Hi Deen,

That is not the case in our experience. The ToS limits what you can do via
an API, but is more liberal with what you do via a "Save as". As long as
you don't syndicate or share what you capture, you can save as .CSV or XML
and use the data in other software for analysis. We worked through this in
shaping our ToS to ensure we aligned with Gnip and Twitter.

~Stu

On Fri, Sep 28, 2012 at 2:49 PM, Deen Freelon <dfreelon at gmail.com> wrote:

> I would also like to point out that your choice of collection/analysis
> tool will depend on whether you need direct access to the data. Generally
> speaking, it is my understanding that unless you collect the data yourself
> (or pay an authorized reseller like Gnip for it), you aren't allowed (by
> Twitter's TOS) to "handle" the raw data--you can only view aggregate
> statistics and analytics. To do systematic Twitter data collection at
> scale, a web server is almost always required. ~DEEN
>
>
> On 9/28/2012 1:04 PM, Alex Leavitt wrote:
>
>> http://140kit.com/
>>
>> ---
>>
>> Alexander Leavitt
>> PhD Student
>> USC Annenberg School for Communication & Journalism
>> http://alexleavitt.com
>> Twitter: @alexleavitt
>>
>>
>>
>>
>> On Fri, Sep 28, 2012 at 8:29 AM, Shulman, Stuart <stu at texifter.com<mailto:
>> stu at texifter.com>> wrote:
>>
>>     DiscoverText has free and paid versions, academic pricing, access
>>     to the
>>     full GNIP fire hose, and now access to every Tweet in history.
>>
>>     Stu
>>
>>     On Friday, September 28, 2012, Deen Freelon wrote:
>>
>>     > I just started using a tweet collection server called 140dev:
>>     > http://140dev.com/free-****twitter-api-source-code-**<http://140dev.com/free-**twitter-api-source-code-**>
>>     >
>>     library/twitter-database-****server/<http://140dev.com/**
>> free-twitter-api-source-code-**library/twitter-database-**server/<http://140dev.com/free-twitter-api-source-code-library/twitter-database-server/>
>> >
>>     >
>>     > It's really quick & easy to set up on a LAMP server, and it
>>     drops all the
>>     > data into a MySQL DB for easy querying. It doesn't include any
>>     additional
>>     > analytics functionality I don't think. ~DEEN
>>     >
>>     > On 9/28/2012 10:36 AM, Pete[r] Landwehr wrote:
>>     >
>>     >> Heyo,
>>     >>
>>     >> Arizona State University has put together a tool for aggregation &
>>     >> performing basic analytics called TweetTracker. You'll need to
>>     check
>>     >> with Huan Liu at ASU if you want to set up your own install,
>>     however
>>     >>
>>     >> Best,
>>     >>
>>     >> pml
>>     >>
>>     >>
>>     >> On Fri, Sep 28, 2012 at 10:17 AM, Moore, Tony A (US - Glen Mills)
>>     >> <tomoore at deloitte.com <mailto:tomoore at deloitte.com>> wrote:
>>     >>
>>     >>> Erica,
>>     >>>
>>     >>> I have listed a few options (not exhaustive) below depending
>>     on how
>>     >>> customized you would want your algorithm to be. The options
>>     further down in
>>     >>> the list will require higher level of effort but provide
>>     greater control
>>     >>> and specificity on the output.
>>     >>>
>>     >>> Clarabridge
>>     >>> Rapidminer
>>     >>> R (tm.plugin.sentiment)
>>     >>> Natural Language Toolkit (NLTK) with Python
>>     >>>
>>     >>> larabridge is the only one that is a fully commercial product.
>>     The rest
>>     >>> of the options are open source solutions that need to go
>>     hand-in-hand with
>>     >>> some licensed packages. For example, NLTK is open source and
>>     free. However,
>>     >>> you will also need access to a lexical resource like
>>     SentiWordNet (
>>     >>> http://sentiwordnet.isti.cnr.****it/
>>     <http://sentiwordnet.isti.cnr.**it/<http://sentiwordnet.isti.cnr.it/>
>> >)
>>     >>> - this is free for non-profit purpose, may incur cost if we
>>     want to use it
>>     >>> in a client setting.
>>     >>>
>>     >>> There are free versions of R and RapidMiner that can be
>>     downloaded and
>>     >>> used, though using this might need additional coding.
>>     >>>
>>     >>> Regards,
>>     >>> Tony
>>     >>>
>>     >>> Tony Moore
>>     >>> Strategy, Brand & Innovation | Deloitte Analytics
>>     >>> 2 Braxton Way, Glen Mills, PA 19342, USA
>>     >>> Tel/Direct: +1 610 479 3124 <tel:%2B1%20610%20479%203124> |
>>     Fax: +1 610 479 4124 <tel:%2B1%20610%20479%204124> | Mobile: +1
>>     215 218
>>     >>> 8891
>>     >>> tomoore at deloitte.com <mailto:tomoore at deloitte.com>  |
>>     www.deloitte.com <http://www.deloitte.com>
>>
>>     >>>
>>     >>>
>>     >>>
>>     >>>
>>     >>>
>>     >>>
>>     >>>
>>     >>> This message (including any attachments) contains confidential
>>     >>> information intended for a specific individual and purpose, and is
>>     >>> protected by law. If you are not the intended recipient, you
>>     should delete
>>     >>> this message and any disclosure, copying, or distribution of
>>     this message,
>>     >>> or the taking of any action based on it, by you is strictly
>>     prohibited.
>>     >>>
>>     >>> v.E.1
>>     >>>
>>     >>>
>>     >>> -----Original Message-----
>>     >>> From: air-l-bounces at listserv.aoir.**org<air-l-bounces at listserv.aoir.org>
>>     <mailto:air-l-bounces@**listserv.aoir.org<air-l-bounces at listserv.aoir.org>>
>> [mailto:
>>     >>> air-l-bounces at listserv.aoir.**org<air-l-bounces at listserv.aoir.org>
>>     <mailto:air-l-bounces@**listserv.aoir.org<air-l-bounces at listserv.aoir.org>>]
>> On Behalf Of Erica Ciszek
>>     >>> Sent: Friday, September 28, 2012 10:13 AM
>>     >>> To: air-l at listserv.aoir.org <mailto:air-l at listserv.aoir.**org<air-l at listserv.aoir.org>
>> >
>>     >>> Subject: [Air-L] suggestions for Twitter aggregating &
>>     analytic tools
>>     >>>
>>     >>> Dear Colleagues,
>>     >>> I was wondering if anyone can suggest particular tools for
>>     aggregating
>>     >>> and analyzing Twitter content.
>>     >>>
>>     >>> What are the best tools for gathering tweets (by hashtags) and for
>>     >>> analyzing activity (by these hastags)? Appreciate any suggestions.
>>     >>>
>>     >>> Best,
>>     >>> Erica Ciszek
>>     >>> Doctoral Student
>>     >>> Graduate Teaching Fellow
>>     >>> School of Journalism and Communication
>>     >>> University of Oregon
>>     >>> eciszek at uoregon.edu <mailto:eciszek at uoregon.edu>
>>     >>>
>>     >>> ______________________________****_________________
>>     >>> The Air-L at listserv.aoir.org <mailto:Air-L at listserv.aoir.**org<Air-L at listserv.aoir.org>
>> >
>>
>>     mailing list
>>     >>> is provided by the Association of Internet Researchers
>>     http://aoir.org
>>     >>> Subscribe, change options or unsubscribe at:
>>     http://listserv.aoir.org/**
>>     >>> listinfo.cgi/air-l-aoir.org
>>     <http://air-l-aoir.org><http:/**/listserv.aoir.org/listinfo.**
>> cgi/air-l-aoir.org <http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org>
>> >
>>
>>     >>>
>>     >>> Join the Association of Internet Researchers:
>>     >>> http://www.aoir.org/
>>     >>> ______________________________****_________________
>>     >>> The Air-L at listserv.aoir.org <mailto:Air-L at listserv.aoir.**org<Air-L at listserv.aoir.org>
>> >
>>
>>     mailing list
>>     >>> is provided by the Association of Internet Researchers
>>     http://aoir.org
>>     >>> Subscribe, change options or unsubscribe at:
>>     http://listserv.aoir.org/**
>>     >>> listinfo.cgi/air-l-aoir.org
>>     <http://air-l-aoir.org><http:/**/listserv.aoir.org/listinfo.**
>> cgi/air-l-aoir.org <http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org>
>> >
>>
>>     >>>
>>     >>> Join the Association of Internet Researchers:
>>     >>> http://www.aoir.org/
>>     >>>
>>     >> ______________________________****_________________
>>     >> The Air-L at listserv.aoir.org <mailto:Air-L at listserv.aoir.**org<Air-L at listserv.aoir.org>
>> >
>>
>>     mailing list
>>     >> is provided by the Association of Internet Researchers
>>     http://aoir.org
>>     >> Subscribe, change options or unsubscribe at:
>>     http://listserv.aoir.org/**
>>     >> listinfo.cgi/air-l-aoir.org
>>     <http://air-l-aoir.org><http:/**/listserv.aoir.org/listinfo.**
>> cgi/air-l-aoir.org <http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org>
>> >
>>
>>     >>
>>     >> Join the Association of Internet Researchers:
>>     >> http://www.aoir.org/
>>     >>
>>     >
>>     >
>>     > --
>>     > Deen Freelon, Ph.D.
>>     > Assistant Professor
>>     > American University School of Communication
>>     > Office: Asbury 228A
>>     > dfreelon at gmail.com <mailto:dfreelon at gmail.com>
>>     > http://dfreelon.org
>>     >
>>     > ______________________________****_________________
>>     > The Air-L at listserv.aoir.org <mailto:Air-L at listserv.aoir.**org<Air-L at listserv.aoir.org>
>> >
>>
>>     mailing list
>>     > is provided by the Association of Internet Researchers
>>     http://aoir.org
>>     > Subscribe, change options or unsubscribe at:
>>     http://listserv.aoir.org/**
>>     > listinfo.cgi/air-l-aoir.org
>>     <http://air-l-aoir.org><http:/**/listserv.aoir.org/listinfo.**
>> cgi/air-l-aoir.org <http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org>
>> >
>>
>>     >
>>     > Join the Association of Internet Researchers:
>>     > http://www.aoir.org/
>>     >
>>
>>
>>     --
>>
>>     Dr. Stuart W. Shulmanhttp://people.umass.**edu/stu<http://people.umass.edu/stu>
>>     <http://people.umass.edu/stu>
>>
>>     Founder and CEO, Texifterhttp://texifter.com <http://texifter.com>
>>
>>
>>     LinkedIn: http://www.linkedin.com/pub/**stuart-shulman/10/351/899<http://www.linkedin.com/pub/stuart-shulman/10/351/899>
>>     Twitter: http://twitter.com/#!/**StuartWShulman<http://twitter.com/#!/StuartWShulman>
>>     <http://twitter.com/#%21/**StuartWShulman<http://twitter.com/#%21/StuartWShulman>
>> >
>>
>>     Director, QDAP-UMasshttp://www.umass.**edu/qdap<http://www.umass.edu/qdap>
>>     <http://www.umass.edu/qdap>
>>
>>     Editor Emeritus, JITPwww.jitp.net <http://JITPwww.jitp.net>
>>     ______________________________**_________________
>>     The Air-L at listserv.aoir.org <mailto:Air-L at listserv.aoir.**org<Air-L at listserv.aoir.org>
>> >
>>
>>     mailing list
>>     is provided by the Association of Internet Researchers
>> http://aoir.org
>>     Subscribe, change options or unsubscribe at:
>>     http://listserv.aoir.org/**listinfo.cgi/air-l-aoir.org<http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org>
>>
>>     Join the Association of Internet Researchers:
>>     http://www.aoir.org/
>>
>>
>>
>
> --
> Deen Freelon, Ph.D.
> Assistant Professor
> American University School of Communication
> Office: Asbury 228A
> dfreelon at gmail.com
> http://dfreelon.org
>
> ______________________________**_________________
> The Air-L at listserv.aoir.org mailing list
> is provided by the Association of Internet Researchers http://aoir.org
> Subscribe, change options or unsubscribe at: http://listserv.aoir.org/**
> listinfo.cgi/air-l-aoir.org<http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org>
>
> Join the Association of Internet Researchers:
> http://www.aoir.org/
>



-- 

Dr. Stuart W. Shulmanhttp://people.umass.edu/stu

Founder and CEO, Texifterhttp://texifter.com

LinkedIn: http://www.linkedin.com/pub/stuart-shulman/10/351/899
Twitter: http://twitter.com/#!/StuartWShulman

Director, QDAP-UMasshttp://www.umass.edu/qdap

Editor Emeritus, JITPwww.jitp.net



More information about the Air-L mailing list