[Air-L] question about using online comments

Janet Salmons jsalmons at vision2lead.com
Thu May 4 14:28:33 PDT 2023 

NVivo has a cool option called NCapture, see https://bit.ly/3NG38k5.
"NCapture is a free web-browser extension for Chrome that enables you to gather web content to import into NVivo... NCapture files (.nvcx) contain your captured content as well as the URLs, capture times and any additional information such as a descriptions, memos and coding that you specified at the time of capture." 

If you are interested in the ethical side of this kind of research, please see this Sage Methodspace post, featuring an interview with Wyke Stommel (https://bit.ly/3AY3lYu) and the open-access article she discusses: " Ethical approval: none sought. How discourse analysts report ethical issues around publicly available online data."

Another post, "Methods in Action: The Ethics of Studying Online Comments" includes an open-access research case and a discussion with the researcher: https://bit.ly/3LJv3y7.

All the best,
Janet

Janet Salmons, PhD (She/her/hers)
Research Community Manager, SAGE MethodSpace.com
Boulder, Colorado USA
jsalmons at vision2lead.com

Now available! Doing Qualitative Research Online, 2nd edition
(720) 507-3965











-----Original Message-----
From: Air-L <air-l-bounces at listserv.aoir.org> On Behalf Of air-l-request at listserv.aoir.org
Sent: Thursday, May 04, 2023 2:01 PM
To: air-l at listserv.aoir.org
Subject: Air-L Digest, Vol 226, Issue 4

Send Air-L mailing list submissions to
	air-l at listserv.aoir.org

To subscribe or unsubscribe via the World Wide Web, visit
	http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
or, via email, send a message with subject or body 'help' to
	air-l-request at listserv.aoir.org

You can reach the person managing the list at
	air-l-owner at listserv.aoir.org

When replying, please edit your Subject line so it is more specific than "Re: Contents of Air-L digest..."


Today's Topics:

   1. question about using online comments (Wiley, Chris)
   2. Re: question about using online comments (Peter Timusk)
   3. Re: question about using online comments (Avner Kantor)
   4. Re: question about using online comments (Deena Abul-Fottouh)


----------------------------------------------------------------------

Message: 1
Date: Wed, 3 May 2023 20:39:31 +0000
From: "Wiley, Chris" <cawiley at illinois.edu>
To: "air-l at listserv.aoir.org" <air-l at listserv.aoir.org>
Subject: [Air-L] question about using online comments
Message-ID:
	<MW5PR11MB5787B7F6804C0FC69084DCF2D76C9 at MW5PR11MB5787.namprd11.prod.outlook.com>
	
Content-Type: text/plain; charset="iso-8859-1"

Hi
I've been doing research using online comments on news websites.  I was wondering are there any tools to extract the comments outside of copying and pasting?

Chris Wiley


------------------------------

Message: 2
Date: Wed, 3 May 2023 19:11:52 -0400
From: Peter Timusk <peterotimusk at gmail.com>
To: "Wiley, Chris" <cawiley at illinois.edu>
Cc: "air-l at listserv.aoir.org" <air-l at listserv.aoir.org>
Subject: Re: [Air-L] question about using online comments
Message-ID:
	<CACdrEbYgFq94qMVqOpGFKQvbCa7rHsbXj-LOj4P1qTYrvPLDGQ at mail.gmail.com>
Content-Type: text/plain; charset="UTF-8"

You can use some softwares like R or SAS or Python to request web pages as data or text files. This may have varying degrees of success.  You can put these requests in loops to make multiple requests across says dates of news reporting. Then you have to clean up the data and isolate the comments from inside the text files.

On Wed, May 3, 2023 at 4:49?PM Wiley, Chris via Air-L < air-l at listserv.aoir.org> wrote:

> Hi
> I've been doing research using online comments on news websites.  I 
> was wondering are there any tools to extract the comments outside of 
> copying and pasting?
>
> Chris Wiley
> _______________________________________________
> The Air-L at listserv.aoir.org mailing list is provided by the 
> Association of Internet Researchers http://aoir.org Subscribe, change 
> options or unsubscribe at:
> http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
>
> Join the Association of Internet Researchers:
> http://www.aoir.org/
>


------------------------------

Message: 3
Date: Thu, 4 May 2023 12:20:44 +0300
From: Avner Kantor <avnerkantor at gmail.com>
To: Peter Timusk <peterotimusk at gmail.com>
Cc: "Wiley, Chris" <cawiley at illinois.edu>,  "air-l at listserv.aoir.org"
	<air-l at listserv.aoir.org>
Subject: Re: [Air-L] question about using online comments
Message-ID:
	<CAGz-SeDABtp-rhfYtaa-52bwiCdPvkD_ooSdpea5xCxhasrEAA at mail.gmail.com>
Content-Type: text/plain; charset="UTF-8"

A lot of news websites offer an API that makes extracting comments easiest.

On Thu, May 4, 2023 at 2:23?AM Peter Timusk via Air-L < air-l at listserv.aoir.org> wrote:

> You can use some softwares like R or SAS or Python to request web 
> pages as data or text files. This may have varying degrees of success.  
> You can put these requests in loops to make multiple requests across 
> says dates of news reporting. Then you have to clean up the data and 
> isolate the comments from inside the text files.
>
> On Wed, May 3, 2023 at 4:49?PM Wiley, Chris via Air-L < 
> air-l at listserv.aoir.org> wrote:
>
> > Hi
> > I've been doing research using online comments on news websites.  I 
> > was wondering are there any tools to extract the comments outside of 
> > copying and pasting?
> >
> > Chris Wiley
> > _______________________________________________
> > The Air-L at listserv.aoir.org mailing list is provided by the 
> > Association of Internet Researchers http://aoir.org Subscribe, 
> > change options or unsubscribe at:
> > http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
> >
> > Join the Association of Internet Researchers:
> > http://www.aoir.org/
> >
> _______________________________________________
> The Air-L at listserv.aoir.org mailing list is provided by the 
> Association of Internet Researchers http://aoir.org Subscribe, change 
> options or unsubscribe at:
> http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
>
> Join the Association of Internet Researchers:
> http://www.aoir.org/
>


------------------------------

Message: 4
Date: Thu, 4 May 2023 14:49:47 +0000
From: Deena Abul-Fottouh <abulfodm at mcmaster.ca>
To: Peter Timusk <peterotimusk at gmail.com>, "avnerkantor at gmail.com"
	<avnerkantor at gmail.com>
Cc: "air-l at listserv.aoir.org" <air-l at listserv.aoir.org>
Subject: Re: [Air-L] question about using online comments
Message-ID:
	<YQBPR01MB10382ADAE2C1B7B6F591FD21DDE6D9 at YQBPR01MB10382.CANPRD01.PROD.OUTLOOK.COM>
	
Content-Type: text/plain; charset="utf-8"

   Hi,

   This tutorial video might be useful

   [1]https://www.youtube.com/watch?v=v8Yh_4oE-Fs
   [2]Web Scrape Text from ANY Website - Web Scraping in R (Part 1)
   Web Scraping in R is super easy and useful, and in this video I scrape
   movies from IMDb into a data frame in R using the rvest library and
   then export the data frame as a csv, all in a few lines of code. This
   method works across many sites -- typically those that show static
   content -- such as Yelp, Amazon, Wikipedia, Google, and more. Part 2
   ...
   www.youtube.com
   Best,
   Deena

   ____________________________

   Deena Abul-Fottouh, PhD.

   Postdoctoral Research Fellow

   Digital Society Lab

   Political Science Department

   Phone icon t??phone: [3](905) 525-9140
   Envelope icon ?email: [4]abulfodm at mcmaster.ca

   McMaster University

   1280 Main Street West

   Hamilton, ON L8S 4M4
      McMaster University Brighter World logo
     __________________________________________________________________

   From: Air-L <air-l-bounces at listserv.aoir.org> on behalf of Avner Kantor
   via Air-L <air-l at listserv.aoir.org>
   Sent: May 4, 2023 5:20 AM
   To: Peter Timusk <peterotimusk at gmail.com>
   Cc: air-l at listserv.aoir.org <air-l at listserv.aoir.org>
   Subject: Re: [Air-L] question about using online comments

   A lot of news websites offer an API that makes extracting comments
   easiest.
   On Thu, May 4, 2023 at 2:23?AM Peter Timusk via Air-L <
   air-l at listserv.aoir.org> wrote:
   > You can use some softwares like R or SAS or Python to request web
   pages as
   > data or text files. This may have varying degrees of success.  You
   can put
   > these requests in loops to make multiple requests across says dates
   of news
   > reporting. Then you have to clean up the data and isolate the
   comments from
   > inside the text files.
   >
   > On Wed, May 3, 2023 at 4:49?PM Wiley, Chris via Air-L <
   > air-l at listserv.aoir.org> wrote:
   >
   > > Hi
   > > I've been doing research using online comments on news websites.  I
   was
   > > wondering are there any tools to extract the comments outside of
   copying
   > > and pasting?
   > >
   > > Chris Wiley
   > > _______________________________________________
   > > The Air-L at listserv.aoir.org mailing list
   > > is provided by the Association of Internet Researchers
   [5]http://aoir.org
   > > Subscribe, change options or unsubscribe at:
   > > [6]http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
   > >
   > > Join the Association of Internet Researchers:
   > > [7]http://www.aoir.org/
   > >
   > _______________________________________________
   > The Air-L at listserv.aoir.org mailing list
   > is provided by the Association of Internet Researchers
   [8]http://aoir.org
   > Subscribe, change options or unsubscribe at:
   > [9]http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
   >
   > Join the Association of Internet Researchers:
   > [10]http://www.aoir.org/
   >
   _______________________________________________
   The Air-L at listserv.aoir.org mailing list
   is provided by the Association of Internet Researchers
   [11]http://aoir.org
   Subscribe, change options or unsubscribe at:
   [12]http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
   Join the Association of Internet Researchers:
   [13]http://www.aoir.org/

References

   Visible links:
   1. https://www.youtube.com/watch?v=v8Yh_4oE-Fs
   2. https://www.youtube.com/watch?v=v8Yh_4oE-Fs
   3. tel:+19055259140
   4. mailto:abulfodm at mcmaster.ca
   5. http://aoir.org/
   6. http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
   7. http://www.aoir.org/
   8. http://aoir.org/
   9. http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
  10. http://www.aoir.org/
  11. http://aoir.org/
  12. http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
  13. http://www.aoir.org/

   Hidden links:
  15. https://www.youtube.com/watch?v=v8Yh_4oE-Fs


------------------------------

Subject: Digest Footer

_______________________________________________
The Air-L at listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org

Join the Association of Internet Researchers:
http://www.aoir.org/


------------------------------

End of Air-L Digest, Vol 226, Issue 4
*************************************

More information about the Air-L mailing list