[Air-L] Tool to Download Websites?

Devayani Tirthali dgt2103 at columbia.edu
Tue Feb 14 06:55:49 PST 2012


I have used BlackWidow and BrownRecluse from Softbytelabs. Both have worked
well. Blackwidow creates the site structure from which you can select file
types to download as required. BrownRecluse is more programmable and can
download elements of a page in a database.

Devayani


On Tue, Feb 14, 2012 at 8:24 AM, Taylor, Nicholas A. <ntay at loc.gov> wrote:

> Hello Katie, the open source website copier HTTrack (
> http://www.httrack.com/) is commonly used to download individual
> websites. It saves downloaded pages as static, linked HTML files, which you
> can then traverse with your browser or easily access with other analytical
> tools. It offers configurable options for link depth and desired file types
> (e.g., if you were only interested in text), among other things.
>
> ~Nicholas
>
> Nicholas Taylor | Information Technology Specialist | Library of Congress
> Web Archiving
> _______________________________________________
> The Air-L at listserv.aoir.org mailing list
> is provided by the Association of Internet Researchers http://aoir.org
> Subscribe, change options or unsubscribe at:
> http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
>
> Join the Association of Internet Researchers:
> http://www.aoir.org/
>



-- 
Devayani Tirthali
Research Associate
Institute for Learning Technologies
Teachers College, Columbia University



More information about the Air-L mailing list