:scissors: High performance, multi-threaded image scraper
:scissors: High performance, multi-threaded image scraper
A high performance, easy to use, multithreaded command line tool which downloads images from the given webpage.
| Build Status | Downloads | Test Coverage |
|---|---|---|
Click here to see it in action!
Grab the latest stable build from - Pip: https://pypi.python.org/pypi/ImageScraper
You can also download using pip:
$ pip install ImageScraperNote that ImageScraper depends on lxml, requests, setproctitle, and future.
If you run into problems in the compilation of lxml through pip, install the libxml2-dev and libxslt-dev packages on your system.
$ image-scraper [OPTIONS] URLYou can also use it in your Python scripts. (Deprecated)
import image_scraper
image_scraper.scrape_images(URL)…Extract the contents of the tar file.
$ cd ImageScraper/
$ python setup.py install
$ image-scraper --max-images 10 [url to scrape]
Scrape all images
$ image-scraper ananth.co.in/test.htmlScrape at max 2 images
$ image-scraper -m 2 ananth.co.in/test.htmlScrape only gifs and download to folder ./mygifs
$ image-scraper -s mygifs ananth.co.in/test.html --formats gifBy default, a new folder called "images_" will be created in the working directory, containing all the downloaded images.
Q.)All images were not downloaded?
It could be that the content was injected into the page via JavaScript; this scraper doesn't run JavaScript.
If you want to add features, improve them, or report issues, feel free to send a pull request!!
ImageScraper is to be used education/research purposes only. The authors takes NO responsibility and/or liability for how you choose to use any of the tools/source code/any files provided. By using ImageScraper, you understand that you are AGREEING TO USE AT YOUR OWN RISK.
No open issues yet, or sync has not completed.