Baike.dev
All toolsOnline toolsAI codingTrendingOpen sourceNewsSubmit
Log in
< Back to tools
S

Scrapy-Samples

> 编程语言
Open source

Scrapy examples crawling Craigslist

199 stars0 likes1 views
WebsiteGitHub

About

Scrapy examples crawling Craigslist

Scrapy Samples

This project contains sample scraping projects/tutorials as detailed in my blog. If you need help with downloading Scrapy and installing the dependencies, please watch this video - http://www.youtube.com/watch?v=eEK2kmmvIdw&feature=plcp

BaseSpider

  • This is a simple tutorial on how to write a crawler using Scrapy (BaseSpider) to scrape and parse Craigslist Nonprofit jobs in San Francisco and store the data to a CSV file.
  • Tutorial: http://mherman.org/blog/2012/11/05/scraping-web-pages-with-scrapy/
  • Video: http://www.youtube.com/watch?v=1EFnX1UkXVU

CrawlSpider

  • This tutorial adds to the BaseSpider code, in order to build a recursive crawler to scrape multiple pages. Make sure you read the first tutorial first.
  • Tutorial: http://mherman.org/blog/2012/11/08/recursively-scraping-web-pages-with-scrapy/
  • Video: http://www.youtube.com/watch?v=P-_TpZ54Vcw

Todo

  1. Add more use cases

Issues· 0 open

View all issuesOpen on GitHub

No open issues yet, or sync has not completed.

> Tags

Python

No comments yet. Be the first to share.

> Details

PublishedAug 1, 2026
UpdatedSep 18, 2026
Category编程语言
PricingOpen source

> Related tools

T
TypeScript
JavaScript 的超集,为前端与全栈提供静态类型
P
Python
通用编程语言,广泛用于 Web、数据与 AI
G
Go
Google 推出的简洁高效系统语言