Description
A quick yet reasonably thorough introduction to Scrapy, the high-level web crawling & scraping framework for Python. Includes a demo, cause I like living on the edge. The "core concepts demo" is a hands-on introduction, starting from a simple example and progressively adding more features. It covers the following topics: * Spiders (Spider, CrawlSpider, etc) * Selectors (XPath, CSS, Regex, etc) * Items & item loaders * Input & output processors * Pipelines Slides from the previous version of this talk: https://speakerdeck.com/citizen428/aaaarrgghh-spider-web-scraping-with-scrapy
Ruby developer since ~2003. Py-curious, Love FP. I talk a lot about programming.