#50: Web scraping at scale with Scrapy and ScrapingHub

Published: March 15, 2016, 8 a.m.

b"What do you do when you are working with an amazing web application that, for whatever reason, doesn't have an API? One option is to say I wish that site had an API and give up. Or, you could use scrapy, an open source web scraping framework from Pablo Hoffman and [scrapinghub.com](scrapinghub.com) and create your own API!"