238 comments in a recent discussion "Ask HN: What are best tools for web scraping?" <a href="https://news.ycombinator.com/item?id=15694118" rel="nofollow">https://news.ycombinator.com/item?id=15694118</a>
I use scrapy, although it doesn't do great w/ JS heavy sites unless you can figure out the ajax request and just simulate those. Tutorials are pretty easy to find, as it's the top python based scraping tool.