Hi, I’m a pretty experienced scraper/automator and I was thinking about sharing my knowledge. I originally thought about writing a blog, but I'm not sure that would be the best format to transmit everything I know. Maybe I'll do both.<p>There would first be a quick introduction to the legacy ways of scraping(i.e GET request+parser), why they’re often not enough today and when can they be still used.<p>Then I’d delve into more advanced techniques, I usually try to find the cheapest/free solutions to the problems I’m solving but I’ll also compare paid options:<p>-how to make your scrapers/bots as stealthy as possible<p>-everything you need to know about fingerprinting<p>-how to bypass datadome, cloudfare, captchas…<p>-how to scale to millions of requests<p>-how to make your own free rotating proxies<p>-how to do automation on mobile apps and desktops<p>-how to reverse engineer APIs on the web or mobile<p>-every tips and tricks I know to scrape better<p>I may add a section on GPT/LLM, either about how to fasten the development of a scrapers or about how to make self healing scrapers.<p>Is this a topic that would interest a lot of you?<p>Would some of you be ready to pay a small amount for an ebook/courses on those subjects?<p>Thanks
I would creating a landing page that creates a mailing list to get notified of when the ebook comes out. plus example scripts<p>Then I would would create blog posts around a hook for each chapter in the book with enough teaser info to want to get the ebook and when new articles are coming out.