Hello! Zack Maril here.<p>I've been working on this research for over two years now. I got started working on it after I read everybody on Hacker News talking about how they kept getting blocked when they were crawling websites[0][1]. This has been a huge part of my life these past few years and it wouldn't have happened without the Hacker News community, so, from the bottom of my heart, thank you.<p>If you would like to read more about this research, please check out Knuckleheads' Club[2]. I've published a lot of what I have so far there and plan on publishing more soon. You're all invited to join the club and I'll be checking this thread all day and responding to folks as best I can.<p>[0] <a href="https://news.ycombinator.com/item?id=9612345" rel="nofollow">https://news.ycombinator.com/item?id=9612345</a><p>[1] <a href="https://news.ycombinator.com/item?id=17941804" rel="nofollow">https://news.ycombinator.com/item?id=17941804</a><p>[2] <a href="http://knuckleheads.club" rel="nofollow">http://knuckleheads.club</a>