Huge fan of DiffBot and awesome projects like this. Really cool analysis, thanks for posting.<p>Would be possible for you to post / send me the original data? I have been very interested in working on more longitudinal analysis using DiffBot data and this seems like a fun and interesting place to start. I'm happy to open-source / clearly attribute DiffBot's contribution to whatever I find / hack together, and would feel a lot more comfortable about integrating DiffBot into larger projects in the future.<p>Please email me (in my profile) if this is a possibility. Thanks!
Funny, I just built a HN article catcher that uses Diffbot to collect and classify submissions from the /new page [1]. I've been a Diffbot fan for quite a while now (although their entity recognition/tag classifier needs a bit of work as you can see from the categorization on my catcher page below).<p>[1] <a href="http://lahiri.me/more" rel="nofollow">http://lahiri.me/more</a><p>I should add that their API is fantastic, and far better than using BeautifulSoup/NLTK for extracting textual content from webpages.
Had to figure out how to use it ... but interesting once you do! Android vs IPhone on Hackernews frontpage shows spike in iphone on launch dates, but mediocre to no activity for android. is it because android is less interesting and not as innovative? or not as fun to talk/read about?<p><a href="http://diffbot.com/robotlab/hackernews/#type=tags&item=IPhone&item=Android%20(operating%20system)&item=" rel="nofollow">http://diffbot.com/robotlab/hackernews/#type=tags&item=I...</a>