Ask HN: Is HN used as AI dataset?

3 点作者 jb_briant4 个月前

Someone, somewhere is scrapping, right?

3 条评论

I've turned up several of my own HN comments using FastGPT, from Kagi Labs.<p>Whether that's training data or live search results I'm not entirely sure, but HN definitely contributes to results in that case.

pvg4 个月前

There's are a couple of different APIs and full datasets are downloadable so the data is readily accessible without scraping anything.

zoezoezoezoe4 个月前

if it's on the internet, it's in a dataset somewhere at this point.