TE
TechEcho
Home
24h Top
Newest
Best
Ask
Show
Jobs
English
GitHub
Twitter
Home
How does archive.today work? How do they a paywall free version of web pages?
8 points
by
atulvi
4 months ago
1 comment
jsheard
4 months ago
Collapse
I would guess they pretend to be a search engine crawler, which are usually allowed to see paywalled pages. There are ways to reliably detect fake crawlers but few paywalled sites seem to bother doing that.
评论 #42816653 未加载
评论 #42816635 未加载