TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Getting around website paywalls with devtools alone

169 pointsby bebrwsabout 2 years ago

38 comments

samwillisabout 2 years ago
Many sites don&#x27;t contains the full content even if you do that.<p>I&#x27;m not sure of how it works (does it subscribed to them all?) but <a href="https:&#x2F;&#x2F;archive.ph&#x2F;" rel="nofollow">https:&#x2F;&#x2F;archive.ph&#x2F;</a> is a good way to see the content in those cases.<p>But really, if you are regularly reading content on a site you should subscribe to support the journalists employed there.
评论 #34955269 未加载
评论 #34956732 未加载
评论 #34954569 未加载
评论 #34965737 未加载
评论 #34954824 未加载
评论 #34954345 未加载
评论 #34954820 未加载
评论 #34955918 未加载
评论 #34954696 未加载
评论 #34955219 未加载
评论 #34954695 未加载
start123about 2 years ago
I just use Firefox&#x27;s reader view. Does the same with just a click. If it doesn&#x27;t work, just refresh in reader view and it should load properly.
评论 #34959389 未加载
drewtatoabout 2 years ago
Usually on these sites, there&#x27;ll be an `overflow: hidden` element that&#x27;s holding all the content. If you can find and disable that CSS line, it&#x27;ll work as normal. Or just save it to the Wayback Machine and read it through that.
评论 #34959341 未加载
评论 #34955340 未加载
batpersonabout 2 years ago
In the case of Washington Post it just has a &quot;position: fixed&quot; style on the &lt;body&gt; element. That&#x27;s usually the case with most of these scroll locking sites, one of the root parent elements will have some CSS style that you can click off.
jwrabout 2 years ago
What I find annoying about paywalled sites is that they provide the full content to Google. And Google is OK with indexing the full content, even though it is not available on the internet, and even though they explicitly forbid the practice of showing different content to a search engine from what is available publicly.<p>Paywalled sites are just fine, but they are not part of the open Internet, and should not pretend to be.
评论 #34954749 未加载
评论 #34957391 未加载
评论 #34955247 未加载
评论 #34957861 未加载
_boffin_about 2 years ago
or... just remove the `overflow: hidden` that&#x27;s most likely placed on the `&lt;body&gt;` or some high level `&lt;div&gt;`.
评论 #34954650 未加载
评论 #34957736 未加载
retoxabout 2 years ago
A handful of sites will present the subscribers view of the page if you put a dot after the tld part of the url, i.e.<p><a href="https:&#x2F;&#x2F;site.com.&#x2F;1235&#x2F;article" rel="nofollow">https:&#x2F;&#x2F;site.com.&#x2F;1235&#x2F;article</a><p>Those behind Cloudflare don&#x27;t seem to be vulnerable to this though.<p>I&#x27;ve emailed the sites I&#x27;ve found where this works and none of them have fixed it after a year.
评论 #34954396 未加载
评论 #34954455 未加载
评论 #34954493 未加载
评论 #34954435 未加载
_the_inflatorabout 2 years ago
A Clickbait Transformator would have opted for a headline along the lines: &quot;This tip saves you thousands of Dollars!&quot;. ;)
karrotwaltzabout 2 years ago
I use this JS bookmarklet to remove fixed elements and restore scrolling, it works most of the time:<p><a href="https:&#x2F;&#x2F;pastebin.com&#x2F;qBjJHkMv" rel="nofollow">https:&#x2F;&#x2F;pastebin.com&#x2F;qBjJHkMv</a><p>I also have one to kill all running javascript and remove all event listeners, it works wonders when you are redirected to a paywall &#x2F; login page after a few seconds.
评论 #34954666 未加载
arbolabout 2 years ago
Good tip. Sites turning off scroll is one of my pet annoyances.
PufPufPufabout 2 years ago
I recommend the browser extension &quot;Bypass Paywalls Clean&quot;. I sometimes think about the morality of using it, but I just don&#x27;t find it viable to pay all the websites where I read just a single article.
评论 #34954772 未加载
kokaneeabout 2 years ago
If you&#x27;re unable to scroll the page, it generally means there is a &quot;position: fixed&quot; css rule on the body or a wrapper element. Turn off that css rule and you can scroll through the article normally.<p>Publishers are slowly wising up, though. Most don&#x27;t load the full article for unpaid viewers anymore.
porbelmabout 2 years ago
Yeah on the system most of the local papers use over here, the full content is not even loaded for non-subscribers. It used to be, so removing the blur div worked, but now only the headline, byline and lead text are visible :(<p>Guess they caught on to the &quot;cheaters.&quot;
Am4TIfIsER0pposabout 2 years ago
Just like with pointless loading spinners. You just delete the element which is overlaid on the complete content. Sometimes there is an overflow, opacity, or visibility attribute that needs changing. Fucking webdevs!
bubblebakerabout 2 years ago
My method is to use ublock origin extention to block third party scripts.
phtrivierabout 2 years ago
Title should be : &quot;getting around very poorly implemented paywall (eg WaPo) with devtools alone&quot;.<p>As soon as your site sends the whole content of the article to the browser, you&#x27;re not even trying seriously. (And Firefox &quot;reading mode&quot; is just much better ux than the devtools.)
71a54xdabout 2 years ago
Your site&#x27;s feature of &quot;cool comments from HN&quot; is awesome! Automating this with some kind of LLM and selling it would be killer.
vixen99about 2 years ago
Does not work with <a href="https:&#x2F;&#x2F;www.spectator.co.uk&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.spectator.co.uk&#x2F;</a>
vixen99about 2 years ago
Did not work with <a href="https:&#x2F;&#x2F;www.spectator.co.uk&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.spectator.co.uk&#x2F;</a>.
l3mureabout 2 years ago
Another devtools trick I&#x27;ve used is network throttling to allow me to copy out an article&#x27;s content before JS loads.
dspillettabout 2 years ago
<i>&gt; But I didn&#x27;t know how to scroll down on the page until today.</i><p>That is usually due to an &quot;overflow: hidden&quot; somewhere near the top of the DOM tree. Remove that and your normal scrollbar usually returns. You see this a lot with &quot;accept being stalked to read this&quot; pop-overs as well as paywall related shenanigans.<p>I&#x27;ve seen some sites put it back in via JS. There is probably a workaround for that too though the easiest one is to not worry about it and DNS blacklist the site so you don&#x27;t waste time visiting it again in future.
Eupraxiasabout 2 years ago
Anyone else just read content in source?
alkonautabout 2 years ago
10 years ago paywalled sites contained the content just hidden. Today I haven&#x27;t seen a site in a long time that renders the content hidden (why would it do that? There is no reason to do it based on indexing&#x2F;SEO as far as I&#x27;m aware).<p>Even cached&#x2F;archived versions these days tend to not include the whole text. Basically: they figured out how to make a paywall, which frankly isn&#x27;t that surprising.
评论 #34955259 未加载
CodeHzabout 2 years ago
Maybe it just a transparent div that blocked all the pointer events?
oh_sighabout 2 years ago
Generally just disabling JavaScript for the site works perfectly.
snaixabout 2 years ago
Shortcut in macos, in most browsers, to get into &quot;div selection mode&quot; is &quot;shift + command + c&quot;...<p>Just press that, select the paywall (and any other junk backdrops&#x2F;opaque divs), and press delete.<p>Sometimes the site also sets an `overflow: hidden` in the css, and you need to remove that to see the content..
kozincabout 2 years ago
Sometimes, however, you don&#x27;t even get a full article text when the paywalled site loads. In those cases, no amount of Scroll Into View will help.<p>For those cases try something like Google Cache or Wayback Machine! It still won&#x27;t always work, but it&#x27;s nevertheless got a pretty good success rate.
iKlsRabout 2 years ago
The simplest method is just to refresh the page and hit Esc as quickly as you can to cancel the page load and prevent further scripts from running, that works for me 80% of the time. Sites need to be indexed by google so any paywall is often client side js.
pentagramaabout 2 years ago
This extension removes paywalls on many news sites (maintained, 33k stars) <a href="https:&#x2F;&#x2F;github.com&#x2F;iamadamdev&#x2F;bypass-paywalls-chrome">https:&#x2F;&#x2F;github.com&#x2F;iamadamdev&#x2F;bypass-paywalls-chrome</a>
评论 #34992771 未加载
thallosaurusabout 2 years ago
Oh yeah, used this method to bypass a regional paywalled news site until they fixed it by sending out scrambled text that seems random enough to not be a cipher (&quot;Zc xjixc Axiäclxiqcil jcqlxi ljx Zxcxqjxiqxi cc&quot;)
suhaybhabout 2 years ago
I just use <a href="https:&#x2F;&#x2F;github.com&#x2F;iamadamdev&#x2F;bypass-paywalls-chrome">https:&#x2F;&#x2F;github.com&#x2F;iamadamdev&#x2F;bypass-paywalls-chrome</a> and it works well for me.
jrberendtabout 2 years ago
It&#x27;s insane that news sites with thousands or even millions of monthly users have paywalls like this. Sure it&#x27;s great for anyone who wants to read for free, but some individuals make their livings now through paywalled articles. If the big guys can&#x27;t protect from exploits, what about everyone else?<p>I created <a href="https:&#x2F;&#x2F;turbolink.io" rel="nofollow">https:&#x2F;&#x2F;turbolink.io</a> to attempt to solve this problem.
kleinmaticabout 2 years ago
Pretty amazing how many people&#x27;s ethics are less valuable to them than their product design opinions.
throwaway29303about 2 years ago
It seems the cat&#x27;s out of the bag now. There&#x27;s also another interesting way of getting around paywalls: a simple race condition. While loading the page hit stop as soon as you load enough of the content you&#x27;re interested in <i>et voilà</i>. It <i>does not</i> work 100% of the time <i>and</i> I&#x27;m not using Chrome, however. ;)
kjeksfjesabout 2 years ago
Hush?
1vuio0pswjnm7about 2 years ago
Another option no one has menitoned is AMP. Many sites that try to use &quot;paywalls&quot; have AMP URLs which point to pages that have all the full text of the article in &lt;p&gt; tags. These AMP sites generally look great in a text-only browser that does not run Javascript. Popular example is WSJ. In the URL, add &#x2F;amp before &#x2F;article&#x2F;.<p>Paywalls are insidious because they target non-subscribers. Why let non-subscribers view articles. Why not password protect all subscriber content. Paywalls are a way to make money from (the attention of) non-subscribers, targeting them with ads and tracking. The strategy is apparently to annoy people to the point of subscribing. Yet even if they subscribe they will still be subjected to advertising. One potential advantage is that a paying subscriber has an enforceable contract. In theory the contract could contain enforceable privacy protections. &quot;Tech&quot; companies would never agree to give people enforceable privacy protections; it would destroy their &quot;business&quot;.<p>The way to save journalism, especially local news, is to regulate &quot;Big Tech&quot; middlemen, who generally do not employ journalists and produce zero content.1 The quality of journalism in general has taken a nosedive, but placing the blame for that on web users not purchasing subscriptions is conveniently ignoring the true culprit.<p>1. Arguably that&#x27;s a prerequisite to maintaining their Section 230 protection. In the recent Supreme Court oral arguments, Google&#x27;s counsel argued Google is not a publisher. Then minutes later she argued Google has to make design decisions &quot;like any publisher&quot;, therefore Google gets a free pass to reorganise information in annoying and perhaps harmful ways to maximise ad services revenue, like inserting &quot;popular&quot; videos into YouTube search results that have nothing to do with the query string.
评论 #34961655 未加载
评论 #34955998 未加载
评论 #34955233 未加载
bebrwsabout 2 years ago
A code free way to view a site with a paywall and navigate or scroll your way through the content.
encryptluks2about 2 years ago
Some sites now are literally not loading the actual paywalled content until after you sign in, so not matter what you do you aren&#x27;t going to be able to access it unless someone with a paid subscription shares that content and it is then uploaded to a third party paywall bypasser.
评论 #34954750 未加载