The Web is the quintessential human artifact. This is what happens when large groups of people crap and eat from the same pile, the fast, the slow, the brilliant and the stupid, the refined, mundane, bloodthirsty and curious, the intricate and obscure.<p>I think of the web in layers. Not discrete, divisible layers, but more like the layers of any ancient city that's seen habitation for centuries. At the lowest level is the oldest stuff: mud huts, stone tools, open fireplaces, graves even. This is like the earliest layers of the web: the webrings, the no-css, no-script HTML bulleted lists, tables of blue links. Even garish black backgrounds. That old web was full of great things; so many enthusiastics and fanatics! So much information and content, written by real people. Short stories, poems, hackers, phreakers, crackers, IRC, that whole great era. That old stone age is mostly buried now, preserved here and there in museum quality, crumbling here and there, broken links, missing images. A mute reminder, hard to find even, of what it was like back then. BACK THEN, before the next layer of the web evolved on top. BACK THEN people on the internet were mostly curious but not nosy or malicious. BACK THEN people put effort into their sites, had to pay money to host their domains, didn't need CDNs and VMs and Cloud Computing.<p>But a layer evolved on top of that old web. It came with CSS in my estimation. Pages started getting fancy, using new fonts. Ads started popping up. Ads always started popping up. Search engines popped up. Then people started making money. Little trickles at first, then a gush, then a torrent. Online businesses, the FIRST BUBBLE, and everyone was rushing to pets.com and eBay and online pharmacies...you know, companies selling actual stuff. Amazon. Online publishing, news sites.<p>That bubble blew up. It grew too fast, people went into far too much debt to puff up their businesses. But quietly chugging along, always increasing, the little banners and annoying popups gave way to a more insidious form of advertising...the watching eye behind it all. The internet started watching us. First it was search history, then cookies and then fingerprinting, then whole underground economies of trackers. And all the while the SEO battles and trollers came along, so fast paced...<p>And something...else...grew on top of the web. You can see it now, maybe just the tip, when you go to one of the news sites that the OP talked about. The massive, heavy sites. Those are just the most polished of this massive avalanche of click-baity slide shows and fake news and crap that is heavy, laden with strewn together junk parts and oriented to only one purpose: making money, by hook or crook.<p>Now you can't hardly see through this layer anymore. It's like a fog. Go to any search engine and search for anything! What do you get? Aggregated, evolved--I won't say optimized--evolved content that is designed to keep you away from the older layers. I say evolved because that is exactly the right metaphor--the crap that survived by natural selection and crowded out the other, more carefully crafted, humble and matter-of-fact content. This new crap evolved to get straight to the top of the search ranking and grab those clicks. It doesn't matter what the original content was. The more commercial it is, the crappier it is for real content, and the more driven it is towards getting you to click through and BAM make a sale. For god sakes, try to find some neutral information about insurance. Try to find that one guy's website that as part of a trip report to the southwest to go hiking with his kids, talks about how the rental agency wouldn't reimburse him for a flat tire. Or some basic, old-web archaeology like that. You cannot find that stuff anymore. It's hidden by a huge layer of <i>commercial bullshit</i> that is designed to lure you in, sell you crap, get you to sign up for newsletters, take surveys, or at the very least track your ass at the slightest sign you might be interesting. And don't think for a minute that it's all an accident, or some unforeseen consequence or poor search ranking function. The whole system is set up to, and rewarded by, and fed by, their ability to serve <i>themselves</i>, not you. Make no mistake. If the algorithm makes more money, it's gonna get shipped. People might wring their hands about it, but the slippery slope is still slippery, and no one can hold the line forever. Least of all when that takes mental energy and forethought...something SO much better suited to ML algorithms and <i>scale</i>. Just <i>scale</i> up to the whole web.<p>We lost our way. The web isn't run by us anymore. It's run by <i>them</i>. And <i>them</i>...whoever they are...search engines, advertisers, publishers, people with political agendas, psychos, dictators, people with power. They don't even have control either. Look at the news sites and aggregators. They tell you want they want to tell you. You can't even set preferences anymore. It's all drive by AI. For fuck's sake nobody really knows what to tell the AI to do, except make money.<p>AI. AI to rank what's important. To tell us what we should look at, watch. Buy. Adjusting news to either make us mad or placate us. Creating and reinforcing a bubble that absolutely <i>always</i> benefits someone else besides ourselves. We keep giving it subgoals, but it'll just keep going around them to what we really want, <i>making money</i>, because that's all we ever reward it for!<p>The fat ass webpages is just a symptom. The disease is that everyone is shoveling shit into your face just to make a buck. Everyone is trying to automate their crap as fast as they can, throwing crap at the wall to see what will stick. And they just. don't. give. a shit.