It feels like the web has just become either social media or AI. There isn't any room for smaller sites to find users anymore.
Obviously, I'm not thinking about "efficiency" and "productivity gains" here, but I do have fond memories of ordering Chinese food over the phone. We had a few places and their phone numbers on the fridge, like that takeout place, or places like Pizza Hut (the dine-in experience was awesome!), and so on.
It felt like places had soul, even the Taco Bell or Pizza hut; now everything is corpo-slop or ghost kitchens.
I'm far happier making my own food at home, and I have zero interest in "supporting" local establishments that want to shake me down because they are run like PE sweat shops.
Yeah, I don’t understand it but so many casual restaurants do not want you eating in them anymore, and it’s not just the big chains.
It’s confusing to me. Does nobody else have business or a fun activity in another neighborhood and stop for a quick bite anymore? Or meet up with friends at the cheap restaurant down the street?
I recently moved back to a city I lived in before Covid, and the biggest shock is how most eateries survived the pandemic, but they have few actual patrons now, only a constant flow of square-backpack delivery drivers going in and out of them. I'm told its because people in their 20s and early 30s now (i.e. the demographic here with a lot of disposable income) aren't much interested in going out to eat; it has become normal that the food comes to them.
There's opportunity out there to build the tools that enable protection for smaller, more focused internet. Until then, its a dark forest.
Adults talking to minors of the forum wont make you arrested. But, blatantly facilitating child abuse again and again and again maybe with some low probability will.
The two are not the same. Not at all.
None of them have needed to sign up for any sort of AI image classification service or moderation setup. My own site has done fine for the last decade with just human moderators and a relaxed community.
It's hardly surprising most normal private individuals don't want to do this and prefer a Web 2.0 style hosted app. They offer better convenience, design, privacy, security, etc.
I only ran a dozen queries but it was memorable. I didn't see a website with "under construction" in it in the decade before nor the decade after.
It seems like an unfinished approach. (Perhaps add dns data?)
Someone should do a p2p search engine and crawl those 100 to 800 thousand new domains per day. Leave them in the index for a week or a month. Make the removed ones into a download, perhaps with some [traffic] data.
The whole StumbleUpon idea was huge for a while too. Didn’t age well though, it was a novelty. I think this was around the time most people switched to a Feed style of information and that sucks your available attention
The once beautiful visualisation of nodes has turned into a glowing donut of activity. Lots of people care enough to use it. You don't have to use the network, it's already great if you only crawl the website you care about.
Ideal I think is to give it some bandwidth the first few days then tune it down to the minimum.
Everything is a private app, or walled-garden served over HTTP/s.
The web now is mostly an ecommerce platform with Google being an e-commerce search engine.
The web of late 1990’s early 2000’s is dead. Sadly,
I probably could have worded it better.
Indeed HTTPS / TLS is a good thing.
With enough gate keeping things could get to a point where the peasants have to extend a document format to be able to publish applications.
When that happens we will have to prevent users from finding them until we find a better method of shutting them down.
One day we will control what they can talk about and our official narrative will be all that remains.</sarcasm>
My sector is currently on strike, I could find exactly one outdated news article where one of the big employers says it has no influence on operations. Like they would pay many millions per month for work they could easily do without.
The last two surviving text based sites are reddit and x. Reddit is going out of their way to become an Instagram feed, and what remains is mostly bots and astroturfing. X, even ignoring the bots and nazis, is not a place for long format.
There's still pockets like IMDb reviews or this site, but it's an extreme niche. I even have people at work who communicate by audios and videos whenever they can rather than writing on slack.
They've made the internet broadly unuseable. I absolutely loathe visiting unfamiliar websites. Sometimes you can't even find the article amidst the spam, pop-ups and autoplay videos.
Meanwhile I've conditioned myself to not even recognize what it is that's being advertised at me, so it's all for naught.
It's a futile arms race between advertisers finding ever more annoying ways of getting my attention and me finding ever more devious ways of averting my eyes from whatever it is they want me to recognize.
that said, it's true that SEO did kill even that, because the headlines began to be "You won't believe who tonight's SNL headliner is" and they even keep the name out of the slug too.
## Someone is hosting SNL this week.
In this article we will tell you who is hosting SNL this week.
### What is SNL?
SNL, or Satruday Night Live, is a sketch comedy show that originated back in...
### A brief history of sketch comedy
...
### Past SNL hosts
...
### This week on SNL
<this section still does not say who is hosting this week>
...
...
...
...
---
This almost every webpage/blog post I've found through a search engine since around 2016 (I remember around that time every single time I'd search something about React, every article would start with many paragraphs describing what React is).
Anyway, ya. People say that nostalgia for the "old web" is just that (nostalgia). I disagree, but ya.
When I seached it, one of the top links was this very same Hacker News thread.
Is there anything after AI though? As long as we allow AI to benefit individual people, we seem headed to an ad-free custom GUI future.
As you say, it has already started with AI rewriting web results into a focused text response--a text interface.
Frontier AI models have started drawing little diagrams and creating little interactive apps that go along with whatever they're trying to demonstrate. They also extract images from--well, from somewhere, the web I assume?--and placing those images in their text responses.
I've been using AI to write custom widgets for the game Beyond All Reason (which is open source and allows custom widgets), and it's great even with this obscure API. It can turn ideas into beautiful custom graphics easily.
I don't want to see your ads, or even your webpage. I just want the information.
Maybe with AI everywhere we can finally do some sort of micropayments where the AI can distribute a fixed amount of money on my behalf. I am willing to directly pay a small amount for casual browsing.
snort, No, you will get ads. It will be all ads eventually. It always turns into ads.
I mean, there may be a niche case where only one airline offers an unusual flight, so be it, but in general there are always going to be multiple companies offering flights, and each of those companies wants to participate in the market (that's kind of the point of our economic system) and so they will make information about their flights available.
I'm saying you can't "filter out ads" if all the content you get is already ads, and you can't replace a search index with a local LLM.
Of course that would burn through a lot of resources and generally be inconvenient in various ways so inevitably someone would launch a centralized version and the cycle repeats.
That depends very much on where you are going and how much time you have to wait for connecting flights.
> And those companies still want to attract customers
If they're the only game in town they don't have to attract them. Airlines would rather consolidate and collude than compete. https://apnews.com/travel-a6ad554f766540dba6536c7d41ab0d39
> so why wouldn't other airlines offer information about their flights my AI can collect?
Because they'll want you to use their app to get that information so that they can collect massive amounts of your personal data and customize what flights and prices they'll offer you depending on who they think you are and how much money they think you have.
Imagine you ask "quick snacks for Superbowl Sunday" - but the dairy industry has bought ad space. You'll get suggestions for cheesy nachos and spinach dip for sure, and chicken wings and other non-dairy options might be slightly less likely to appear, or described in slightly less enthusiastic tones.
And if the AI folk have their way, it won't stay in the chatbot either. When your day-planning agent or personal shopper gets ads, you won't even see the text.
There are multiple very good reasons to host your own AI models. Those reasons are not going away with time, but rather multiplying.
It's about capability:
1. Do you have the right hardware? Most people don't and hardware has just exploded in price. One of the RAM makers and also AMD have said they will focus on data centers, which will only make things worse.
2. Do you have the know-how? It needs to be as easy as installing and using Chrome.
3. The end result needs to be directly as usable as ChatGPT.
Fairly local LLMs fail all 3 points.
However, Apple is already including LLM models automatically with even iOS that can be queried for historical facts, etc.
We need unified memory for almost everything for these types of setups to be usable and we also need to standardize LLMs, if everyone wants to run their own LLM locally, that will probably be untenable for decades. We probably need new DRAM tech (3D RAM?).
Hardware prices need to go down a lot, and we're probably 5+ years away from that. Not only do prices need to go back to where they were, they need to become even lower. So we're probably 10+ years away from usable good enough local LLMs for the masses.
It's going to be an ugly decade from a hardware economics point of view. The potential is endless, but the way there is hard.
Drink the verification can!
Every time I do a google search to cross check something, the AI answer has been incomplete or incorrect.
I can only assume the answers I don't know are the same.
I don't want the AI answer, I want the actual information.
Right. Why? That's a nightmare that Google built for us. They lined the pockets of SEO spammers, and because it was their business, they made talked the talked but were never willing to truly deal with the problem.
But even in your SNL example, to show you the answer, Google AI needs to take it from someone who actually made an effort to put this information online. Network programming is an rare corner case where the person doesn't mind the bot slurping it up because the goal is to get people to watch SNL, not to visit a website. But there is so much non-commercial content on the internet that is really getting hosed right now, and that people probably simply won't be putting online anymore because they don't want to do free labor for OpenAI or Google.
As a practical example, there's a lot of hobby historian communities dedicated to specific places, periods, or types of collectibles, and the only reason they exist is to bring people together and share their finds and wisdom. If you're a historian of Kinder Surprise toys or old military uniforms or whatever, and Google is now taking your work without letting you connect with like-minded individuals, there's really little incentive left.
Who cares if it isn’t googleable. There’s other ways to build community and other avenues to be recognized for your work.
AI search results are inserting themselves as intermediaries in that process of discovery. This is the opposite of what the net achieved, and its reducing the rate at which potential group members ever find community.
I don't think this will play out as you imagine there, because those platforms will drown out human made content with ai copycats until nothing but the already established players are left
It's funny. Until a couple years ago I really hated walled gardens like facebook groups, discord and other app-only communities. But now I find myself defending them, as a last frontier against automation, where you can still hangout with real humans online...
The difference is that Google aggregates content from everywhere, so you don't need a pre-existing relationship with any of those places to find content. If you want to find a YouTube video without Google you have to go to YouTube to search for it. That's great for YouTube, but it makes it virtually impossible for any other video platform to get a foothold.
The beauty of Google is (was?) that it was a way to get traffic if you weren't already the incumbent. What you're suggesting is that we should give up on having new platforms and just stick with the existing ones, even if they're terrible now or they decline in the future. That's not fun.
Google was great for finding products and services, but poor at finding the type of communities we are describing.
Google is also in the unique position of selling both search ads and display ads. And they know what a visitors ad exposure is for links in the search results. They make money on both sides of the click.
(I do work for Alphabet so make of that what you will, maybe the Upton Sinclair quote does apply.)
Won't the people who are interested in connecting with like minded individuals click through anyway? The 40% who aren't clicking now are the people who were just coming to get the info and bounce, they weren't the ones connecting with like minded individuals.
Sites that were too big to just be run as a couple hours a week hobby project level, for years, relied on all traffic, including people who only read a page or two, to generate money via ad revenue. And the site being big, and existing in search results meant it was there for that core audience of people who might build community there.
All this is undone if hosting a site is no longer rewarding because you get no actual visitors and no community forms, while your content is just repackaged by commercial AI.
And I say this as a definite net promoter of AI. I just am honest that from a content publisher’s point of view, yup, they are getting screwed hard here - there’s no upside for them.
The biggest problem is the general shift by which most of the world uses smartphones to access the internet, not computers. This medium seems to discourage traditional web content at a societal scale. A lot of younger people barely ever open a browser, their internet use is exclusively through apps. That causes traditional web content to gray out and become even less appealing to audiences.
I was taken aback when I learned that my obscure blog (no app; 1k page views/day average) gets 70% of its traffic from smartphones, congruent with your observation.
Since I solely use my laptop to produce my blog I was taken aback and immediately checked to see how it looks on my phone — something I'd never done.
To my surprise and delight it displays perfectly there: in fact, it looks much better.
FWIW just for lulz the other day I tried the iPhone Kindle app to see what it was like to read books there. I used white type on black background: excellent! Easier, sharper, all around better than my latest gen Kindle Paperwhite, which is what I use to read in bed at night.
I won't use screens (read phones/tablets/laptops) in my bedroom so I'll stick to the Paperwhite there.
And the costs of putting something on line were commensurate with the number of people who needed to be paid to accomplish that goal. When Al Gore made the first website in the early 90s, it probably cost a few pennies of electricity and the effort of some grad students who worked for a few more pennies. Today, putting a website online involves paying a lot more companies who have massive bottom lines to support.
And that's before we get to the other problem: what's under the AI summaries, and what's often "cited" by the summaries, is LLM slop too, because it's now practically free to create on any topic. For example, I searched for info on a vintage calculator just yesterday, and ended up on this page:
https://www.calculator.org/calculators/Calfax_Calfax.html
It's just data scraped from real hobby websites to boost their page rank. And everything is like that now. No subject is too insignificant for LLM spam because the cost is negligible.
These are far more common than niche hobby collectible communities, and if those communities love bringing people together those people can still hang out together!
People who are looking for others with a similar passion—which, if it’s a niche interest, sounds quite nice—still have access to search results or the sources shown on the AI summary.
But for the vast majority of things, we don’t need 29 sites competing for SEO on “Which channel is the US Open on?”
IMHO, Wikipedia has similar culture problems to Stack Overflow, just less extreme, and its editor decline trend started before AI and AI overviews.
Due to those culture problems, eventually Wikipedia will be completely dominated by people dedicated to pushing ideological agendas and others who just like throwing the book at newbies.
different thing is that it allows joirnalism... that can quote wrong from wikipedia
this topic is in my opinion much smaller than AI slop learning om AI slop
for the impact of wikipedia on journalism (mankind?) the circular reporting cases are relatively minor
https://en.wikipedia.org/wiki/Circular_reporting
https://en.wikipedia.org/wiki/Wikipedia:List_of_citogenesis_...
I would complain more about
1) death of forums
2) reddit being plagued by bots, artificial upvotes
3) reddit mod problem (mods can create a community, but also mods cannot be removed. removal would be a problem due to brigading, but there is no mechanism to remove bad mods)
4) HN becoming reddit / eternal September
Maybe not directly, but what about sources that were AI generated? How would that even be vetted?
Any most of them haven't done any real writing in years. They stand atop their domains angrily fighting off anyone who dares to update something without kissing the ring. They don't do research and only contribute through deletions and reversals of other people's writing.
I have a few relatives infamous enough to have Wikipedia entries. Every time I have tried to update them, a mod has pounced. Where my grandfather died ... nope. That cannot be changed without me submitting heaps of personal information to some rando mod. And good luck going anywhere near article about legal topics. Lawyer? Published expert in your narrow field? Not good enough. It's armchair lawyers only on wikipedia.
Between SEO spam as the precursor then AI generated SEO spam and then just AI.
I used to enjoy stumbling on random things and learning/seeing into a world I didn't know existed (usually related to tech/science/history) but the signal/noise has changed radically and not in favour of the signal.
We need a different version of the www. Google controls the www though via the adChromium codebase.
The wholesale ripping off started in the late 90's and we are already deep into the "feeling it". DRM, standalone apps for everything, consolidated corporate internet with paywalls all over.
I'm sorry, I just cannot take anyone on the internet who bemoans IP laws seriously. We all ad block everything and pirate stuff as needed, this is the moral high ground of the internet for 25+ years. Hell LLMs are the worst pirates anyway because they won't even let you just cleanly download the IP you want to steal.
Copyright has little or no value for small blokes and bloketts like us. I think that part of the problem with copyright is that we are blending rent-seeking with acknowledgement of one's contribution in the creation of IP.
I dare say, most of the value of “copyright” for us small players is that it is part of the discovery process through which people with jobs and money find us. My writings and code have led customers to me (in a good way).
I don't mind what the LLM hovers up of my so-called creative efforts as long as people can find me. And that perspective is, I think, the core complaint people have about Google's AI searches. At least, that's how I read the article.
It was never a question of resources and it was never a conflicting goals issue. From Google's standpoint, SEO spam is an existential threat because if somebody solves filtering for it, everyone will switch to that competitor.
It is simply a hard problem to solve at scale. Successful spammers live on the razor line between the signals Google has for useful content and wasting people's time.
The element Google can't control for is human nature. SEO spam sites are built to keep organic users reading long enough to tip the quality signal in the site's favor. Savvy users like those in this conversation know what they look like, but remember that most of the internet is not composed of sanity users. So the signal Google mostly gets from those pages is that they are holding user attention, and holding user attention, and holding use your attention because the site is annoying to retrieve information from is difficult to distinguish from holding user attention because the site is good.
Once you've created something, whether it's an album or a blogpost, they are like your children - or as Kahlil Gibran wrote:
They come through you but not from you,
And though they are with you yet they belong not to you.
When people's interest is piqued, they may investigate more deeply, and that may lead them to other people in the same way. Discord servers are doing pretty well.Personally, I'm a follower of Bowie's definition of success, in that success is about how much you influence other people, because it's purer and happens even if they hate you.
CREATING SOMETHING
__________________________________
.-' '-.
.' '.
/ \
/ \
| Curiosity |
| Joy |
| Art |
| Experimentation |
| Learning |
| Self-expression |
| Play |
| Discovery |
| |
| ___ |
| Making things .-' '-. |
| just because / MONEY \ |
| you want to \ / |
\ '-.___.-' /
\ /
'. _.'
'-.________________________________.-'
Monetisation is just one possible consequence of creation. We've somehow mistaken it for the purpose. Because capitalism.And before that, you would get the an exact, human written page for what you searched for, which is why Google was able to make money in the first place.
This is a Google search problem, and they could have defeated SEO sites if it weren't more profitable for them. SEOs didn't force Google to put 8 ads between the search bar and the first non-ad result, Google did.
Whatever Google is now, nobody would actually choose it if there were alternatives that competed on product, but there aren't.
We all live in duopoly land where every extremely high margin software and hardware role is taken up by 2 of 7 companies.
There are dozens but they aren't good either.
It turns out that running a good search engine is very challenging and insanely expensive.
Companies make good products as loss leaders then monetize them later. People complain that the product was "enshittified" but what they get wrong is the original product never existed in any real sense. It was never a durable maintainable system. Most things require money to run well and if they can't make money they won't keep running well.
1. Money
2. Goodwill
3. Threat of violence (usually via government / taxes)
You can have some mix of those three (a mix of 80% money 20% goodwill seems pretty solid in my experience), but I don't think there is some secret fourth option.
As with the CIA funding the modern art movement and various counterculture groups, and the LSD that drove hippie culture being a product of MKULTRA, the money would have appeared from somewhere.
It has everything to do with quarterly number go up. The market is meant to align incentives, and the incentives here is to transfer as much benefit as is possible to shareholders.
Google (Tech in general) makes more money on a smaller cost base than any industry that has ever existed.
People say this and act like it has something to do with greed.
No. This is just basic economics. This is what it means to run a business with other people's money. If your growth doesn't compete with other places they could invest their money, why shouldn't they take it back?
> Google (Tech in general) makes more money on a smaller cost base than any industry that has ever existed.
This is quite simply not true. Tech does not have the largest profit margins of all time, and has exceptionally high capital requirements to operate.
What tech does have is really nice scaling properties, which Google benefits from as the "winner" in search. But beware survivorship bias.
> No. This is just basic economics.
A lot of what people call "basic economics" is just excuses for greed.
I get reliable search results the vast majority of times, and if there’s a site that keeps popping up that I don’t like (AI-generated slop or paywalled), I block it and my results improve.
You can block sites, because Kagi’s product is search, not ads. Yeah, you have to pay for it, but you know that? I’m fine with that. I’m fine with paying for a product to do a thing well, and not have it tainted by the alternate revenue stream the company actually uses to make money from.
I use Kagi, and I really hope I am part of a large enough cohort paying for it to be a good, viable business. But realistically it is incredibly difficult to imagine it taking any major market share given the above.
Perhaps they should run some Google ads and work on their SEO.
Google wasn’t really good for questions like “who is hosting SNL?” until pretty late in the game. The Huffington Post made a big deal in the early 2010s about posting articles like “What time is the Super Bowl?” The SEO wars started pretty much immediately after that.
But before that you probably would have had to go to a TV listings site or go to the NBC page for SNL, which may or may not have had the answer, possibly embedded in a Flash interactive.
(Just as we had multiple big retailers, in different narrow categories, like CDNOW.com, before Amazon.) All the consolidation into Google for every information need is unhealthy at best.
I still remember how much to sleep I lost when I discovered TVTropes
I switched, and every tech-savvy person that I know switched about 5 years to a decade ago. Google stays on business, just like Facebook, because of the huge advantage of being a household name.
This is exaxctly how they built out their dominance in search. Good, high quality answers, no ads. Get the users in the door. Become synonymous with search.
Google absolutely bled cash for their first three years, because they were investing in acquisition. Here we are again.
Then, little by little, you monetise, until the product is once again awful.
They repeated this process with YouTube, for a larger example of "burn cash on user acquisition until vast profits".
We'll see the same with their AI offering. It'll take 10-15 years to the "hot trash" stage, it'll be WILDLY profitable (think of the targetting opportunities!), and then they'll have to pivot to the new hotness, whatever that is.
Yes, there are. I use ChatGTP Plus to search, with citations. It's not free, but my nerves aren't either.
In other words, the search traffic was already amplified by crap and this pulled it back. I am not saying there is no theft because there is massive theft.
You can't copyright facts.
If you write a cookbook, I'm perfectly free to take all your recipies (facts) and publish them in a cookbook of my own. I'm not free to take the artwork and prose (intellectual property) from your cookbook without your permission.
In Nester's Map & Guide Corp. v. Hagstrom Map Co. (1992), the United States District Court for the Eastern District of New York held that trap streets are not copyrightable under the federal law of the United States.
And was sued for it by news media in a number of countries like Australia.
"No one owns the truth" is exactly the kind of black and white thinking that leads to bad places.
This is what I will tell to myself from now on when downloading movies and series instead of paying for them.
Ultimately it doesn't matter, because the internet will die, and Google will have no one to steal facts from anymore.
What you are describing is not the death of discovery. It is still required to discover a lot of things that are also more valuable to know.
For example you can't really understand how to implement _start on linux x86_64 by just reading some summary.
And this is why, kids, the statement "this technology is the worse it will ever be" is false. Whether it's search or cars with huge screens or LLMs. Technology can obviously regress, even if the on paper specs progress.
Am I the only one discovering way more niche sites and cool research publications now, by clicking through the sources the LLM gives back to me?
Now with AI (I use chatgpt and perplexity) as direct replacement for search engines I find Google as a company even more obsolete than in the past.
So is YT, which is cluttered with ads more than linear TV in American and I thought nothing could be worse… and recommendation engine focused on misinformation more than ever. All interesting content from YT once randomly found is ripped with yt-dlp and stored on NAS to be turned into local streaming service via plex or emby or similar service is my way to access media.
Google created habits of effective discovery of valuable content in the internet and killed it by its own greed.
Now, you ask AI if Sonic Advance 2 allows you to get a D rank, it lies to your face that yes. The game doesn't even have letter ranks. Too bad you're streaming on a game show while searching that, letting 8 thousand people see the failure of the modern google in action.
Google chose to prioritize results which don't provide the answer, making you scroll aimlessly and paying them with ad revenue.
Google chose to keep the websites with the answers for themselves, and only provide them through AI. There's a difference.
Google killed the web, period.
So I have a project with domains, YouTube channels, Github repositories, reddit channels [0]. All have 'ranking', so most important appear first for me.
This project however is already big. 2M of entries. So I have a trimmed version of it, only things I already consider worth maintaining [1].
I also maintain RSS feeds for what is worth [2], and I have other repositories.
I don't like Google. They intentionally broken the search. You cannot say it differently once you understand how broad, rich, and interesting the internet actually is.
Although list of domains does not answer broad questions like "who is on snl tonight", so I still use other search methods.
[0] - https://github.com/rumca-js/Internet-Places-Database
But yes, a lot of pipelines are broken right now. If you are a junior dev today, you have a hard time to get into the field. Quite ironic since just a year ago you were too old if you were past the age of 25 for any dev work...
On the other hand decades ago web search was horrible too - in most cases what you got was result of full text searches ordered by entry rank.
Hopefully people go back to real social interactions and that kills AI on the web. People just go back to directly contacting businesses rather than exploring their what is now a completely AI generated website. Almost all the models used in the newspaper are now AI.
SEO sites killed discovery a long time ago. And, based on what Google has been serving up for a decade [1], they did seemingly nothing about it.
Oh well.
([1] nothing worth discovering)
I just searched "who is on snl tonight?" on the "web" tab of Google (which is Google search without AI) and the first 4 results are in order the SNL instagram, Reddit, Twitter and the NBC website, all of which have the answer easily accessible.
Twitter and the NBC website even have the response directly in their description so I don't need to open the link: "John Mulaney hosts with musical guest Phoebe Bridgers".
I already see this when searching for product reviews. "People say this chair is very comfortable." Then you dig into the sources and "people" is a single astroturfed reddit post.