Two important points this doesn’t address:<p>1. Money. How cheaply can this be run per query, and how much value add does this have over the current product?<p>2. Modalities. GPT is only just ok at factual responses. It hallucinates a lot but let’s assume it didn’t. It’s damn near useless for location based and recency based queries. The day after an election, you’re gonna want to update it on who the president is. It’s not feasible to retrain. And don’t even think about answering “best restaurants near me” based on model parameters alone.<p>What may be possible however is synthesizing the top N results into one coherent answer.
I don’t think “how do I write differential equations in LaTeX” is a high-ad-revenue search query? Whereas a query like “what’s the best car insurance” or “where can I buy air Jordans” is.<p>Does GPT do a good job on those types of queries?
How are you going to train this AI? With a corpus. And how are you going to choose the corpus? You can't use the whole internet; that would train it on lies, propaganda, advertising, ignorance, rants, and trolls (along with some truth). That won't get you good results.<p>You need something outside the AI deciding what material to use to train the AI. How do you decide what the best stuff is? You're probably going to need a large organization to do that, <i>before</i> you get results that lead to money. How are you going to pull that off?
It’s a thought that AI ( not ML) can provide better search result than the current algorithms<p>How a startup can get funding for crawling and storing the internet, running ML (not AI) training across the unnumbered TB and running the trained models to reply in the same latency. Is the hard part.<p>How such a startup would out compete google for the same idea
is another hard part.<p>The idea of AI returning search results is the easy part<p>I really don’t mean to be snarky, I see this post as similar to saying Tyre companies will be disrupted by flying cars<p>I suppose Tesla disrupted traditional car makers so it possible