It'll be interesting to see where this leads to. Probably a much worse web and less accurate information. As soon as online info became a source of income through advertisements counted by clicks, clicks increased and the info quality decreased. As soon as presenting search results in a certain way became a "real" business, the searches increased but the quality of the results decreased. Now that simply having access to information will create monetary value for the middlemen by extracting it from the source, more and more garbage will be fed to the LLMs but since they're not getting paid for it or getting any recognition, the <i>real people</i> behind the scenes who write the articles and produce the primary information will stop doing so. Just like the independent journalists, bloggers and hobbyists who essentially stopped having an online presence gradually over the last decade.
Sure, these AIs have decades upon decades of information available to them, but what about the new stuff? Why publish an article when nobody but Bard and ChatGPT will read them? The answer is that people won't, or if they do, they'll know it will be used to direct the AIs answers and tweak them accordingly to fool it and get the behavioural result they desire from it's users.
This also exposes an underlying problem with these tools, they only know text on the internet, and they believe everything. It's like asking a gullible child to read you the first page results and give you an answer. That's just not going to work.