TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

The model is the product

237 点作者 cocoflunchy大约 2 个月前

29 条评论

Dorialexander大约 2 个月前
Hi, author here.<p>An important background is the imminent rise of actual LLM agents I discuss in the next post: <a href="https:&#x2F;&#x2F;vintagedata.org&#x2F;blog&#x2F;posts&#x2F;designing-llm-agents" rel="nofollow">https:&#x2F;&#x2F;vintagedata.org&#x2F;blog&#x2F;posts&#x2F;designing-llm-agents</a><p>So answering to a few comments:<p>*The shift is coming relatively soon thanks to the latest RL breakthroughs (I really encourage to give a look at Will Brown talk). Anthropic and OpenAI are close to nail long multi-task sequences on specialized tasks.<p>*There are stronger incentives to specialize the model and gate them. They are especially more transformative on the industry side. Right now most of the actual &quot;AI&quot; market is still largely rule-based&#x2F;ML. Generative AI was not robust enough but now these systems can get disrupted — not to mention many verticals with a big focus on complex yet formal tasks. I know large network engineering co are upscaling their own RL capacities right now.<p>*Open source AI is distanced so far due to lack of data&#x2F;frameworks for large scale RL and tasks related data. Though we might see a democratization of verifiers, it will take time.<p>Several people from big labs reached out since then and confirmed that, despite the obvious uncertainties, this is relatively one point.
评论 #43399949 未加载
评论 #43400247 未加载
评论 #43398880 未加载
smjburton大约 2 个月前
&gt; So what is happening right now is just a lot of denial. The honeymoon period between model providers and wrappers is over. &gt; In short the dilemma for most successful wrappers is simple: training or being trained on. What they are doing right now is both free market research for the big labs but, even, as all outputs is ultimately generated through model providers, free data design and generation.<p>This is a great observation on the current situation. Over the past few years, there&#x27;s been a proliferation of AI wrappers in the SaaS space; however, because they&#x27;re use proprietary models, they become entirely dependent on the model providers to continue to offer their solution, there&#x27;s little to no barrier to entry to create a competing product, and they&#x27;re providing free training data to the model providers. Instead, as the article suggests, SaaS builders should look into open source models (from places like Github, HuggingFace, or paperswithcode.com) or consider researching their own, and training custom models if they want to offer long-term services to their users.
dimitri-vs大约 2 个月前
&gt; I&#x27;ve read a lot of misunderstandings about DeepResearch, which isn&#x27;t helped by the multiplication of open and closed clones. OpenAI has not built a wrapper on top of O3.<p>It also doesn&#x27;t help that they let you select a model varying from 4o-mini to o1-pro for the Deep Research task. But this confirms my suspicion that model selection is irrelevant for the Deep Research tasks and answering follow-up questions.<p>&gt; Weirdly enough, while Claude 3.7 works perfectly in Claude Code, Cursor struggles with it and I&#x27;ve already seen several high end users cancelling their subscriptions as a result.<p>It&#x27;s because Claude Code burns through tokens like there&#x27;s no tomorrow, meanwhile Cursor attempts to carefully manage token usage and limit what&#x27;s in context to remain profitable. It&#x27;s gotten so bad that for any moderately complex task I switch to o1-pro or sonnet-3.7 in the Anthropic Console and max out the thinking tokens. They just released a &quot;MAX&quot; option but I can still tell its nerfed because it thinks for a few seconds whereas I can get up to 2 minutes of thinking via Anthropic Console.<p>Its abundantly clear that all these model providers are trying to pivot <i>hard</i> into productizing, which is ironic considering that the UX of all these model-as-a-product companies is so universally terrible. Deep Research is a major win, but OpenAI has plenty of fails: Plugins, Custom GPTs, Sora, Search (obsolete now?), Operator are maybe just okay for casual users - not at all a &quot;product&quot;.
评论 #43399017 未加载
评论 #43398940 未加载
mjburgess大约 2 个月前
The argument appears to be &quot;last-mile&quot; specialisation of AI models by massive-compute-companies will be entirely proprietary, and walled-off to prevent competitor extraction of data. And these scenario&#x2F;domain&#x2F;task specific models will be the product sold by these companies.<p>This is plausible insofar as one can find a reason to suppose compute costs for this specialisation will remain very high, and the hardwork of producing relevant data will be done best by those same companies.<p>I think its equally plausible compute will come down enough, and innovations in &quot;post-training re-training&quot; will occur, that you&#x27;ll be able to bring this in-house within the enterprise&#x2F;org. Ie., that &quot;ML&#x2F;AI Engineer&quot; teams will arise like SEng teams.<p>Or that there&#x27;s a limit to statistical modelling over historical cases, that means specailisation is so exponentially demanding on historical case data production, that it cannot practically occur in places which would most benefit from it.<p>I think the latter is what will prevent the mega players in AI atm making &quot;the model the product&quot; -- at the level they can specialise (ie., given the amount of data needed), so can everyone else.<p>Perhaps these companies will transition into something SaaS-like, AI-Model-Specialisation-As-A-Service (ASS ASS) -- where they create bespoke models for orgs which can afford it.
评论 #43398847 未加载
评论 #43400928 未加载
jjmarr大约 2 个月前
&gt; Inference cost are in free fall. The recent optimizations from DeepSeek means that all the available GPUs could cover a demand of 10k tokens per day from a frontier model for… the entire earth population. There is nowhere this level of demand. The economics of selling tokens does not work anymore for model providers: they have to move higher up in the value chain.<p>I&#x27;ve been using Cline so I can understand the pricing of these models and it&#x27;s insane how much goes into input context + output. My most recent query on openrouter.ai was 26,098 input tokens -&gt; 147 output tokens. I&#x27;m easily burning multiple dollars an hour. Without a doubt there is still demand for cheaper inference.
lukev大约 2 个月前
I don&#x27;t disagree, but I think we need to be careful of our vocabulary around the word &quot;model.&quot; People are starting to use it to refer to the whole &quot;AI system&quot;, rather than the actual transformer model.<p>This article is talking about models that have been trained specifically for workflow orchestration and tool use. And that is an important development.<p>But the fundamental architectural pattern isn&#x27;t different: You run the model in some kind of harness that recognizes tool use invocations, calls to the external tool&#x2F;rag&#x2F;codegen&#x2F;whatever, then feeds the results back into the context window for additional processing.<p>Architecturally speaking, the harness is a separate thing from the language model. A model can be trained to use Anthropic&#x27;s MCP, for example, but the capabilities of MCP are not &quot;part&quot; of the model.<p>A concrete example: A model can&#x27;t read a webpage without a tool, just like a human can&#x27;t read a webpage without a computer and web browser.<p>I just feel like it&#x27;s important to make a logical distinction between a model and the agentic system <i>using</i> that model. Innovation in both areas is going to proceed along related but different paths.
评论 #43406834 未加载
huijzer大约 2 个月前
&gt; Inference cost are in free fall. The recent optimizations from DeepSeek means that all the available GPUs could cover a demand of 10k tokens per day from a frontier model for… the entire earth population. There is nowhere this level of demand. The economics of selling tokens does not work anymore for model providers: they have to move higher up in the value chain.<p>Even before DeepSeek, the prices were declining by about 90% per year when keeping performance constant. The way to think about economics is different I think. Think of it as any other industry that is on a learning curve like chips, batteries, solar panels, or you name it. The price in these industries keeps falling each year. The winners are the companies that can keep scaling up their production. Think TSMC for example. Nobody can produce high quality chips for a lower price than TSMC due to economies of scale. For instance, one PhD at the company can spend 4 years optimizing a tiny part of the process. But it’s worth it because if it makes the process 0.001% cheaper to run then the PhD paid itself back on the TSMC scale.<p>So the economics for selling tokens does work. The question is who can keep scaling up long enough so that the rest (has to) give up.
bambax大约 2 个月前
I&#x27;m confused by the language here; it seems &quot;model&quot; means different things.<p>To me a &quot;model&quot; is a static file containing numbers. In front of that file is an inference engine that receives input from a user, runs it through the &quot;model&quot; and outputs the result. That inference engine is a program (not a static file) that can be generic (can run any number of models of the same format, like llama.cpp) or specific&#x2F;proprietary. This program usually offers an API. &quot;Wrappers&quot; talk to those APIs and therefore, don&#x27;t do much (they&#x27;re neither an inference engine, nor a model) -- their specialty is UI.<p>But in this post it seems the term &quot;model&quot; covers a kind of full package that goes from LLM to UI, including a specific, dedicated inference engine?<p>If so, the point of the article would be that, because inference is in the process of being commoditized, the industry is moving to vertical integration so as to protect itself and create unique value propositions.<p>Is this interpretation correct?
评论 #43399100 未加载
评论 #43399357 未加载
评论 #43399246 未加载
roenxi大约 2 个月前
&gt; This was the whole message behind the release of GPT-4.5: capacities are growing linearly while compute costs are on a geometric curve<p>I don&#x27;t see where that is coming from. Capacities aren&#x27;t really measureable in that way. Computers either can do something like PdD level mathematics research more or less under their own power or they cannot with a small period of ambiguity as subhuman becomes superhuman. This process seems to me to have been mostly binary with relatively clear tipping points that separate models that can&#x27;t do something from models that can. That isn&#x27;t easily mapped back to any sort of growth curve.<p>Regardless, we&#x27;re in the stage of the boom where people are patenting clicking a button to purchase goods and services thinking that might be a tricky idea. It isn&#x27;t clear yet what parts of the product are easy and standard and what parts are difficult and differentiators. People who talk in vague terms will turn out to be correct and specific predictions will be right or wrong at random. It is hard to stress how young all these practical models are. Stable diffusion was released in 2022, and ChatGPT is younger than that - almost yesterday years old; this stuff is early days magic.<p>Models could easily turn out to be a commodity.
pkdpic大约 2 个月前
I like this as a narrative framework a lot more than the AGI arc. This seems a lot more realistic and less dramatic, more human-focused.<p>I like the idea of a model being able to create and maintain a full codebase representing the app layer for model-based tools but in practical terms at work and on personal projects I still just don&#x27;t see it. To get a model to write even a small-scale frontend only app I still have to make functions so atomic and test them to the point where it feels close to the time it would take to write the app manually. And if I ask a model to write larger functions or don&#x27;t test them &#x2F; edit them through 3-5 rounds of re-prompting I just end up with code debt that makes the project unrealistic to continue building out beyond a pretty limited MVP stage without going back line by line and basically rewriting the whole thing.<p>Anyway I&#x27;m no power user, curious what other people&#x27;s experience is. Maybe I&#x27;m just using the wrong models.
评论 #43401699 未加载
TrackerFF大约 2 个月前
Models might be the product, but data is the material that the products are made out of.<p>I&#x27;m starting to think that if you can control your data, you&#x27;ll have somewhat of an edge. Which I think could lead to people being more protective of their data. Guess we&#x27;ll move more and more in the direction of premium paid data streams, while making scraping as hard as possible.<p>At least in the more niche fields, that work with data that isn&#x27;t very commonplace and out there for everyone to download.<p>Kind of sucks for the open source crowds, non-profits, etc. that rely on such data streams.
piokoch大约 2 个月前
Not having API-s for models would suck terribly. It would kill tools like Aider or Cline, where I can switch models as I prefer, paying only for tokens I have used. The only option would be to purchase overpriced application from a model provider.<p>I hope the author is wrong and still there will be someone who would like to make money on &quot;selling tokens&quot; not end-to-end closed solutions. But indeed, market surely would seek for added value.
评论 #43398543 未加载
rbren大约 2 个月前
This is a thoughtful article, but I very much disagree with the author&#x27;s conclusion. (I&#x27;m biased though: I&#x27;m a co-creator of OpenHands, fka OpenDevin [1])<p>To be a bit hyperbolic, this is like saying all SaaS companies are just &quot;compute wrappers&quot;, and are dead because AWS and GCP can see all their data and do all the same things.<p>I like to say LLMs are like engines, and we&#x27;re tasked with building a car. So much goes into crafting a safe, comfortable, efficient end-user experience, and all that sits outside the core competence of companies that are great at training LLMs.<p>And there are 1000s of different personas, use cases, and workflows to optimize for. This is not a winner-take-all space.<p>Furthermore, the models themselves are commoditizing quickly. They can be easily swapped out for one another, so apps built on top of LLMs aren&#x27;t ever beholden to a single model provider.<p>I&#x27;m super excited to have an ecosystem with thousands of LLM-powered apps. We&#x27;re already starting to see it materialize, and I&#x27;m psyched to be part of it.<p>[1] <a href="https:&#x2F;&#x2F;github.com&#x2F;All-Hands-AI&#x2F;OpenHands" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;All-Hands-AI&#x2F;OpenHands</a>
评论 #43400012 未加载
评论 #43401025 未加载
评论 #43399245 未加载
bjornsing大约 2 个月前
These two trends seem somewhat contradictory:<p>&gt; Generalist scaling is stalling. This was the whole message behind the release of GPT-4.5: capacities are growing linearly while compute costs are on a geometric curve. Even with all the efficiency gains in training and infrastructure of the past two years, OpenAI can&#x27;t deploy this giant model with a remotely affordable pricing.<p>&gt; Inference cost are in free fall. The recent optimizations from DeepSeek means that all the available GPUs could cover a demand of 10k tokens per day from a frontier model for… the entire earth population. There is nowhere this level of demand. The economics of selling tokens does not work anymore for model providers: they have to move higher up in the value chain.<p>Wouldn’t the market find a balance then, where the marginal utility of additional computation is aligned with customer value? That fix point could potentially be much higher than where are now in terms of compute.
评论 #43398546 未加载
评论 #43398493 未加载
评论 #43399188 未加载
mromanuk大约 2 个月前
&gt; This is also an uncomfortable direction. All investors have been betting on the application layer. In the next stage of AI evolution, the application layer is likely to be the first to be automated and disrupted.<p>I&#x27;m not convinced, we tend to think in terms of problem-products(solutions), for example editing an image =&gt; photoshop, writing some document =&gt; word. I doubt that we are going to move to a &quot;Any problem =&gt; model&quot;. That&#x27;s what ChatGPT is experimenting with the &quot;calendaring&#x2F;notification&quot;. It breaks the concept that one brand solves one problem. The App store is a good example, there are millions of apps. I find it really hard that the &quot;apps&quot; can get inside the &quot;model&quot; and expect that the model will &quot;generate an app tailored&quot; for that problem at that moment, many new problems will emerge.
kohlerm大约 2 个月前
I am not so sure this makes sense. Training a model to directly use certain tools (web search etc) makes the model very specialized and less flexible. As long as other solutions are more flexible and less costly, training a specialized model would not be worth it.
cellis大约 2 个月前
I just saw a billboard sign for “deepseek on together.ai” on the 101 a couple days ago, and thought “that’s a very good idea”. As long as there are infra players like together.ai and truly open source crack research teams like DeepSeek and Meta (no one can monopolize research(ers)) I don’t think this “gated model” thesis holds. Which means that OpenAI and Anthropic are competing with every other token output wrapper, and somewhat poorly as they aren’t able to offer competing models where theirs may be lacking. Cursor defines this dilemma for the foundational providers.
评论 #43400997 未加载
lubujackson大约 2 个月前
Comparison I would make is that is like the transition from renting a server to using services on the cloud - you used to rent a server of a specific size and do whatever you want with it, but then the cloud came and undermined that &quot;Swiss army knife&quot; approach by having you rent specific services directly - database storage, processing, etc.<p>So AI will be more directed and opinionated, but also much easier to use for common tasks. And the &quot;renting a server&quot; option doesn&#x27;t go away, just becomes less relevant for anyone in the middle of the bell curve.
bob1029大约 2 个月前
&gt; In short, what Claude aims to disrupt and replace the current workflows like this basic &quot;agent&quot; system from llama index: [Figure 1] With this: [Figure 2]<p>In the 2nd figure, I think we have a viable pattern if you consider &quot;Human&quot; to be part of &quot;Environment&quot;. Hypothetically, if one of the available functions to the LLM is something like AskUserQuestion(), you can flip the conversation mode around and have the human serve as a helpful agent during the middle of their own request.
dartos大约 2 个月前
The real questions wrt the title is:<p>Will specialized models also hit a usefulness wall like general models do? (I believe so)<p>And<p>Will the model’s blindspots hurt more than the value a model creates? (Much more fuzzy and important)<p>If so, then even many specialized models will be a commodity and the application on top will still be the product end users will care about.<p>If not, then we’ll finally see the return on all this AI spending. Tho I think first movers would be at a disadvantage since they need much higher ROI to overcome the insane cost spent on training general models.
trash_cat大约 2 个月前
This is an incredibly valuable analysis.<p>In simple terms, performing a relatively simple RL on various tasks is what gives the models the emergent properties like DeepSeek managed to do with multi step reasoning.<p>The reasoning models and DeepSearch models are essentilly of the same class, but applied on different types of tasks.<p>The underlying assumption then is that these &quot;specialized&quot; models is the next step in the industry, as the general models will get outperformed (maybe).
Jonovono大约 2 个月前
Interesting read. I am curious how you would analyze the current AI hype MCP (model context protocol) from your perspective. Does it fit into the future you see? It seems like it&#x27;s going the complete opposite direction as the future you paint, but perhaps it&#x27;s just a stepping stone given the constraints of row.
jimkoen大约 2 个月前
&gt; It&#x27;s coding model no longer just generating code but managing an entire code base by themselves.<p>What model is the author talking about? I would pay for that. Is Claude really THIS good, that it could manage the codebase of say, PostgreSQL?
DebtDeflation大约 2 个月前
&gt; an agent has to perform the targeted tasks internally: they &quot;dynamically direct their own processes and tool usage, maintaining control over how they accomplish tasks&quot;.<p>&gt; What most agent startups are currently building is not agents, it&#x27;s workflows, that is &quot;systems where LLMs and tools are orchestrated through predefined code paths.&quot; Workflows may still bring some value<p>While this viewpoint will likely prove correct in the long run, we are pretty far away from that. Most value in an Enterprise context over the next 3-5 years will come from embedding AI into existing workflows using orchestration techniques, not from fully autonomous agents doing everything end to end &quot;internally&quot;.
评论 #43402255 未加载
gmaster1440大约 2 个月前
&gt; This is also an uncomfortable direction. All investors have been betting on the application layer. In the next stage of AI evolution, the application layer is likely to be the first to be automated and disrupted.<p>Highly agree with the sentiments expressed in this post, I wrote about something similar in my blog post on &quot;Artificial General Software&quot;: <a href="https:&#x2F;&#x2F;www.markfayngersh.com&#x2F;posts&#x2F;artificial-general-software" rel="nofollow">https:&#x2F;&#x2F;www.markfayngersh.com&#x2F;posts&#x2F;artificial-general-softw...</a>
vessenes大约 2 个月前
This is .. surprisingly good tech and strategy analysis for free content on the internet, thank you.<p>A couple of thoughts — as you note hard infra &#x2F; training investment has slowed in the last two years. I don’t think this is surprising, although as you say, it may be a market failure. Instead, I’d say it’s circumstance + pattern recognition + SamA’s success.<p>We had the bulk of model training fundraising done in the last vestiges of ZIRP, at least from funds raised with ZIRP money, and it was clear from OpenAI’s trajectory and financing that it was going to be EXXXPPPENSIVE. There just aren’t that many companies that will slap down $11bn for training and data center buildout — this is out of the scale of Venture finance by any name or concept.<p>We than had two eras of strategy assessment: first — infrastructure plays can make monopolies. We got (in the US) two “new firm” trial investments here — OpenAI, and ex-OpenAI Anthropic. We also got at least Google working privately.<p>Then, we had “there is no moat” as an email come out, along with Stanford’s (I believe Alpaca? Precursor to llama) and a surge in interest and knowledge that small datasets pulled out of GPT 3&#x2F;3.5&#x2F;(4?) could very efficiently train contender models and small models to start doing tasks.<p>So, we had a few lucky firms get in while the getting was good for finance, and then we had a spectacularly bad time for new entrants: super high interest rates (comparatively) -&gt; smaller funds -&gt; massive lead by a leader that also weirdly looked like it could be stolen for $5k in API calls -&gt; pattern recognition that our infrastructure period is over for now until there’s some disruption -&gt; no venture finance.<p>I think we could call out that it’s remarkable, interesting and foresighted that Zuck chose this moment to plow billions into building an open model, and it seems like that may pay off for Meta — it’s a sort of half step ahead of the next gen tech in training know how and iron and a fast follower to Anthropic and OpenAI.<p>I disagree with your analysis on inference, though. Stepping back a level from the trees of raw tokens available to the forest of “do I have enough inference on what I want inferred at a speed that I want right now?” The answer is absolutely not, by probably two orders of magnitude. With the current rise of using inference to improve training, we’re likely heading into a new era of thinking about how models work and improving them. The end-to-end agent approach you mention is a perfect example. These queries take a long time to generate, in the ten minute range often, from OpenAI. When they’re under a second, Jevon’s paradox seems likely to make me want to issue like ten of them to compare &#x2F; use as a “meta agent”.. Combined with the massive utility of expanded context and the very real scaling problems with expanding attention into the millions of tokens range, and we have a ways to go here.<p>Thanks again, appreciated the analysis!
bloomingkales大约 2 个月前
Nah.<p>The model is the talent. A talented model is good, but you need to know how to use it.
aubanel大约 2 个月前
&gt; Generalist scaling is stalling. This was the whole message behind the release of GPT-4.5: capacities are growing linearly while compute costs are on a geometric curve. Even with all the efficiency gains in training and infrastructure of the past two years, OpenAI can&#x27;t deploy this giant model with a remotely affordable pricing.<p>Hard disagree. 1. &quot;Capacities are growing linearly while compute costs are on a geometric curve&quot; is the very definition of scaling. GPT4.5 continuing this trend is the opposite of stalling: it&#x27;s the proof that scaling continues to work 2. &quot;OpenAI can&#x27;t deploy this giant model with a remotely affordable pricing&quot; WTF? Gpt-4.5 has the same price per token than GPT-4 at release. It seems high compared to other models, but is still dirt cheap compared to human labor. And this model&#x27;s increased quality means it is the only viable option for some tasks. I have needed proofreading for my book: o1 or o3-mini were not up to the task, but gpt-4.5 really helps. GPT-4.5 is also a leap forward on agentic capabilities. So of course I&#x27;ll pay for this, it saves me hours by enabling new use-cases
dgfitz大约 2 个月前
Out of curiosity, is it common to pay to use “AI” in 2025?<p>I have no desire to pay for any of these “products” even a little bit.
评论 #43400262 未加载
评论 #43400162 未加载