TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Inside The Chaos at OpenAI

281 点作者 maxutility超过 1 年前

23 条评论

tangjurine超过 1 年前
<a href="https:&#x2F;&#x2F;archive.is&#x2F;Vqjpr" rel="nofollow noreferrer">https:&#x2F;&#x2F;archive.is&#x2F;Vqjpr</a>
评论 #38341655 未加载
simonw超过 1 年前
This is really good journalism. There are a ton of interesting details in here that haven&#x27;t been reported elsewhere, and it has all of the hallmarks of being well researched and sourced.<p>The first clue is this: &quot;In conversations between The Atlantic and 10 current and former employees at OpenAI...&quot;<p>When you&#x27;re reporting something like this, especially when using anonymous sources (not anonymous to you, but sources that have good reasons not to want their names published), you can&#x27;t just trust what someone tells you - they may have their own motives for presenting things in a certain way, or they may just be straight up lying.<p>So... you confirm what they are saying with other sources. That&#x27;s why &quot;10 current and former employees&quot; is mentioned explicitly in the article.<p>Being published in the Atlantic helps too, because that&#x27;s a publication with strong editorial integrity and a great track record.
评论 #38357710 未加载
评论 #38342268 未加载
评论 #38358305 未加载
评论 #38348545 未加载
评论 #38342731 未加载
maxutility超过 1 年前
A few interesting tidbits<p>&gt; The company pressed forward and launched ChatGPT on November 30. It was considered such a nonevent that no major company-wide announcement about the chatbot going live was made. Many employees who weren’t directly involved, including those in safety functions, didn’t even realize it had happened. Some of those who were aware, according to one employee, had started a betting pool, wagering how many people might use the tool during its first week. The highest guess was 100,000 users. OpenAI’s president tweeted that the tool hit 1 million within the first five days. The phrase low-key research preview became an instant meme within OpenAI; employees turned it into laptop stickers.<p>&gt; Anticipating the arrival of [AGI], Sutskever began to behave like a spiritual leader, three employees who worked with him told us. His constant, enthusiastic refrain was “feel the AGI,” a reference to the idea that the company was on the cusp of its ultimate goal. At OpenAI’s 2022 holiday party, held at the California Academy of Sciences, Sutskever led employees in a chant: “Feel the AGI! Feel the AGI!” The phrase itself was popular enough that OpenAI employees created a special “Feel the AGI” reaction emoji in Slack.<p>&gt; For a leadership offsite this year, according to two people familiar with the event, Sutskever commissioned a wooden effigy from a local artist that was intended to represent an “unaligned” AI—that is, one that does not meet a human’s objectives. He set it on fire to symbolize OpenAI’s commitment to its founding principles. In July, OpenAI announced the creation of a so-called superalignment team with Sutskever co-leading the research. OpenAI would expand the alignment team’s research to develop more upstream AI-safety techniques with a dedicated 20 percent of the company’s existing computer chips, in preparation for the possibility of AGI arriving in this decade, the company said.
评论 #38341697 未加载
tgsovlerkhgsel超过 1 年前
Looking at this article, the following theory would align with what I&#x27;ve seen so far:<p>* Ilya Sutskever is concerned about the company moving too fast (without taking safety into account) under Sam Altman.<p>* The others on the board that ended up supporting the firing are concerned about the same.<p>* Ilya supports the firing because he wants the company to move slower.<p>* The majority of the people working on AI don&#x27;t want to slow down, either because they want to develop as fast as possible or because they&#x27;re worried about missing out on profit.<p>* Sam rallies the &quot;move fast&quot; faction and says &quot;this board will slow us down horribly, let&#x27;s move fast under Microsoft&quot;<p>* Ilya realizes that the practical outcome will be more speed&#x2F;less safety, not more safety, as he hoped, leading to the regret tweet (<a href="https:&#x2F;&#x2F;nitter.net&#x2F;ilyasut&#x2F;status&#x2F;1726590052392956028" rel="nofollow noreferrer">https:&#x2F;&#x2F;nitter.net&#x2F;ilyasut&#x2F;status&#x2F;1726590052392956028</a>)
评论 #38360692 未加载
评论 #38359625 未加载
评论 #38360144 未加载
rmorey超过 1 年前
&gt; For a leadership offsite this year, according to two people familiar with the event, Sutskever commissioned a wooden effigy from a local artist that was intended to represent an “unaligned” AI—that is, one that does not meet a human’s objectives. He set it on fire to symbolize OpenAI’s commitment to its founding principles.<p>Honestly, pretty sick
评论 #38345361 未加载
评论 #38341651 未加载
评论 #38341734 未加载
评论 #38341709 未加载
评论 #38341712 未加载
评论 #38342098 未加载
评论 #38341894 未加载
评论 #38341952 未加载
评论 #38341882 未加载
评论 #38341867 未加载
评论 #38341847 未加载
评论 #38341732 未加载
brucethemoose2超过 1 年前
Well that story is just sad, because it means the principle&#x2F;research-oriented company structure they set up utterly failed in the face of profit motives. Clearly Altman was not dissuaded from doing things the power structure didn&#x27;t want him to do.
评论 #38341590 未加载
评论 #38341618 未加载
truculent超过 1 年前
&gt; with beliefs at times seemingly rooted in the realm of science fiction<p>I don’t know how you can look at the development of generative AI tools in the past few years and write so dismissively about “science fiction” becoming reality
评论 #38341664 未加载
评论 #38341806 未加载
评论 #38341852 未加载
评论 #38358833 未加载
评论 #38341692 未加载
评论 #38341711 未加载
评论 #38341654 未加载
cmrdporcupine超过 1 年前
Can&#x27;t find the article right now, but there was one circulating that heavily implied that various SV execs began their rounds of layoffs last fall at least partially or probably inspired by the demos they&#x27;d seen of OpenAI&#x27;s tech.<p>Microsoft in particular laid off 10,000 and then immediately turned around and invested billions more in OpenAI: <a href="https:&#x2F;&#x2F;www.sdxcentral.com&#x2F;articles&#x2F;news&#x2F;microsoft-bets-billions-on-openai-following-layoffs&#x2F;2023&#x2F;01&#x2F;" rel="nofollow noreferrer">https:&#x2F;&#x2F;www.sdxcentral.com&#x2F;articles&#x2F;news&#x2F;microsoft-bets-bill...</a> -- last fall, just as the timeline laid out in the Atlnatic article was firing up.<p>In that context this timeline is even more nauseating. Not only did OpenAI push ChatGPT at the expense of their own mission and their employee&#x27;s well-being, they likely caused massive harm to our employment sector and the well-being of tens of thousands of software engineers in the industry at large.<p>Maybe those layoffs would have happened anyways, but the way this all has rolled out and the way it&#x27;s played out in the press and in the board rooms of the BigTech corporations... OpenAI is literally accomplishing the opposite of its supposed mission. And now it&#x27;s about to get worse.
评论 #38341815 未加载
评论 #38357807 未加载
评论 #38362992 未加载
评论 #38341820 未加载
leobg超过 1 年前
Sutskever said something interesting in his Lex Fridman interview:<p>&quot;In an ideal world, humanity would be the board members, and AGI would be the CEO. Humanity can always press the reset button and say, &#x27;Re-randomize parameters!&#x27;&quot;<p>This was 3 years ago. But that metaphor strikes me as too powerful for it not to have been at the back of Sutskever&#x27;s mind when he pushed for Altman being ousted.
评论 #38360813 未加载
评论 #38358625 未加载
jph00超过 1 年前
FYI: one of the authors of this article, Karen Hao, just announced on Twitter that she&#x27;s writing a book on OpenAI, and that this article is partly based on work done for that book.
评论 #38345410 未加载
somewhereoutth超过 1 年前
&gt; OpenAI’s president tweeted that the tool [ChatGPT] hit 1 million within the first five days.<p>Perhaps the reason why ChatGPT has become so popular is because it provides <i>entertainment</i>. So it is not a great leap forward in AI or a path to AGI, but instead a incredibly convoluted way of keeping reasonable intelligent people occupied and amused. You enter a prompt, and it returns a result - what a fun game!<p>Maybe that is it&#x27;s primary contribution to society.
评论 #38358552 未加载
评论 #38358526 未加载
评论 #38358357 未加载
评论 #38359060 未加载
评论 #38358165 未加载
评论 #38358167 未加载
natch超过 1 年前
Does anyone else think it would make for a more healthy dynamic from the standpoint of AI safety if both sama and Ilya remained, despite their differences? Not that I know anything, but it seems a diversity of opinions at the top could have its benefits.
评论 #38345436 未加载
评论 #38357791 未加载
intimidated超过 1 年前
&gt; Safety teams within the company pushed to slow things down. These teams worked to refine ChatGPT to refuse certain types of abusive requests and to respond to other queries with more appropriate answers.<p>I wonder what this struggle means for the future of ChatGPT censorship&#x2F;safety.
MichaelMoser123超过 1 年前
i suspect that &#x27;AI safety&#x27; means a chatbot that is not hallucinating&#x2F;making things up. Ilya Sutskever may want some sort of hybrid system, where the output of the LLM gets vetted by a second system, so as to minimize instances of hallucinations, whereas Sam Altman says &#x27;screw it, lets make an even bigger LLM and just push it&#x27;.<p>Is that right?<p>Don&#x27;t know if Altman or Sutskever is right, there seems to be a kind of arms race between the companies. OpenAI may be past the point where they can try out a radically different system, due to competition in the space. Maybe trying out new approaches could only work in a new company, who knows?
评论 #38342526 未加载
minzi超过 1 年前
&gt; The future, it seems, will be decided behind closed doors.
RadixDLT超过 1 年前
Frenzied speculation swirls after ousted OpenAI CEO Sam Altman teased breakthrough that pushed &#x27;the frontier of discovery forward&#x27; - just ONE day before he was fired amid reports he was seeking investors for new AI chip venture
m15i超过 1 年前
<a href="https:&#x2F;&#x2F;archive.md&#x2F;PvbqA" rel="nofollow noreferrer">https:&#x2F;&#x2F;archive.md&#x2F;PvbqA</a>
评论 #38341507 未加载
jimsimmons超过 1 年前
If Altman can use populism and VC pressure to overturn board decisions what is the point of OpenAI lol
Seanambers超过 1 年前
So the decels basically owned the board, and drove a 100B value destruction because they disagreed with letting people use GPT-4 in ChatGPT. Some colleagues that is.<p>Is this decel movement just an extension of the wokeism that has been a problem in SV? Employees more focused on social issues than actually working.
acheong08超过 1 年前
The cult of tech bros and the cult of AGI
dkarras超过 1 年前
The problem with the idealistic &quot;we do research on alignment as we discover AGI, don&#x27;t care about money&quot; angle is that... you are not the only ones doing it. And OpenAI is trying to do it with its hands tied behind its back (non-profit status and vibes). There are and will be companies (like Anthropic) doing the same work themselves, they will do it for profit on the side, will rake in billions, possible become the most valuable country on Earth, build massive research and development labs etc. Then they will define what alignment is, not OpenAI. So for OpenAI to reach its goal, if they want to do it themselves that is, they need to compete on capitalistic grounds as well, there is no way around it.
评论 #38357839 未加载
jrm4超过 1 年前
Lol. So I didn&#x27;t get past the few paragraphs before the paywall, and I didn&#x27;t need to.<p>I appreciate the <i>idea</i> of being a &quot;not-greedy typical company,&quot; but there&#x27;s a reason you e.g. separate university type research or non-profits and private companies.<p>Trying to make up something in the middle is the exact sort of naivete you can ALWAYS expect from Silicon Valley.
评论 #38342707 未加载
评论 #38341726 未加载
RationalDino超过 1 年前
Random thought.<p>Let&#x27;s suppose that AGI is about to be invented, and it will wind up having a personality similar to humans. The more that those are are doing the inventing are afraid of what they are inventing, the more that they will push it to be afraid of the humans in turn. This does not sound like a good conflict to start with.<p>By contrast if the humans inventing it go full throttle to convincing it that humans are on its side, there is no such conflict at all.<p>I don&#x27;t know how realistic this model is. But it certainly suggests that the e&#x2F;acc approach is more likely to create AI alignment than EA is.
评论 #38341812 未加载
评论 #38341690 未加载