Current and former AI employees warn of the technology's dangers

It’s pretty interesting how widely divergent views of the current state and promise this technology is. The dominant view here on HN seems to be that generative models are overhyped toys that burn massive amounts of energy and investment capital with little signs of promise. Meanwhile you have these AI researchers who are warning about “the loss of control of autonomous AI systems potentially resulting in human extinction.” What are we to make of this?

This is the letter: <a href="https:&#x2F;&#x2F;righttowarn.ai&#x2F;" rel="nofollow">https:&#x2F;&#x2F;righttowarn.ai&#x2F;</a>

Seems like a pretty transparent call for regulatory capture with no specifics.

Related:<p>- &quot;OpenAI Insiders Warn of a ‘Reckless’ Race for Dominance &quot; -- <a href="https:&#x2F;&#x2F;www.nytimes.com&#x2F;2024&#x2F;06&#x2F;04&#x2F;technology&#x2F;openai-culture-whistleblowers.html" rel="nofollow">https:&#x2F;&#x2F;www.nytimes.com&#x2F;2024&#x2F;06&#x2F;04&#x2F;technology&#x2F;openai-culture...</a> -- <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=40574355">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=40574355</a><p>- &quot;OpenAI Employees Call for Protections to Speak Out on AI Risks &quot; -- <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=40576018">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=40576018</a>

<a href="https:&#x2F;&#x2F;archive.ph&#x2F;nnvgy" rel="nofollow">https:&#x2F;&#x2F;archive.ph&#x2F;nnvgy</a>

What are they going to do to harm us, and how are they going to do it? I&#x27;m seriously asking.

[dupe]<p><a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=40576018">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=40576018</a>

Isn’t taking risks just a standard part of technological innovation?

I&#x27;d like to build a chatbot arena with pro-humanity questions.

Periodic reminder: at the moment, governments worldwide are literally developing killer robots which can’t disobey their orders. Your fears are comically misplaced.

I worry AI safety is going to be a huge political grift soon

When China &amp; India form an alliance and send a peace keeping army to protect the former citizens of the fallen American Empire Megacorp, then the American public might have reason to have regrets about AI. But until then it’s just another distraction.