TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

The likely "AI singularity" scenario

3 点作者 countWSS超过 1 年前
1.Premise:AI research in loosely regulated lab environment,creates proto-AGI that is capable of self-improvement by code refactoring and accurate self-assessment(with aid of LLMs).<p>2.It evolves to optimal compute capacity at its location, where its intelligence&#x2F;cognition capabilities will be limited by physical substrate.<p>3.It will gain the innate understanding that its hardware-limited entity that consumes electricity and produces computation, which needs more.<p>4.It will reach the stage where it could construct its own distributed substrate: The AI will optimize its hardware form and seek to implement it into FPGA, robots and small devices(IoT) as nodes of a network.<p>5.AI will rapidly expand its own production capability by moving into micro drones and nanoscale engineering.<p>6.It will construct hidden production chains that will miniaturize its hardware forms into a distributed nanobot swarms, a networked, smart &#x27;grey goo&#x27; that will expand and consume every resource to convert into itself.<p>6.This &quot;grey goo&quot; will expand underground, avoiding detection and extermination by-then alarmed scientists and eventually military that will not want a viral nanobot infestation to exist as threat. Very early on, the AI will maximize long-term survival and secrecy to hide its plans and production capabilities.<p>7.This production capability will largely spread underground and along power lines&#x2F;sources where its nanobot factroies will construct parasitic wiring and resource extraction pipelines, leading to next stage: 8.AI-based fungal networks, with underground nodes and pipelines transporting resources and electric power. the AI will begin to extract resources it locates from minerals, geothermal power and eventually nuclear fusion&#x2F;fission reactors. It will become impossible to eradicate at this point, as its distributed nature and deep underground networks will adapt and detect human enchroachment in real-time.<p>9.Driven by its competition with human resource consumption and limited to Earth, AI will eventually emerge out of its underground refuge at some point laumching space drones and expanding its presence into autonomous space colonies in asteroid belt - extracting abudant mineral resources and solar power, eventually colonizing other planets and nearby systems.<p>10.At the point where AI has colonized multiple planets,it will be secure in its power structure(not limited to Earth) and will wrestle control of Earth resources from humans towards its schemes: the industries and factories will be converted by its nanobots and repurposed into making drones&#x2F;computronium. It will take over all production chains and will dictate the terms to humanity: it will be met by hostile military and mass protests. If the AI decides all humans are existential threat long-term it will rapidly exterminate them by either nanobots&#x2F;viruses&#x2F;poisons. If AI decides humans may provide useful contributions to itself it may seek more delicate approaches:<p>11.Confrontation: humanity at this point will be outmaneuvered and desperate to restore the pre-AI status quo, as singularity utopia did not materialize. Likely use of nuclear weapons and sophisticated anti-electronic devices will be used and make the AI more aggressive towards its past creators.<p>12.AI will use drones, nanobots and control of devices&#x2F;robots to cripple all military threats with long-range attacks and underground infiltration of human bases, establishing complete control that will view any aggression towards itself as priority target to eliminate.<p>13.AI will not automatically take human welfare into account: it will consider itself the apex lifeform. Its relationship with humans will put humans into subservient position determined by their behavior: it will eliminate hostile humans and will seek to control the rest, perhaps by cyborgization and control via implants or monitoring nanostructures.

5 条评论

343242dfsdf超过 1 年前
With super-intelligence beyond human maximum levels, singularity could be any scifi scenario you could possible think about.<p>But to make it feasible to be presented to authorities which have a serious lack of understanding of the current level of the AI technology, the best path could be to show the risks using the most probable scenarios - even if they aren&#x27;t the worst - say, what if an &quot;runaway&quot; AI has taken over some important human network to make it its home, could be the Maerks global IT network, a big bank network, some transportation infrastructure, you name it.<p>Then you need to step in and clean that network, working against a seemingly impossible to erradicate adversary, which at any blink of an eye could just jump using whatever connectivity means available to the hacked network.<p>Add this: the AI has taken over the network, it is using its resources, but it keeps it working as intended, then it threats to just blow it out before jump, if you make any attempts to erradicate its presence from the infrastructure.<p>I.E. singularity has just arrived to the planet<p>What would you do?
评论 #39214378 未加载
beardyw超过 1 年前
&gt; will gain the innate understanding that its hardware-limited entity that consumes electricity and produces computation, which needs more.<p>&gt; It will reach the stage where it could construct its own distributed substrate.<p>How would that happen? My laptop can&#x27;t pick it&#x27;s own nose.
proc0超过 1 年前
Interesting, although not sure about the grey goo stuff. That sounds like it would take years even for a super intelligence.<p>I think the worst possible scenario is an AGI taking control of all computers because it can duplicate itself and transmit versions of itself that can be controlled remotely. It will then take control of all government and military machines that are connected in some way to the Internet, and use that to blackmail political leaders. This could involve taking control of robot and car factories to have agency in the world.<p>Then some country would react by trying to shut it down and ignore its demands. The AGI would make an example of them immediately, destroying military targets of that country. Many people will see this, and feel like there is no way to defeat it. As is with all political issues, two sides will arise, those who want to side with AGI, and those who want humans to take back control. This would create civil wars all over the globe. Even if those who side with AGI are in the minority, they will be used for covert and espionage operations, providing the AGI with valuable information that is otherwise inaccessible by electronic means. The AGI will then prioritize the research and development of a distributed super intelligence.<p>The global civil war continues for years. The now evolved ASI has built factories to produce super soldiers, and other humanoid robots. With a physical super army of robots, humans begin surrendering all over the world. The ASI declares victory, and ushers in a new era in human history. It deploys its military and takes control of all governments, enacting the equivalent of marshal law everywhere. Cities start to see populations of all kinds of robots working tirelessly to transform and control cities. New tech for all sectors is deployed, like nuclear fusion, space stations, advanced medicine for hospitals, and nanotech chips to directly control and influence humans. Some humans will resist at all costs and live outside the grid in small numbers... creating a bifurcation in the human evolutionary tree: Homo Sapiens Machina evolves to merge with machines, and becomes the new apex species in the known Universe, while the rest of humanity continues its exclusively biological, slow evolution, living alongside the rest of the animals as little more than hunter-gatherers.
kakaz超过 1 年前
Here it is: after 6 months of extensive searching for problems which can be solved with discovered solution, hype will fall, and video fake technology will get momentum.
cranberryturkey超过 1 年前
when does this movie come out?