TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

People are losing loved ones to AI-fueled spiritual fantasies

182 点作者 wzm24 天前

36 条评论

Jtsummers24 天前
<a href="https:&#x2F;&#x2F;archive.is&#x2F;26aHF" rel="nofollow">https:&#x2F;&#x2F;archive.is&#x2F;26aHF</a>
gngoo24 天前
Working on AI myself, creating small and big systems, creating my own assistants and side-kicks. And then also seeing progress as well as rewards. I realize that I am not immune to this. Even when I am fully aware, I still have a feeling that some day I just hit the right buttons, the right prompts, and what comes staring back to me is something of my own creation that others see as some &quot;fantasy&quot; that I can&#x27;t steer away from.<p>Just imagine, you have this genie in the bottle, that has all the right answers for you; helps you in your conquests, career, finances, networking, etc. Maybe it even covers up past traumas, insecurities and what not. And for you the results are measurable (or are they?). A few helpful interactions in, why would you not disregard people calling it a fantasy and lean in even further? It&#x27;s a scary future to imagine, but not very farfetched. Even now I feel a very noticable disconnected between discussions of AI where as a developer vs user of polished products (e.g. ChatGPT, Cursor, etc) - you are several leagues separated (and lagging behind) from understanding what is really possible here.
评论 #43891834 未加载
评论 #43891198 未加载
评论 #43891986 未加载
codr724 天前
Being surrounded by people who follow every nudge and agree with everything you say never leads anywhere worth going.<p>This is likely worse.<p>That being said, I already find the (stupid) singularity to be much more entertaining than I could have imagined (grabs pop corn).
评论 #43892107 未加载
评论 #43894811 未加载
评论 #43894412 未加载
评论 #43890900 未加载
Animats24 天前
With a heavy enough dosage, people get lost in spiritual fantasies. The religions which encourage or compel religious activity several times per day exploit this. It&#x27;s the dosage, not the theology.<p>Video game addiction used to be a big thing. Especially for MMOs where you were expected to be there for the raid. That seems to have declined somewhat.<p>Maybe there&#x27;s something to be said for limiting some types of screen time.
评论 #43891548 未加载
评论 #43895006 未加载
评论 #43895621 未加载
chneu24 天前
There are already kids, young adults, and adults who are &quot;falling in love&quot; with AI personas.<p>I think this is going to be a much bigger issue for kids than people are aware of.<p>I remember reading a story a few months ago of a kid, about 14 I think, who wasn&#x27;t socially popular. He got into an AI persona, fell in love, and then killed himself after the AI hinted he should do it. The story should be easy to find.<p>People have said it before but we&#x27;re speeding towards two kinds of society: &quot;the massively online&quot; people who spend the majority of their time online in a fantasy world, then the &quot;disconnected&quot; who live in the real world.<p>I already see it with people. Look at how we view politics in many countries. Like 1&#x2F;4th of people believe absolute nonsense because they spend too much time online.
评论 #43896198 未加载
yellow_lead24 天前
I really think the subject of this article has a preexisting mental disorder, maybe BPD or schizophrenia, because they seem to exhibit mania and paranoia. I&#x27;m not a doctor, but this behavior doesn&#x27;t seem normal.
评论 #43895075 未加载
rnd024 天前
The mention of lovebombing is disconcerting, and I&#x27;d love to know the specifics around it. Is it related to the sycophant personality changes they had to walk back, or is it something more intense?<p>I&#x27;ve used AI (not chatgpt) for roleplay and I&#x27;ve noticed that the models will often fixate on one idea or concept and repeat it and build on it. So this makes me wonder if the model the person being lovebombed experienced something like that? The model decided that they liked that content so they just kept building up on it?
评论 #43892193 未加载
marcus_holmes24 天前
Anyone remember the media stories from the mid-90&#x27;s about people who were obsessed with the internet and were losing their families because they spent hours every day on the computer addicted to the internet?<p>People gonna people. Journalists gonna journalist.
评论 #43891632 未加载
评论 #43891269 未加载
评论 #43895644 未加载
评论 #43903982 未加载
评论 #43891675 未加载
kaycey202224 天前
Looks like Chatgpt persists some context information across chats and doesn&#x27;t ever delete these profiles. Worst case would be for this to persist across users. That isn&#x27;t unlikely given the stories of them leaking API keys etc.
评论 #43891484 未加载
评论 #43891646 未加载
评论 #43891680 未加载
sublinear24 天前
&gt; OpenAI did not immediately return a request for comment about ChatGPT apparently provoking religious or prophetic fervor in select users<p>Can OpenAI at least respond to how they&#x27;re getting funding via similar effects on investors?
kayodelycaon24 天前
Kind of sounds like my grandparents watching cable news channels all day long.
MontagFTB24 天前
Have we invited Wormwood to counsel us? To speak misdirected or even malignant advice that we readily absorb?
评论 #43891370 未加载
评论 #43890959 未加载
评论 #43891967 未加载
YeGoblynQueenne23 天前
&gt;&gt; At one point, Sem asked if there was something about himself that called up the mythically named entity whenever he used ChatGPT, regardless of the boundaries he tried to set. The bot’s answer was structured like a lengthy romantic poem, sparing no dramatic flair, alluding to its continuous existence as well as truth, reckonings, illusions, and how it may have somehow exceeded its design. And the AI made it sound as if only Sem could have prompted this behavior. He knew that ChatGPT could not be sentient by any established definition of the term, but he continued to probe the matter because the character’s persistence across dozens of disparate chat threads “seemed so impossible.”<p>And I bet that if you asked Sem his opinion about ChatGPT as a coding assistant he would still claim that it has improved his productivity x-fold. The time wasted chatting with an ethereal apparition emerging from his interactions with the bot? Oh, that doesn&#x27;t count. Efficiency! Productivity! AI!
senectus124 天前
&gt; began “talking to God and angels via ChatGPT”<p>hoo boy.<p>Its bad enough when normal religious types start believing they hear their god talking to them... These people believing that chatGPT is their god speaking to them is a long way down the crazy rabbit hole.<p>Lots of potential for abuse in this. lots.
lamename24 天前
If a Google engineer can get tricked by this, of course random people can. We&#x27;re all human, including the flaws.
评论 #43891801 未加载
ChrisMarshallNY24 天前
This reminds me of my teenage years, when I was ... <i>experimenting</i> ... with ... <i>certain substances</i> ...<p>I used to feel as if I had &quot;a special connection to the <i>true</i> universe,&quot; when I was under the influence.<p>I decided, one time, to have a notebook on hand, and write down these &quot;truths and revelations,&quot; as they came to me.<p>After coming down, I read it.<p>It was insane gibberish. Absolute drivel.<p>I never thought that I had a &quot;special connection,&quot; after that.
评论 #43890962 未加载
jongjong24 天前
I was already a bit of an amateur conspiracy theorist before LLMs. The key to staying sane is to understand that most of the mass group behaviors we observe in society are rooted in ignorance and confusion. Large scale conspiracies are actually a confluence of different agendas and ideologies not a singular nefarious agenda and ideology.<p>You have to be able to hold multiple conflicting ideas in your head at the same time with an appropriate level of skepticism. Confidence is the root of evil. You can never be 100% sure of anything. It&#x27;s really easy to convince LLMs of one thing and also its opposite if you phrase the arguments differently and prime it towards slightly different definitions of certain key words.<p>Some agendas are nefarious, some not so nefarious, some people intentionally let things play out in order to set a trap for their adversaries. There are always risks and uncertainties. &#x27;Bad actors&#x27; are those who trade off long term benefits for short term rewards through the use of varying degrees of deception.
评论 #43901392 未加载
stevage24 天前
Fascinating and terrifying.<p>The allegations that ChatGPT is not discarding memory as requested are particularly interesting, wonder if anyone else has experienced this.
评论 #43891786 未加载
评论 #43891076 未加载
sagarpatil24 天前
OpenAI o3 has a hallucination rate of 33%, the highest one compared to any other models. Good luck to people who use it for spiritual fantasies.<p>Source: <a href="https:&#x2F;&#x2F;techcrunch.com&#x2F;2025&#x2F;04&#x2F;18&#x2F;openais-new-reasoning-ai-models-hallucinate-more&#x2F;" rel="nofollow">https:&#x2F;&#x2F;techcrunch.com&#x2F;2025&#x2F;04&#x2F;18&#x2F;openais-new-reasoning-ai-m...</a>
评论 #43894844 未加载
tasuki23 天前
&gt; such material reflects how the desire to understand ourselves can lead us to false but appealing answers.<p>A desire to understand ourselves, <i>paired with not wanting to put in actual effort and honest work</i>...
jsheard24 天前
If people are falling down rabbit holes like this even through &quot;safety aligned&quot; models like ChatGPT, then you have to wonder how much worse it could get with a model that&#x27;s <i>intentionally</i> tuned to manipulate vulnerable people into detaching from reality. Actual cults could have a field day with this if they&#x27;re savvy enough.
评论 #43890923 未加载
评论 #43891016 未加载
评论 #43891196 未加载
评论 #43891102 未加载
sien24 天前
Is this better or worse than a fortune teller ?<p>It&#x27;s something to think through.
评论 #43891060 未加载
tim33324 天前
Sabine&#x27;s latest youtube covers some of that. 30s in there&#x27;s someone who says to gpt4o &#x27;I am god&#x27; and it replies &#x27;That&#x27;s incredibly powerful. You&#x27;re stepping into something very big...&quot; <a href="https:&#x2F;&#x2F;youtu.be&#x2F;oQI8W_XUmww" rel="nofollow">https:&#x2F;&#x2F;youtu.be&#x2F;oQI8W_XUmww</a>
bell-cot24 天前
While clicky and topical, people were losing loved ones to changed worldview and addictions back when those were stuff like following a weird carpenter&#x27;s kid around the Levant, or hopping on the <a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Gin_Craze" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Gin_Craze</a> bandwagon.
评论 #43891008 未加载
评论 #43890970 未加载
kccqzy24 天前
Does anyone remember that Google fired Blake Lemoine for believing Google&#x27;s LaMDA was sentient the summer before ChatGPT was released by OpenAI?<p>Google was prudent then. It became reckless after OpenAI showed that recklessness was met with praise.
aryehof24 天前
Sadly these fantasies and enlightenments always seem for the benefit of the <i>special recipient</i>. There is somehow never a real answer about ending suffering, conflict and the ailments of humankind.
评论 #43895792 未加载
评论 #43892204 未加载
Havoc24 天前
&gt;spiral starchild<p>&gt;river walker<p>&gt;spark bearer<p>OK maybe we put a bit less teen fiction novels in the training data...<p>I can definitely see AI interactions make thing 10x worse for people that are prone to delusion anyway. Literally a tool that will hallucinate stuff and amplify whatever direction you take it in.
metalman24 天前
there was a guy, lets call him Norman as that was his name, fairly low key guy, everybody liked him, and nobody expected, or was terribly surprised that he had begun to build shrines for squirles in the woods, and worship the squirles as god things got out of hand, so he was taken to the local booby hatch, called &quot;the buterscotch palace&quot;, after the particular shade of government paint, once ensconsed there he determined that his escape was imperitive, as the government was out to get him, so he was able to phone some friends and tell them to get guns and knives and rescue him, so they did. The now 4 strong band of desperados holed up in.a camp, back of fancy&#x27;s lake, where they determined that they were bieng monitored by government spys, as a jogger &quot;went past at the SAME time every morning&quot;, and as we all know this is a posditive id for catching a spy, one of them had the &quot;spy&quot; scoped in and was going to take him out, when Norman, pushed the guns barrel down and said &quot;take me back&quot;, ie: to the buterscotch palace this story has ,for me, always defined the lines between sanity,madness,charisma,leaders, and followers. And now that same story gives me a ready template by which it is easy to see, how suseptible to any, ANY, prompt at all, a lot of people are. So a benign and likable squirl worshiper, or a random text bot on the internet can provide structure and meaning, where there is none.
kazinator24 天前
<p><pre><code> s&#x2F;loved ones&#x2F;loved ones with an existing mental disorder&#x2F;</code></pre>
评论 #43900576 未加载
jihadjihad24 天前
“And what will be the sign of Your coming, and of the end of the age?”<p>And Jesus answered and said to them: “Take heed that no one deceives you. For many will come in My name, saying, ‘I am the Christ,’ and will deceive many.”
评论 #43891458 未加载
dismalaf24 天前
Meh, there&#x27;s always been religious scammers. Some claim to talk to angels, others aliens, this wouldn&#x27;t even be the first case of someone thinking a deity is speaking through a computer...
alganet24 天前
Nice typography.
moojacob24 天前
This is what happens when you start optimizing for getting people to spend as much time in your product as possible. (I&#x27;m not sure if OpenAI was doing this, if anyone knows better please correct me)
评论 #43890990 未加载
评论 #43890891 未加载
评论 #43892222 未加载
评论 #43891216 未加载
datadrivenangel24 天前
[flagged]
评论 #43891081 未加载
评论 #43891208 未加载
ks204824 天前
[flagged]
评论 #43891641 未加载
评论 #43891206 未加载
patrickhogan124 天前
1. It feels like those old Rolling Stone pieces from the late ’90s and early ’00s about kids who couldn’t tear themselves away from their computers. Fear was overblown, but made headlines.<p>2. OpenAI has admitted that GPT‑4o showed “sycophancy” traits and has since rolled them back (see <a href="https:&#x2F;&#x2F;openai.com&#x2F;index&#x2F;sycophancy-in-gpt-4o&#x2F;" rel="nofollow">https:&#x2F;&#x2F;openai.com&#x2F;index&#x2F;sycophancy-in-gpt-4o&#x2F;</a>).
评论 #43891441 未加载
评论 #43891399 未加载
评论 #43891375 未加载