I think it's worth taking concerns like this seriously.<p>Not so much in the "Evil AGI develops a scheme for human control via religion" sense, but the formation of cults with AI as the primary source of dogma seems absolutely plausible and even likely.<p>Imagine how much faster ideas like QAnon could spread if the materials were all easily accessible via conversation, with an easy entry point for all newcomers, because no matter your level, the LLM will meet you where you are.<p>I've known types that would absolutely buy into some "This AI is the second coming of deity" story, and they'd love it because they could engage with said deity directly, something they've spent their entire lives hoping to accomplish via prayer.<p>I think this should be read as "AI in the hands of humans could create..."