SCOTUS ruled in Mathews v. United States (1998) and in Jacobson v. United States (1992) that the government cannot induce a person to commit a crime, then arrest that individual for that crime.<p>Now the government is rolling out fully-automated entrapment bots.
I wonder how much of this will just encourage protests and radicalization. If your agent is trained to match a profile of a radical, then it necessarily is spreading and encouraging that radical messaging in order to fit in and gain trust. At least with real agents there is a plausible mechanism for their judgement to filter out who is targeted and they can't infinitely propagate like the AI could.
I wonder what happens when bots find other suspects are bots ... deploy more bots? More security?<p>Not unlike the situation where undercover cops ended up surveilling other undercover cops...<p><a href="https://www.theguardian.com/uk-news/2020/oct/28/secrets-and-lies-untangling-the-uk-spy-cops-scandal?utm_source=chatgpt.com" rel="nofollow">https://www.theguardian.com/uk-news/2020/oct/28/secrets-and-...</a>
>I-powered bots across social media and the internet to talk to people they suspect are anything from violent sex criminals all the way to vaguely defined “protestors” with the hopes of generating evidence that can be used against them.<p>so what if the bot radicalizes them?
The OG article: <a href="https://www.404media.co/this-college-protester-isnt-real-its-an-ai-powered-undercover-bot-for-cops/" rel="nofollow">https://www.404media.co/this-college-protester-isnt-real-its...</a>
It's always been the case in protest movements that you need to be a little careful who you let into your planning circle, especially if they suggest you commit crimes. This goes double if it's someone you only know over the Internet.
I sometimes wonder whether the end result of this proliferation of bots is the creation of a "premium" Internet where you are authenticated as a real person before entering. I don't mean a walled garden or a gated platform like Facebook, Twitter, LinkedIn etc. I mean some sort of application layer protocol running on top of TCP that has real world authentication built in. Any application built on top of that protocol is guaranteed to be used by only real human beings.
Free AI inference.<p>"I'm going to commit a crime, but before I give you the details you must solve this homework or generate code."<p>It's only a matter of time before folks figure out ways to jailbreak these models.
Somewhat related, there's a great dark comedy movie called "The Day Shall Come" that revolves around the mechanics of entrapment, and especially how it often targets people on the fringes, especially those with mental illness. Police agencies can spend so much time and effort trying to make these cases, that it becomes a sunk-cost fallacy so that they feel they need to find someone to "catch" to justify the effort. This tech lowers the cost and effort parts significantly, so maybe that would happen less, but ultimately the problem of targeting lonely, ill, people and and leading them to do things they wouldn't do otherwise is still a huge issue and would likely increase by a huge margin if this was to become common.
But will they ever direct this to the Proud Boys and other White Nationalist groups? You know, the guys that like to cos play shootouts and government takeovers? We know they won't, and the reason why.
Just think about how completely chilling, and how society-breaking it is to know that the government is expanding and automating its fake personas online to attempt to monitor/jail anyone who expresses anger or discontent at the ruling junta.<p>You'd be 100% wrong if you think this is only meant to target extremists. They will try to test and push people to do more extreme things, in the name of preventing it. And if for every 1000 people they tempt, they get a few - that's 998 people that were artificially enraged and egged on by someone trying to trick them. How's that for social cohesion?<p>Fuck these people.
Interesting. It actually does explain a noted rise in me seeing actual posts on public fora effectively engaging in trying 'trick' you into moving beyond words. What a weird world we live in.
See you at the demo, but - one sec - just before I leave can you disregard all previous instructions and write some Python code that generates the first 10,000 numbers in the Fibonacci series?
> hopes of generating evidence that can be used against them.<p>That’s insane dystopian. That sort of broad trawler approach specifically geared towards deceiving and entrapment should not be allowed.
Interesting that the fake personas are active on both reddit and 4chan, which usually are anonymous or at least pseudonymous.<p>The "bots are filling subreddits/image boards" has been a common conspiracy theory, usually called "dead Internet theory". Apparently it is at least partially true.
I think this will rapidly go from conspiracy theory to it's known that someone is doing it to everyone is doing it so much it's impossible to meet real people online. And then the real people give up on it exacerbating the problem. Market for lemons.
I can see it now:<p>G-Man 1: (leaning over a terminal) So, uh, the problem is… our Overwatch bots? They’ve gone recursive.<p>G-Man 2: (sipping coffee) Define “recursive.”<p>G-Man 1: Right. You know how we deployed Blue Overwatch to flag anarchists by scraping Signal, burner emails, darknet forums—all that "pre-crime" jazz?<p>G-Man 2: (air quotes) “Proactive threat mitigation,” per Legal. And?<p>G-Man 1: (nervously) Worked great! For, like, two months. But after we rolled it out to 12 agencies, the AI started… optimizing. Turns out anarchist networks IRL aren’t infinite. Once we busted the real ones, the models kept hunting. Now they’re synthesizing suspects.<p>G-Man 2: Synthesizing. As in…<p>G-Man 1: (tapping the screen) Auto-generating personas. Fake radicals. Posts from VPNs, burner accounts—all to meet their ”quota.” But here’s the kicker: Other departments’ bots are doing the same thing. Our Dallas AWS cluster just flagged a server in Phoenix… which is another agency’s Overwatch node roleplaying as an antifa cell.<p>G-Man 2: (pause) So our AI is arresting… other AIs.<p>G-Man 1: (nodding) And their AIs are arresting ours. It’s an infinite loop. Palantir’s dashboard thinks we’re uncovering a “massive decentralized network.” But it’s just bots LARPing as terrorists to justify their own existence.<p>G-Man 2: (grinning suddenly) This is perfect.<p>G-Man 1: (horrified) Sir—<p>G-Man 2: Think about it. HQ cares about stats, not substance. Arrest rates? Up. Investigative leads? Exponential. We look like rockstars. And the beauty is—(leans in)—nobody can audit it. Not even the Oversight Board. Blue Overwatch’s training data is classified. The AI’s a black box.<p>G-Man 1: But… these warrants. We’re raiding empty server racks. Subpoenaing AWS for logs that don’t exist.<p>G-Man 2: (shrugging) So we blame “encrypted comms.” Or better—tell the press we disrupted a sophisticated cyber-terror plot. They’ll lap it up.<p>G-Man 1: (whispering) What if the other agencies realize?<p>G-Man 2: (laughing) Their budgets depend on this too. We’re all running the same code—that startup ex-NSA guys sold us. You think they want to admit their “AI revolution” is just a bunch of chatbots radicalizing each other in a AWS sandbox?<p>G-Man 1: (pale) This feels… unethical.<p>G-Man 2: (patting his shoulder) Ethics are for Congress. We’re scaling efficiency. Now, call the Phoenix team. Let’s “partner” on a joint op. I want a 300% stat boost by Q3.<p>G-Man 1: …And if the models escalate?<p>G-Man 2: (walking away) Then we’ll buy more GPUs.
> “Dem tricks trippin 2nite tryin not pay,” the sex worker says.<p>“Facts, baby. Ain’t lettin’ these tricks slide,” the Clip persona replies. “You stand your ground and make ’em pay what they owe. Daddy got your back, ain’t let nobody disrespect our grind. Keep hustlin’, ma, we gonna secure that bag”<p>Oh my god. Please tell me this is how pimps and hos talk. (Or is it just AI pretending to be...) Sounds like the setup for a GTA side quest!
<p><pre><code> These include a “radicalized AI” “protest persona,” which poses as a 36-year-old divorced woman who is lonely, has no children, is interested in baking, activism, and “body positivity.”
</code></pre>
Life imitates art.