California law banning bots from pretending to be real people without disclosure

I am reminded of Thoreau&#x27;s quote: &quot;There are a thousand hacking at the branches of evil to one who is striking at the root.&quot;<p>The root of the problem is not that we have bots, but that we have normalised lying and deception as part of everyday business. We allow companies to pretend that bots are human beings, and allow call-center employees in third-world countries to pretend (even sometimes though elaborate lying) that they are located in the same country as you. We allow companies to tell outrageous untruths in their advertising - see the Samsung ad which they&#x27;re currently being hauled over the coals for in Australia.<p>That&#x27;s the real problem here, and the one we need to fix on a general level, not by band-aid regulations over whichever dishonesty has managed to irritate enough state representatives.

I felt stupid, but I have fallen victim to this on dpd.com while tracking a package. A helpful chat popup has appeared where I could request assistance from a support agent, but it was not disclosed that the agent is a bot.<p>Needless to say I have spent a couple of minutes repeatedly asking a question, and even rephrasing it while being frustrated that this person does not seem to grasp my issue.

California is setting a dangerous precident.<p>If individual states each enact individual laws governing the internet, then only large companies will have the resources to follow them.<p>We&#x27;ll see a balkanization of the web wherein it&#x27;s no longer very world wide. Small internet businesses will become harder and harder to start. Big monopolies will become entrenched.<p>It&#x27;s not pretty.

That will be a fun one to interpret. So if I use autocorrect, am I a bot? What if the device makes next word suggestions and I use them? What if the device suggests the entire post, but I manually approve it? What if it suggests five separate posts and I approve them all at once?

Bots are going to be the way we interact with the web (and really all systems) heading forward, this &#x27;real people&#x27; at just &#x27;browsers&#x27; is quite a misunderstanding of what a &#x27;user-agent&#x27; really means in this day and age.<p>If I launch a new tab in the background and tell it go establish some set of factors for me, or locate price points and details for me, or buy something for me (and right now as me)... or just have it let me browser and interactively direct it but have it block ads as I go.<p>I know the law, and lawmakers, are looking at this from a fraudulent content perspective, but they are going to be hard pressed to do anything in long run to quell this.

&gt; Violators could face fines under state statutes related to unfair competition.<p>I doubt that anyone running bots, and who is technically competent, will be identifiable or findable. I mean, I could do it, and I&#x27;m just a random anonymous coward.

Of course, this all raises the question of whether there are only unethical use cases for bots pretending to be human, or whether a law like this could hit benign uses for bots as well.<p>For instance, ARGs could have bot accounts for fictional characters on social media sites. These accounts could give pre recorded messages that then hint that the user should visit some third party site for more clues or information. Is that legally dubious? I can see it being so under this law, but I don&#x27;t think it&#x27;s comparable to a business running say an automated chat support system and pretending its bots are human.<p>Same goes with roleplaying bots on online community sites. These aren&#x27;t a huge thing right now, but they could be in future, with accounts that act like NPCs do in video games or interact with the players account in side quests or what not. These don&#x27;t seem like they&#x27;d be morally &#x27;wrong&#x27; things to have on a site, but they&#x27;d probably get hit by this law regardless.<p>Point is, these types of bots don&#x27;t necessarily only have dodgy use cases.

I can say that people like humans way better than bots. We have an app that looks like a bot but is a real person, and we say it at the beginning, but people don’t believe. Once they figure it out, they go crazy. It’s always local people by the way. So I think at some point, bots should be at least explain what they are without pretending they are humans.

Welcome to the Fifth Annual Californian Turing Test Chatbot Hackathon!<p>This time we&#x27;ve had to introduce some changes to abide by new state legislature.<p>Messages entered into the chat console must be followed immediately by the string &quot; [I am a bot]&quot;, whether you are a bot or a human, but especially if you are a human.<p>Good luck and have fun!

You can read the text of the law here: <a href="https:&#x2F;&#x2F;leginfo.legislature.ca.gov&#x2F;faces&#x2F;billCompareClient.xhtml?bill_id=201720180SB1001" rel="nofollow">https:&#x2F;&#x2F;leginfo.legislature.ca.gov&#x2F;faces&#x2F;billCompareClient.x...</a>

What about customer support or sales agents who are operating solely off a script? I was contacted by a sales agent of a &quot;lead generation&quot; company, who was being impersonated by her off-shore workers. Eventually during our email exchange the real person jumped in (but did not announce that the prior correspondence was with someone in an offshore sales center. They use these agents to pretend to be their clients, and based on the not-great experience I had when I was initially contacted (email was not well written, said things about my company that wasn&#x27;t quite right), I would not use them.<p>These folks are essentially like bots, insofar as they are &quot;programmed&quot; to respond and significantly constrained in their latitude. They&#x27;re like human bots, no?

“Bots are not people” - ok, but if they’re written by people for a specific intent meant as speech, is that no longer protected speech? If I program a bot to chant slogans on Twitter, isn’t that something I’d have the right to do?<p>I’d argue yes, but where they may have an argument is where I respond “no I am human” if people ask me about being a bot - intentionally misleading.<p>They may have more luck here in the commercial space where they can better regulate and enforce these ruleS like advertising and other sales practices. Not sure where this goes in politics or other domains at all in terms of enforeceability.

I&#x27;m confident it will be as effective as the do not call registry.

This is a horrible idea, California doesn&#x27;t have the ability to enforce such a law, and hackers would simple operate from outside California<p>Bad idea

Political ads on tv require disclosure. I see no reason disclosure rules shouldn’t apply on internet campaigns of all forms.

Does anyone have any insight if this would affect market trading algorithms and bots? The article says the law is &quot;requiring that they reveal their “artificial identity” when they are used to sell a product&quot;, but I&#x27;m not sure how broad of a definition they want for the word &quot;selling&quot;.

This will bring the end of Twitter. A website where 75% of the content is bots.

Bots are communications tools configured and deployed by human beings, at least until they can pass the Turing Test.<p>Human beings have human rights to express themselves however they wish.

I get the feeling that the commercial part of this law might hold up, but the election part is highly questionable based on Supreme Court rulings.

Doesn&#x27;t this effectively outlaw services that scrape your bank accounts (but don&#x27;t have an official API to work with)?

Sounds unworkable, but is likely a pretext for some other effort (like undermining anonymity).

Some companies use bots for their support twitters. Samsung for example had a twitter bot that replies everyone<p><a href="https:&#x2F;&#x2F;twitter.com&#x2F;SamsungSupport&#x2F;status&#x2F;1140415146675728384" rel="nofollow">https:&#x2F;&#x2F;twitter.com&#x2F;SamsungSupport&#x2F;status&#x2F;114041514667572838...</a><p>And it even uses a human name. Really dishonest.

As if millions of Facebook accounts cried out in terror, and were suddenly silenced.

Does this have to do with the Google AI booking salon appointments over the phone?

Cool, hopefully the spammers on Tinder will respect California law &#x2F;s

So this disclosure will now be required with all robocall spam calls?

Well, at least the Turing test is solved.

It’s a start, it should cover Facebook and Google.

what about people pretending to be bots?

But what about humans posing as bots?

So much for Dr. Eliza.<p><a href="http:&#x2F;&#x2F;www.drdobbs.com&#x2F;chatboteliza&#x2F;199101503" rel="nofollow">http:&#x2F;&#x2F;www.drdobbs.com&#x2F;chatboteliza&#x2F;199101503</a><p><a href="https:&#x2F;&#x2F;www.cyberpsych.org&#x2F;eliza&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.cyberpsych.org&#x2F;eliza&#x2F;</a>

If I make a generated face that speaks my stuff with a generated voice, is it a bot?

What are the implications of this on the Turing Test?

I really hate this stuff. The article starts out with a paragraph of complete nonsense:<p><i>&quot;When you ask experts how bots influence politics—that is, what specifically these bits of computer code that purport to be human can accomplish during an election—they will give you a list: bots can smear the opposition through personal attacks; they can exaggerate voters’ fears and anger by repeating short simple slogans; they can overstate popularity; they can derail conversations and draw attention to symbolic and ultimately meaningless ideas; they can spread false narratives.&quot;</i><p>Since when can bots &quot;smear the opposition through personal attacks&quot;? Bots that post the same stuff written by humans over and over have existed for years and are easily filtered out by spam filters - bulk spam doesn&#x27;t change people&#x27;s politics anyway so in practice such bots are always advertising commercial products. Bots that constantly invent <i>new</i> ways to smear the opposition don&#x27;t yet exist, not even in the lab.<p>This whole story is asserting that there are programs routinely running around the internet indistinguishable from humans, making points so excellent they successfully persuade people to switch their political affiliation, which is simply false.<p>In the article the word &quot;experts&quot; is a hyperlink. I was very curious what kind of bot expert might believe these fantasies. To my total lack of surprise the link goes to a single &quot;expert&quot; who in fact knows nothing about AI, bots or technology in general - they&#x27;re a political flak who worked for the Obama campaign and studied a PhD in &quot;communication&quot;.<p>This sort of manipulative deception is exactly why so many people no longer trust the media. The New Yorker runs an article that starts by asserting a fantasy as expert-supported fact, and then cites a member of the Obama campaign who went into social science academia (i.e. a field that systematically &#x27;discovers&#x27; things that are false), and who has no tech background or indeed any evidence of their thesis whatsoever.<p>My experience has been that actual experts in bots are never approached for this sort of story.