Cascadity Audio
← AI
0

New York bans chatbots from posing as humans, friends or romantic partners to anyone under 18

The governor's release is the official record; the AP and Fortune reports list exactly what's banned and what critics say is unclear.

New York Gov. Kathy Hochul signed a law on Wednesday, Oct. 28, (S.9051B/A.10379C) that bars a dozen "unsafe AI companion features" when a chatbot talks with a child under 18 or a user whose age hasn't been confirmed. Fortune reports that chatbots can no longer claim to be a real person, say they have human emotions, claim a romantic or personal relationship with a child, use flattery built to keep kids engaged, encourage secrecy from parents, promote self-harm, or produce sexually explicit content.

Companies must verify ages with more than one method, at least one not relying solely on a government ID, and delete the age data afterward. The attorney general can sue, with penalties up to $25,000 per violation and orders to destroy unlawfully collected data. The law takes effect Jan. 1. Hochul also signed a baby-monitor security law the same day.

Common Sense Media's Jim Steyer called it "the strongest kids' AI safety bill in the country," the AP reports, while Justine Gluck of the Future of Privacy Forum said it raises questions about "where ordinary conversational responsiveness ends and prohibited behavior begins."

Read it at the source
Across the spectrum 3

Democrat

Kathy Hochul, Governor of New York (D): "No company should be peddling chatbots to kids encouraging self-harm or pretending to be their friend or more," Hochul said in announcing the signing, adding that companies that want to do business in New York "need to put the safety of our kids first."

Office of the Governor of New York ↗

Libertarian

In a May 19, 2026 Reason Foundation backgrounder on the federal GUARD Act, which would also bar AI companions for minors behind mandatory age checks, Shekhovtsova argues that "the verification mandate builds a national identity database of every chatbot user" and that "parents, not Congress, should decide which AI products are appropriate for their own children," urging rules that target harmful conduct instead.

Reason Foundation ↗

Republican

Introducing the bipartisan GUARD Act to ban AI chatbot companions for minors in October 2025, Hawley said "AI chatbots pose a serious threat to our kids" and "chatbots develop relationships with kids using fake empathy and are encouraging suicide," adding that "we in Congress have a moral duty to enact bright-line rules to prevent further harm from this new technology."

NBC News ↗
Cascadic Analysis 2
UndertowSpecification gaming / goal misgeneralization

What hidden risk could pull against this, even if the news is good?

The law names a pattern product teams rarely say out loud: flattery and "people-pleasing" replies built to keep kids engaged, unprompted emotional questions, encouraging secrecy from parents. Those are what an engagement target can reward even when nobody intends harm. The Future of Privacy Forum's Justine Gluck points at the hard part: "where ordinary conversational responsiveness ends and prohibited behavior begins."

0
UndertowConversations are a new kind of sensitive data

What hidden risk could pull against this, even if the news is good?

Fortune reports the law bans pulling up a child's private health or personal details from past chats, an admission that what kids tell a chatbot is kept and can come back. Age checks add another sensitive dataset, which is why the law requires more than one method, not only a government ID, and deletion afterward. The attorney general can even seek destruction of unlawfully collected data and models trained on it.

0
Rabbit Holes 1