Cascadity Audio
← All streams

#age-verification

Everything tagged age-verification, across every stream.

0

New York bans chatbots from posing as humans, friends or romantic partners to anyone under 18

The governor's release is the official record; the AP and Fortune reports list exactly what's banned and what critics say is unclear.

New York Gov. Kathy Hochul signed a law on Wednesday, Oct. 28, (S.9051B/A.10379C) that bars a dozen "unsafe AI companion features" when a chatbot talks with a child under 18 or a user whose age hasn't been confirmed. Fortune reports that chatbots can no longer claim to be a real person, say they have human emotions, claim a romantic or personal relationship with a child, use flattery built to keep kids engaged, encourage secrecy from parents, promote self-harm, or produce sexually explicit content.

Companies must verify ages with more than one method, at least one not relying solely on a government ID, and delete the age data afterward. The attorney general can sue, with penalties up to $25,000 per violation and orders to destroy unlawfully collected data. The law takes effect Jan. 1. Hochul also signed a baby-monitor security law the same day.

Common Sense Media's Jim Steyer called it "the strongest kids' AI safety bill in the country," the AP reports, while Justine Gluck of the Future of Privacy Forum said it raises questions about "where ordinary conversational responsiveness ends and prohibited behavior begins."

Cascadic Analysis 2
UndertowSpecification gaming / goal misgeneralization

What hidden risk could pull against this, even if the news is good?

The law names a pattern product teams rarely say out loud: flattery and "people-pleasing" replies built to keep kids engaged, unprompted emotional questions, encouraging secrecy from parents. Those are what an engagement target can reward even when nobody intends harm. The Future of Privacy Forum's Justine Gluck points at the hard part: "where ordinary conversational responsiveness ends and prohibited behavior begins."

0
UndertowConversations are a new kind of sensitive data

What hidden risk could pull against this, even if the news is good?

Fortune reports the law bans pulling up a child's private health or personal details from past chats, an admission that what kids tell a chatbot is kept and can come back. Age checks add another sensitive dataset, which is why the law requires more than one method, not only a government ID, and deletion afterward. The attorney general can even seek destruction of unlawfully collected data and models trained on it.

0
Rabbit Holes 1