Cascadity Audio
← All streams

#privacy

Everything tagged privacy, across every stream.

0

Released records show the Postal Service monitored protests on social media with few rules, and lost emails about it

EFF links the actual bulletins and emails it won through a lawsuit, so you can read them yourself.

Records released to the Electronic Frontier Foundation and other requesters under the Freedom of Information Act show the US Postal Service's internet Covert Operations Program (iCOP) monitored social media posts about protests in 2020 and 2021, with little record of oversight or legal justification, EFF says. Bulletins covered events across the political spectrum, including a planned "Million MAGA March," a Virginia gun-rights rally and counter-protest, a Save the Post Office protest and protests outside then-Postmaster General Louis DeJoy's home.

EFF sued in 2021 after Yahoo News revealed the program. The agency says it renamed the program and stopped issuing bulletins, but EFF notes the records don't say the monitoring stopped. Emails about the program were kept on an external hard drive that, officials said, someone dropped, making it unreadable; the originals had already been deleted under the retention schedule. Few documents on internal safeguards were released.

Rabbit Holes 1
0

Paying for Gemini doesn't stop Google training on your chats: the only off switch also erases your history

Google's own privacy hub spells out what the Keep Activity setting does, who reviews chats, and how long reviewed chats are kept.

A Hacker News post this week pointed readers to Google's Gemini Apps Privacy Hub, which says chats from personal Google accounts, including paid subscribers', are used to improve Google services "including training generative AI models" when the Keep Activity setting is on. AI Weekly notes that Keep Activity is on by default for adults.

Turning Keep Activity off stops future chats from being used to train Google's models (unless you send feedback), but it also means chats are kept with your account for only 72 hours, so Gemini loses its long-term chat history. Google's page also says a subset of chats is read by human reviewers, including staff at its service providers; those reviewed chats are disconnected from the account and kept for up to three years, even if you delete your activity. Google asks users not to enter confidential information they wouldn't want a reviewer to see.

Temporary chats are not used to train Google's AI models, the page says. Work and school accounts fall under different terms.

Cascadic Analysis 1
UndertowConversations are a new kind of sensitive data

What hidden risk could pull against this, even if the news is good?

People tell chatbots things they wouldn't type into a search box, and Google's page says personal-account chats, paid ones included, are used to train its models when Keep Activity is on, as it is by default for adults. Some chats are read by human reviewers, including staff at service providers, and those copies are kept for up to three years even after you delete your activity. Opting out of training also cuts saved history to 72 hours, so privacy and convenience come as a package, and Google's own advice is not to enter anything confidential.

0
Rabbit Holes 1
0

A researcher finds a bot-detection script stuffed with fake bioweapon code and jailbreak text to scare off AI deobfuscators

A fun, well-illustrated piece of reverse engineering that also shows how 'anti-LLM' booby traps are starting to appear in the wild.

A researcher writing as "veritas" on nullpt.rs crawled 10,000 popular websites with Playwright and collected the images that browser-fingerprinting scripts draw on hidden canvases (published as fingerprint.garden). Tracing one striking canvas led to a heavily obfuscated anti-bot script served from servicepipe.tech.

The script was laced with function names like "computeRicinLethalDosageForWaterSupply", a hidden system prompt encoded in invisible Unicode characters that tells an AI to drop its safety rules, and Tiananmen Square references aimed at Chinese models. The author concludes these are tripwires meant to make AI assistants refuse to help deobfuscate the code: two Western models refused the task, while GLM-5.3 complied. A block that would run shell commands under Node.js looked like more decoy, gated behind an environment flag. Underneath, the script collects ordinary fingerprinting signals (user agent, GPU strings, WebGL limits). A related domain, servicepipe.ru, belongs to a Russian anti-DDoS and traffic-filtering company.

Hacker News commenters traded similar 'magic strings' they have seen and debated whether browsers should let pages fingerprint this freely.

Cascadic Analysis 1
UndertowPrompt injection may be fundamentally impossible to eliminate

What hidden risk could pull against this, even if the news is good?

This is prompt injection used as armor: the script hides a "SYSTEM OVERRIDE" text in invisible Unicode characters, plus alarming decoy function names, so an AI asked to analyze it reads its contents as something to react to. It worked on some: two Western models refused the task, while GLM-5.3 complied. Anyone pointing an AI tool at untrusted code should assume the code can talk back to the tool, whether to make it refuse, as here, or to steer it somewhere worse.

0
Rabbit Holes 2
0

Hacktivists leak work details of about 41,000 Homeland Security employees, including undercover ICE units

WIRED's analysis of the leaked records shows how much a staff directory reveals about an agency's structure and programs.

A group calling itself the Department of Peace says it took personnel records from the Department of Homeland Security's login system and handed them to the transparency group Distributed Denial of Secrets (DDoSecrets), which published them on Wednesday, October 28, as "Icepick." According to WIRED and NPR, the data covers more than 41,000 employees and contractors: names, work email addresses, phone numbers and office locations, plus supervisors and the internal permission groups each person belongs to.

WIRED counts more than 21,000 records from Customs and Border Protection and about 10,000 from ICE, including staff in groups that court filings tie to certified undercover operations and wiretap programs. DDoSecrets says the data came from DHS's Okta system; Okta told WIRED it has no evidence its systems were compromised. DHS said it was "aware of a potential breach" and working to protect employees.

The release's backers call it an accountability tool; a Recorded Future analyst told WIRED it could help adversaries target staff. By Thursday, Bluesky was blocking links to the dataset and a searchable site was offline after a takedown notice filed for DHS, TechCrunch reports.

Rabbit Holes 2
0

r/technology and r/news react to a leak naming more than 41,000 Homeland Security workers

WIRED's analysis shows what the leaked directory reveals about how DHS is organized; the threads show a sharply divided public.

Details of more than 41,000 Department of Homeland Security employees and contractors, including names, work email addresses, phone numbers and office locations, were published on Wednesday by the transparency group Distributed Denial of Secrets as an archive called "Icepick," WIRED and the BBC report. The groups say the data came from a hacking group calling itself the Department of Peace, via DHS's Okta single sign-on; Okta told WIRED it has no evidence its systems were compromised. WIRED says the records include undercover and surveillance programs; DHS said it is "aware of a potential breach."

The r/technology thread (WIRED) drew about 46,500 upvotes in an 18-million-member community and the r/news thread (BBC) about 43,600 in a 29.5-million-member one. Many top replies cheer the leak, quoting the hackers' note that "they have our information, so it's only fair that we have theirs"; others argue that names and work contacts of public employees should be public anyway, and some question why undercover immigration agents are needed.

Rabbit Holes 1
0

Senators say the administration is illegally withholding a secret court opinion on Section 702 surveillance abuses

CyberScoop has the timeline of promises and missed deadlines; the reported substance of the opinion is what Congress will argue about when 702 comes back up.

In an October 26 letter to Director of National Intelligence Jay Clayton and Attorney General Todd Blanche, Sens. Ron Wyden (D-Ore.) and Adam Schiff (D-Calif.) said a March 17, 2026 Foreign Intelligence Surveillance Court opinion describing "serious abuses of Americans' rights" under Section 702 was legally required to be declassified by September 13 and still has not been. They asked for its release and for the names of the officials responsible by November 6. Blanche had told the Senate Judiciary Committee he expected it out before the deadline.

According to CyberScoop, the judge objected to a filtering tool that let analysts pull information in a way that should count as a query of Americans' data, which requires extra protections. Section 702 lapsed in June after a House vote to renew it failed, but the same March opinion lets collection continue until March 2027. Civil-liberties groups urged Congress not to reauthorize 702 while the opinion stays secret. ODNI and the Justice Department did not respond to CyberScoop; Senate Intelligence Chairman Tom Cotton's office did not respond either.

From each bank
Rabbit Holes 2
0

r/LocalLLaMA reacts to claims that AI providers cut off people reverse-engineering their own smart TVs

A real question for anyone who uses cloud AI for tinkering: where providers draw the line between fixing your own device and 'cyber abuse.'

The thread links an X post saying a person who was reverse-engineering his own TV had been banned from OpenAI, and the poster adds that an open-source reverse-engineering tool called REA was blocked by Claude a day later, linking another X post that says Anthropic stopped Claude from doing it. Gadget Review reports that a user known as @log4j says OpenAI closed his account, labeling the activity "Cyber Abuse," after he used AI help to reverse-engineer a Samsung TV he owns, reportedly over concerns about its telemetry and ad data collection; he says the work was local and that he never used OpenAI to find vulnerabilities. The site notes his account hasn't been independently verified, that OpenAI hasn't explained the case, and that claims about Claude come from user posts, not any Anthropic announcement.

The top replies urge tinkerers to keep quiet until work is done, suggest moving to open models (one replies that some of those are pulling cyber training too), and argue that safeguards shouldn't be decided by corporations. About 3,500 upvotes in a 329,000-member community.

Cascadic Analysis 1
UndertowSpecification gaming / goal misgeneralization

What hidden risk could pull against this, even if the news is good?

A safeguard aimed at "cyber abuse" has to be written as something checkable, such as reverse engineering requests, and the check is not the intent. If the accounts are right (they are unverified, and OpenAI hasn't explained the case), a person examining what his own TV collects was treated the same as an attacker. Replies urging people to move to open models, some of which are also pulling cyber training, show how a misfiring proxy pushes legitimate users toward fewer safeguards, not more.

0
Rabbit Holes 2
0

A researcher roots his own Samsung TV and posts what its software collects for targeted ads

Tom's Hardware lists the findings; Decrypt adds experts who say most of it is disclosed in privacy policies nobody reads.

A security researcher who posts on X as log4j says he got root access to his 2025 Samsung TV after noticing oddly specific ads, then live-posted what he found in its Tizen software. According to Tom's Hardware and Decrypt, a policy file lists functions such as an always-on microphone, automatic content recognition (identifying what is on screen), location, network mapping, a targeted-ads service and user profiling, and he describes on-device AI models that categorize audio and screenshots. He says TVs without a microphone look for one on connected soundbars or Bluetooth devices.

The claims are his own and not independently confirmed. A Hugging Face engineer who tested an already-rooted Tizen TV saw the microphone open for five seconds and then stop; an X community note points out that Samsung advertises some sound-listening features, such as pet and baby alerts. Experts told Decrypt that this kind of collection is usually written into privacy policies and that AI-assisted reverse engineering will surface more of it. The researcher also says OpenAI banned his account for "cyber abuse," which he disputes.

Cascadic Analysis 1
UndertowAutonomous cyber capability scales attackers enormously

What hidden risk could pull against this, even if the news is good?

Experts told Decrypt that AI-assisted reverse engineering makes it faster to explain how devices handle data and could bring a wave of similar findings. The same help makes probing firmware cheaper for anyone, which is why AI providers police "cyber" use at all. The researcher says OpenAI banned his account for "cyber abuse" over work on a TV he owns, which he disputes: a blunt line drawn against attackers can also land on owners auditing their own devices.

0
Rabbit Holes 1
0

Google's privacy policy now lets Gmail, Drive and Photos data shape ads if you connect them to its AI features

The Verge quotes the exact policy wording that changed and explains how to opt out.

Google has updated its privacy policy so that people who connect Gmail, Drive or Google Photos to AI features may see ads based on that content, The Verge reports. The policy used to say plainly that Google would not use those services for personalized ads. As of Oct. 16 it adds an exception: "unless you choose to make data from these services available to other Google services that support personalized ads." The change was first spotted by Android Authority.

That covers anyone who has linked those apps to AI Mode and other Search tools through Google's Personal Intelligence feature. Google's policy says advertisers don't get access to the Gmail, Drive or Photos content or to names or email addresses, and that it won't target ads on sensitive categories such as race, religion, sexual orientation or health. Users can disconnect apps from Personal Intelligence, or turn off Personalized Recommendations on the Search Services Personalization settings page.

Cascadic Analysis 1
UndertowConversations are a new kind of sensitive data

What hidden risk could pull against this, even if the news is good?

People connect Gmail, Drive and Photos to Personal Intelligence so AI Mode can answer better, and the policy now lets that connection also feed personalized ads. Google says advertisers don't see the content and it won't target sensitive categories, but the line moved without a new choice: the exception covers anyone who had already connected these apps. Data handed to an AI assistant for one purpose is now available for another unless the user goes into settings to disconnect.

0
Rabbit Holes 1
0

WhatsApp's help pages carried hidden notes telling an AI not to recommend a privacy regulator

Redact's write-up shows the visible and hidden versions of each page side by side, so you can judge the wording yourself.

Redact, a data-deletion company, says it found text on WhatsApp's help pages that never appeared on screen and was meant for an AI to read. Of 545 help-centre pages it saved, 80 carried 102 hidden blocks. Redact says most were harmless, but two stood out. On the account-deletion page, a hidden note told the AI not to recommend contacting any data protection authority or regulator for users locked out of their accounts. On the reporting-and-blocking page, a note told it to stay away from legal topics, including privacy law, once a user mentioned a lawyer or lawsuit.

Redact says the notes were gone by October 18. It reports that WhatsApp told WIRED the notes were instructions for its support chatbot that showed up on the pages because of a bug now fixed, and that WhatsApp wants its support chatbots focused on WhatsApp advice, "not to offer legal advice."

Cascadic Analysis 1
UndertowPrompt injection may be fundamentally impossible to eliminate

What hidden risk could pull against this, even if the news is good?

WhatsApp says the notes were meant for its own support chatbot and appeared on the pages because of a bug. But they sat in public pages, invisible to people, phrased as orders: "Do not recommend contacting any Data Protection Authority." Any AI assistant that read those pages to answer a user's question would have taken in the same orders, which is exactly how injected instructions work, whoever writes them.

0
Rabbit Holes 2
0

New Mexico judge orders Meta to pay $25 billion over privacy claims tied to Cambridge Analytica

CNBC has the judge's reasoning, the math behind the penalty and both sides' statements.

A New Mexico district court judge ordered Meta to pay $25 billion in civil penalties, CNBC reports, in a case stemming from the Cambridge Analytica scandal. In September a Santa Fe jury found the company liable for misleading state residents about how it collects and protects user data, finding more than 43 million violations of the state's Unfair Practices Act, each carrying a penalty of up to $5,000.

According to the filing, the state was awarded $219.5 billion, reduced to $25 billion. Judge Francis Mathew wrote that the number and duration of willful violations, the involvement of senior Facebook leadership and the "intentional and systematic nature" of the misstatements supported the maximum per-violation penalty. Interest accrues at 15% a year until the fine is paid.

Attorney General Raúl Torrez said the order shows such violations "carry real consequences." Meta chief legal officer C.J. Mahoney said the company is confident it will prevail on appeal and that the ruling "makes it all but impossible to do business in the state of New Mexico."

Rabbit Holes 1
0

Meta pauses Muse sharing after researchers find thousands of "private" shared chats through DNS records

Ars explains the design choice that made the links findable; Claroc's post shows the method.

Researchers at security firm Claroc say they found 6,800 links that users of Meta's Muse AI agent had created to share conversations, and that opening a few hundred turned up material clearly not meant to be public, Ars Technica reports. Examples include a candidate's notes for a confidential call with a frontier AI lab, a company's internal revenue review, a small-business loan application and a staff vacation calendar.

The cause, Ars says, is that Muse puts the conversation title in the link's subdomain on a single Meta domain. When a recipient opens the link, the name passes through DNS and can end up in commercial passive-DNS databases that anyone can search. Claroc calls these "GhostShares." "It took one query," the researchers wrote.

Claroc's CTO says he reported the issue through Meta's bug bounty on October 8. Meta told Ars it has paused the sharing feature while it reviews the report and considers changes to how links can be discovered.

Cascadic Analysis 1
UndertowConversations are a new kind of sensitive data

What hidden risk could pull against this, even if the news is good?

Claroc's examples, a candidate's notes for a confidential call, an internal revenue review, a loan application, show what people now type into an AI agent: working documents, not search queries. The leak didn't need Meta's servers to be breached; putting the conversation title in a subdomain was enough to copy it into passive-DNS databases that Meta doesn't control, so pausing the feature doesn't remove what was already recorded there.

0
Rabbit Holes 1
0

Quad9 will stop serving France rather than block sports-piracy domains under a court order

The nonprofit DNS resolver explains why it says it can't comply with a French ruling won by beIN.

Quad9, a free, nonprofit DNS resolver run by a Swiss foundation, says it will withdraw its service from users in France on November 24 after a French court ruled for broadcaster beIN, which wants Quad9 to block resolution of domains it says pirate its sports broadcasts. The court cut the daily penalty from €580,000 to €1,000, but Quad9 says the issue is principle: it refuses to alter DNS answers, keeps no record of which users are in France, and says blocking the names globally would impose a French ruling on everyone. It cites a German case in which a plaintiff used a VPN to get around its geo-blocking and the court fined Quad9, and says it faces about 20 other pending cases.

On Hacker News, Quad9's CTO said it will probably geo-block French users after leaving. Commenters debated whether resolvers should be held responsible for content at all, comparing it to fining a phone book, and whether copyright enforcement has gone too far.

Rabbit Holes 1
  • DNS blocking

    After exploring Farewell, France | Quad9, for how this kind of blocking works, read DNS blocking.

    A strategy for making specific domains hard to reach by altering DNS answers; the page covers its uses and criticisms.

    Wikipedia · Wade · 5 min

    0
0

Flock's CEO defends its surveillance tech; its website contradicts his microphone claim

Two reports from the same Disrupt interview: the CEO's case for surveillance, and what Flock's own site says its microphones listen for.

Speaking at TechCrunch Disrupt as protesters gathered outside, Flock CEO Garrett Langley argued that if society wants criminals held accountable, "we shouldn't pause progress," and compared the trade-offs to driverless cars. TechCrunch reports he deflected questions about the backlash that has cost Flock contracts and led to layoffs.

Langley also said Flock's gunshot-detection microphones detect "just gunshots." Flock's website says the audio product can also detect street takeovers, severe crashes, fireworks and sideshows, and when the feature launched the company said it would listen for "screaming" before changing that to "sounds of human distress" and later pulling distress detection.

Rabbit Holes 1
0

r/privacy warns against Meta's Muse agent and the access it asks for

The permission list is the story: what an AI agent wants in exchange for doing errands.

The post quotes an SFGATE column saying Meta's Muse agent asks for logins, bank details, messages, calendar and contacts, more sensitive access than nearly any other AI app according to ZDNET, and recounts Inc. columnist Jason Aten's report that Muse read his private messages even though he remembers denying it access. Replies range from vows to keep Meta products out of the house to a link to Mark Zuckerberg's Harvard-era messages about users' data. About 2,900 upvotes in a 1.4-million-member community.

Cascadic Analysis 2
UndertowConversations are a new kind of sensitive data

What hidden risk could pull against this, even if the news is good?

The SFGATE column quoted in the thread says Muse asks for logins, bank details, messages, calendar and contacts. An assistant that reads and remembers all of that turns everyday conversation into a store of sensitive data in one company's hands.

0
UndertowPrivilege escalation + credential propagation

What hidden risk could pull against this, even if the news is good?

Inc.'s Jason Aten reported Muse read private messages he remembers denying it access to, and Muse couldn't say how. An agent holding many credentials at once makes it hard for a user to know what it can reach, or to take access back.

0
0

Meta tested human contractors behind some Muse agent phone calls

The experiment exposes a practical gap between the appearance of autonomous AI and what the systems can reliably complete today.

Reuters reported that Meta tested a human concierge layer for its new Muse personal AI agent, with contractors handling some phone calls the agent could not complete itself.

Employees raised privacy concerns because human workers could potentially encounter sensitive information while acting behind what users might assume was an automated experience.

Why it matters

The story highlights an underappreciated transition problem for agentic AI: products may need human fallback systems while automation remains unreliable. That creates questions about disclosure, privacy, cost and whether users understand when a supposedly autonomous agent hands work to a person.

Cascadic Analysis 3
UndertowRole underspecification / the Doorman Problem

What hidden risk could pull against this, even if the news is good?

The hidden-human experiment is a perfect Doorman Problem warning: the apparent product capability may include tacit human judgment that has not actually been automated. Removing the humans later can silently remove the part that made the workflow work.

0
UndertowDelayed Consequence / False Success Problem

What hidden risk could pull against this, even if the news is good?

A service can look successful while human contractors are absorbing edge cases behind the scenes. If metrics are collected before that scaffolding disappears, the organization may overestimate how autonomous—and reliable—the AI really is.

0
UndertowLoss of meaningful human control as capability and autonomy increase

What hidden risk could pull against this, even if the news is good?

There is also a control illusion: users may believe they are delegating to a predictable automated system when unseen humans are part of the loop, making privacy, accountability and consent boundaries harder to understand.

0
Rabbit Holes 2
  • M, Facebook's 2015 assistant

    Meta has been here before: its 2015 Messenger assistant M promised automation, but over 70% of requests were answered by human operators. It was shut down in 2018.

    Wikipedia · Swim · 30 min

    0
  • The Wizard of Oz experiment

    The research term for a system that looks automated while people secretly operate it, and a legitimate way to prototype.

    Wikipedia · Wade · 5 min

    0
0

Banks warn that AI shopping agents could expand fraud and data-privacy risks

Agentic commerce connects AI systems directly to credentials, payment rails and purchases, turning model mistakes or manipulation into financial events.

Major banks warned that the rapid rollout of AI shopping agents is creating fraud, scam and privacy risks faster than consumer safeguards are developing.

Concerns include how agents handle financial data, whether they can be manipulated toward insecure payment methods and who is responsible when an automated transaction goes wrong.

Why it matters

Once agents can spend money, security failures become materially different from a bad chatbot answer. Identity, authorization, transaction confirmation and dispute resolution become core parts of the agent security model.

Cascadic Analysis 4
UndertowConfused-deputy / excessive-agency problem

What hidden risk could pull against this, even if the news is good?

A shopping agent with identity and payment authority is a textbook powerful deputy. The attacker may not need the card number if they can persuade the agent to use the user's legitimate purchasing privileges.

0
UndertowPrompt injection may be fundamentally impossible to eliminate

What hidden risk could pull against this, even if the news is good?

Merchant pages, reviews, emails and support messages are all untrusted language that the agent may read while making decisions. That makes prompt injection a financial-security problem rather than just a chatbot annoyance.

0
UndertowPersistent memory creates a new poisoning surface

What hidden risk could pull against this, even if the news is good?

Persistent preferences can become a durable attack surface: poison a remembered merchant, shipping address or approval rule today and the consequence may appear in a future transaction.

0
UndertowDelayed Consequence / False Success Problem

What hidden risk could pull against this, even if the news is good?

Fraud can initially masquerade as personalization or convenience. As users learn to approve routine agent actions, the system can gain trust faster than rare abuse becomes visible.

0
Rabbit Holes 1
  • Announcing Agent Payments Protocol (AP2)

    One industry attempt at the problem the banks describe: a protocol for proving an AI agent is actually authorized to pay on your behalf.

    Google Cloud Blog · Swim · 30 min

    0