LeakyLM: AI Assistants Are Leaking Your Conversations
Generative AI systems are increasingly adopted, raising privacy concerns as users often share sensitive information. This trend is evident in various sectors, including personal, professional, and educational contexts. The risks are heightened by the potential for LLMs to infer user attributes and the sharing of conversation data with third parties.
- ▪32.7% of the EU population used generative AI in 2025, primarily for personal purposes.
- ▪Sensitive information is often disclosed to LLMs, including personal and health-related data.
- ▪Samsung banned ChatGPT usage internally after sensitive information was leaked by employees.
Opening excerpt (first ~120 words) tap to expand
Privacy Impact: Why does it matter? Generative AI systems are rapidly reaching mass adoption. According to Eurostat, 32.7% of the EU population (ages 16–74) used generative AI in 2025, primarily for personal purposes (25.1%), but also for work (15.1%), covering all sorts of professionals, and education (9.4%). User conversations frequently contain sensitive information as users often perceive LLMs as trusted assistants. This perception increases the likelihood of oversharing sensitive information. Prior research shows that PII is disclosed to LLMs in unexpected contexts, including sexual preferences, mental support or health conditions, which carries significant privacy risks. These privacy threats are aggravated by LLMs' ability to infer user attributes.
…
Excerpt limited to ~120 words for fair-use compliance. The full article is at Github.
