Got OpenAI's privacy filter model running on-device via ExecuTorch

Been experimenting with running OpenAI's privacy filter model on mobile through ExecuTorch. Sharing in case it's useful to others working on similar problems. Setup: - Runtime: ExecuTorch - Memory footprint: ~600 MB RAM - Bridge: react-native-executorch The model handles arbitrary text — emails, documents, chat logs, pasted notes, transcripts — and flags sensitive content reasonably well across all of them. Quality holds up better than I expected; it catches the kinds of PII and sensitive materi

More from Reddit

Luce DFlash: Qwen3.6-27B at up to 2x throughput on a single RTX 3090

Reddit

GBNF grammar tweak for faster Qwen3.6 35B-A3B and Qwen3.6 27B

Reddit

Tissue regeneration moves closer to reality with lab-grown bone, muscle, and cartilage

Reddit

AI bill would crack down on deepfake distribution and protect whistleblowers

Reddit

India’s power demand hits record as heat wave batters nation

Reddit

How to run a local coding agent with Gemma 4 and Pi | Patrick Loeber

Reddit