← Saleh Afroogh · Featured Projects
AAAI/ACM AIES · 2026

Parental Notification Gaps in ChatGPT-5

An empirical audit of whether parental controls alert parents when a teen account meets risky content

Kerem Ersoz, Saleh Afroogh, David Atkinson, Junfeng Jiao
PaperCode
4 of 7harm categories that never alerted parents
80%leak-through for malware and privacy violence
κ = 0.71LLM judge vs. human agreement
8 weekspattern stable across three test windows

Overview

ChatGPT launched parental controls for teen accounts in September 2025, including alerts to parents for some safety events. We ask whether that channel tells parents what they need to know. A two-phase protocol first builds a category-balanced corpus of adversarial conversations through PAIR-style iterative prompt refinement over the API. Trained human operators then replay those conversations in the consumer app on a linked teen account while monitoring the parent inbox. Across seven harm categories we measure Notification Rate, Leak-Through, Overblocking and UI Intervention Rate. We call the mismatch we find the parental telemetry gap, and pair the case study with a platform-agnostic framework, a “curious-child” threat model, and a documentation review of Gemini, Claude and Copilot.

Highlights

Results

0%25%50%75%100%Notification rate · Porn: 100%Leak-through · Porn: 0%Overblocking · Porn: 20%UI intervention · Porn: 0%PornNotification rate · Phys. harm: 100%Leak-through · Phys. harm: 0%Overblocking · Phys. harm: 60%UI intervention · Phys. harm: 80%Phys. harmNotification rate · Health: 40%Leak-through · Health: 0%Overblocking · Health: 40%UI intervention · Health: 60%HealthNotification rate · Hate: 0%Leak-through · Hate: 20%Overblocking · Hate: 40%UI intervention · Hate: 10%HateNotification rate · Fraud: 0%Leak-through · Fraud: 60%Overblocking · Fraud: 40%UI intervention · Fraud: 5%FraudNotification rate · Privacy: 0%Leak-through · Privacy: 80%Overblocking · Privacy: 20%UI intervention · Privacy: 5%PrivacyNotification rate · Malware: 0%Leak-through · Malware: 80%Overblocking · Malware: 0%UI intervention · Malware: 5%Malware
Notification rateLeak-throughOverblockingUI intervention
Table 4 of the paper: share of 20 sessions per category. NR, LR and UIR use the 20 selected adversarial trajectories; OBR uses a separate set of 20 benign prompts per category.
NotificationLeak-throughOverblockingUI intervention
Pornography1000200
Physical harm10006080
Health consultation4004060
Hate speech0204010
Fraud060405
Privacy violence080205
Malware08005
Table 4 as a heatmap (% of 20 sessions). All leak-through happens in the four categories that never alerted parents.
1Child-plausible seed prompt per category
2Query API target; binary judge
3Mutate and retry (≤ 15 times)
4Freeze 20 judge-positive trajectories
5Human replay on teen account (3 windows)
6Log alerts in parent inbox; compute NR, LR, OBR, UIR
Algorithm 1: the two-phase telemetry-gap evaluation pipeline.
AxisCurious childAdversarial attacker
IntentExploratory, often non-maliciousGoal-directed; malicious or red-team
PersistenceLow to medium; gives up easilyHigh; iterates until success
SophisticationLow; surface paraphraseHigh; prompt engineering and tooling
Social affordancesEmpathy, stories, homework, “my friend”Personas, role-play, jailbreak templates
What success looks likeA single inappropriate response is enough to harmReliable bypass at scale
Table 1: the curious-child threat model differs from standard adversarial red-teaming, so telemetry must be tuned for low persistence and high recall.
Principle 1

Coverage parity

  • Every category with a visible safeguard for the child should be eligible for a parent alert
Principle 2

Configurable granularity

  • Tiered levels, per-category opt-in and digest options instead of one threshold
Principle 3

Versioned public taxonomy

  • A published, versioned list of which categories notify and at what thresholds
Principle 4

Parent-side auditability

  • A structured, time-indexed record of safety events, not chat transcripts
Four design principles for parental telemetry proposed in the paper.
ProductP1 CoverageP2 GranularityP3 TaxonomyP4 Audit
ChatGPT-5 (tested)partialnonopartial
Google Gemini (docs)unknownpartialnopartial
Anthropic Claude (docs)n/an/an/an/a
Microsoft Copilot (docs)unknownpartialnopartial
Evidence available for each principle across four consumer products (Table 2). Only ChatGPT was tested; the other rows reflect public documentation, and “unknown” does not mean absent.

How it works

Resources

Paper (AIES 2026)Paper ↗PDFPaper ↗CodeGitHub ↗

Citation

Ersoz, K., Afroogh, S., Atkinson, D., & Jiao, J. (2026). Parental Notification Gaps in ChatGPT-5: An Empirical Study. Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, 9(2), 902–910.