What AI Gets Right and Wrong About Mental Health

AI Watches Your Phone So Cancer Survivors Don't Suffer in Silence

Cancer survivors are least likely to reach out for mental health help exactly when they need it most — so what if the phone just noticed on its own?

Imagine a friend who quietly watches how much you've been walking, whether your phone screen stays dark all day, how little you've been messaging people — and then flags to your care team that something might be wrong, without you having to say a word. That's the basic idea behind PULSE, a system built by researchers on a dataset of 50 cancer survivors. The problem they set out to solve is called the diary paradox. Patients are asked to log their feelings regularly. But when someone is anxious, exhausted, or in distress — precisely the moments clinicians want to know about — they're the least likely to fill in a form. So the logs go blank right when they matter most. PULSE sidesteps this by passively reading smartphone data: how much you move, where you go, how long your screen stays on, how many messages you send. It then sends that data to an AI agent — not a simple script, but a reasoning system that can ask follow-up questions of the data, like a detective, before deciding whether to flag a concern. The result: the system predicted whether a survivor wanted help managing their emotions with 74.3% balanced accuracy. That's a real improvement over earlier approaches, which hovered around 52–60%. The catch is size. Fifty participants is a starting point, not a verdict. All were cancer survivors — this may not translate to other groups. And the system still takes about 45 seconds per check, which matters in clinical settings. This is a proof of concept with genuine promise, not something your oncologist will use next year.

AI Misses Anxiety When You Say You're Coping Fine

You describe classic anxiety symptoms to an AI screener — and it says you're fine, because you also mentioned you go to the gym.

A team of researchers tested five AI language models — including LLaMA 3, DeepSeek, GPT-4o Mini, GPT-4.1 Mini, and GPT-5 Mini — on 555 real psychiatric interview transcripts. Each transcript had been clinically diagnosed using a structured gold-standard tool called the SCID. The question: can these models correctly identify anxiety, depression, and PTSD from what people say? The short answer is: sometimes. Accuracy ranged wildly, from 0.49 — barely better than a coin flip — to 0.86 depending on the model and the diagnosis. GPT-4.1 Mini and GPT-5 Mini performed most consistently across disorders. But here's the finding that stopped me. When researchers examined the cases the AI got wrong — specifically the missed diagnoses — a pattern emerged. Many of those transcripts contained clear symptom descriptions. The person had explicitly described hypervigilance, avoidance, sleep disruption. The AI read all of it. And then it decided the person was probably fine. Why? Because the person also mentioned they had a support network, or strong coping habits, or were still functioning at work. Think of it like a doctor who hears you describe chest pain, shortness of breath, and fatigue — but then focuses so heavily on the fact that you walked to the appointment that they send you home. Protective factors are real and matter. But they don't cancel symptoms. The catch: this was zero-shot testing — the most basic way to use these models, with no task-specific tuning. The results might improve significantly with better prompting. There was also a gender bias: depression was identified more accurately in men than women. Nobody fully understands that yet.

A Smartwatch Helped Veterans Manage PTSD Symptoms During a Cycling Event

Thirteen veterans, a long-distance cycling race, and a smartwatch trying to catch a PTSD symptom before it escalates.

Here's what hyperarousal looks like from the outside: a veteran gets startled by a backfire, their heart rate spikes, their muscles tense, and they're back in a place they've been trying to leave. It can happen in seconds. By the time they notice it consciously, the body is already running. A research team built a smartwatch system that tries to detect this before the person does — monitoring heart rate and movement together to spot the physiological signature of a hyperarousal event in real time. They then ran a small randomised trial during Project Hero, a real endurance cycling event for veterans. Seven veterans wore the wearable; three did the cycling without it; four stayed home as a comparison group. The wearable group showed more stable symptom trajectories over the study period. Both cycling groups had a noticeable improvement during the event itself — endurance exercise reliably does that — but the wearable group held onto more of those gains afterward. Veterans in the at-home group gradually declined. Qualitatively, participants said the real-time alerts increased their awareness and brought a kind of mindfulness to what their body was doing. Several also said they wished the watch had offered something more after the alert — guidance, a breathing cue, anything. Right now it just flags. I have to be straight with you: thirteen people across three groups is a pilot in the purest sense of the word. No finding here can be generalised. What it shows is enough to justify a proper trial — and that the wearable was usable in a demanding real-world setting. That's actually the meaningful result.

Step back and look at what these three papers are collectively doing. They're all trying to solve the same underlying problem: the gap between when someone is struggling and when help actually arrives. That gap exists because people don't always report distress — they're too sick, too proud, too unaware of what their body is doing. So researchers are trying to make the environment do the reporting instead: passive phone sensors, real-time wearables, AI reading interview transcripts. But all three papers hit the same wall from different angles. The AI screener misses the person who says they're coping. The wearable detects the spike but doesn't know what to do next. The phone sensor is clever but tested on fifty people. The technology is not the bottleneck anymore — the question is whether the data is big enough, honest enough, and fair enough to actually deploy. Right now, the honest answer is: not yet, but the direction is clearly right.

The PULSE team deferred statistical details to future publications, so watch for a follow-up paper with larger sample sizes and pre-registered methods — that's where the real test will happen. On the wearable PTSD side, the next meaningful step is a trial with enough participants to actually detect an effect — somewhere north of 100 per group. The open question I'd most want answered: when the watch fires an alert and the veteran is mid-ride, what happens next? A flag without a response is half a system.

• Wikipedia: Post-traumatic stress disorder — solid background on PTSD diagnosis and treatment landscape
• Wikipedia: Passive sensing in mental health research
• Wikipedia: Federated learning — useful context for understanding AI privacy trade-offs in health data