MediaPipe pose (33 landmarks) + voice, processed on-device. This debug view never leaves the home.
rolling 10 s window
Frequency measured live from tracked-landmark displacement (FFT, 2–8 Hz). Amplitude is a scale-relative estimate vs her own baseline — not clinic UPDRS scoring.
The camera watches movement, the mic listens to speech — the two symptom domains a doctor titrates against.
Why it matters: these rise and fall with every dose — they are the ON/OFF state a doctor is tuning.
Why it matters: voice change is one of the earliest, most sensitive signs — often before movement declines.
Two real single-speaker recordings — a person with Parkinson's and a healthy speaker. Press play: the flat, monotone voice is audible before it's measured. Red bands mark monotone stretches.
The blue line is the pitch (melody). The healthy speaker's sweeps up and down across more than an octave (15 semitones); the patient's stays inside 7 — a flat, monotone voice (red bands). He even says it himself. Reduced melodic range (monotone) is among the earliest, most sensitive signs in Parkinson's — captured from a passive mic, no extra hardware. Analysis illustrative; the clinician decides.