By Nargiza Noimann Zander, Founder, X Technology
LinkedIn: Nargiza Noimann Zander
LinkedIn: X Technology
Digital mental health dashboards often lead with reassuring numbers: registrations, logins, active days, session completion and time spent. These measures matter. They show whether people can reach a service and whether the technology is being used. They do not, by themselves, show whether a patient is improving, struggling or receiving the right follow up.
The distinction is easy to lose because engagement is measurable in real time, while clinical change is slower and harder to interpret. A patient may complete every module without meaningful improvement. Another may use a tool briefly, learn what was needed and move on. A third may stop because the content felt irrelevant, inaccessible or distressing. The same dashboard event can represent very different clinical realities.
Engagement Is Useful, but It Is Not an Outcome
A systematic review and meta analysis of digital mental health interventions found that greater engagement was associated with better mental health outcomes, but the relationship was modest and individual studies produced mixed results. The researchers also noted that module completion appeared more informative than measures such as logins, time spent or online interactions. Engagement therefore offers a signal, not a clinical verdict.
Build the Dashboard in Four Layers
The first layer is access. Providers should know who was referred, who activated the service, how long it took to begin and whether language, disability, connectivity or device requirements created barriers. A high completion rate among a narrow group can conceal poor reach across the wider patient population.
The second layer is engagement. Active days, content viewed, sessions completed and use of human support can help teams understand how the intervention is being used. These measures should be interpreted by pathway and patient group, not combined into a single score that labels people as motivated or unmotivated.
The third layer is patient response. This includes validated symptom check ins, perceived value, comfort, burden and reasons for stopping. For immersive interventions, completion data should sit beside reports of nausea, disorientation, anxiety or detachment. A systematic review of adverse effects in therapeutic virtual and augmented reality found that safety reporting remains inconsistent. If discomfort is recorded only as an abandoned session, an important part of the care experience disappears.
The fourth layer is clinical impact. Providers need to see change in symptoms and daily functioning, whether a clinician reviewed the information, and what action followed. AHRQ guidance on integrating patient reported outcomes into practice emphasizes their value for shared decision making while also recognizing the workflow and EHR challenges involved. Collecting a score is not enough. Someone must understand it, discuss it when appropriate and act on it.
Connect Measurement to Responsibility
These four layers should remain distinct but connected. Leaders should be able to trace a patient journey from referral to use, from use to response, and from response to clinical action. Missing data also need an explicit meaning. Silence may reflect recovery, disengagement, technical failure or worsening symptoms. A dashboard should not guess which explanation is correct.
Before procurement or renewal, health systems should ask what each metric means, which outcomes are measured, how nonresponse is handled, where adverse responses appear and who is responsible for review. Vendors can supply data, but providers must define the decisions those data are allowed to support.
The denominator and time window also matter. A 70 percent completion rate means something different when calculated from registered users, patients who began the first session or everyone referred. Outcome change should be shown against a clear baseline, while missing patient reported data should remain visible rather than being silently excluded. At program level, teams can compare access, response and outcomes across patient groups to identify uneven performance. At patient level, only clinically relevant information should trigger review, with a named person or team responsible for deciding what happens next.
Digital mental health programs should be judged by whether they expand access and contribute to appropriate care. Engagement is part of that assessment, but it should never be asked to carry the full weight of clinical success.