Rates of Attrition and Dropout in App-Based Interventions for Chronic DiseaseSystematic Review and Meta-Analysis

Gideon Meyerowitz‐Katz, Sumathy Ravi, Leonard Arnolda, Xiaoqi Feng, Glen Maberly, Thomas Astell‐BurtView original
OverviewBalancedalloy voice
Chronic disease is one of the defining health challenges of our time. The prevalence of diabetes nearly doubled from under five percent in the 1990s to more than eight percent today, and the economic and social costs keep climbing. So when smartphones arrived and researchers started showing that app-based interventions could improve clinical markers, such as weight, glycated hemoglobin, and medication adherence, the excitement was understandable. Here was a tool that could sit in a patient's pocket, nudge them toward better choices, and scale to millions of people at minimal cost. The promise was real. The problem is that most people stop using these apps. Not gradually, not reluctantly — they just quit. Meyerowitz-Katz and colleagues, in their systematic review and meta-analysis, flag that prior work found as many as ninety-eight percent of users engaged with an app only briefly before dropping out or reducing use to a level unlikely to help manage their disease. That number is striking enough to demand a harder look. Their study set out to do exactly that: quantify how bad the dropout problem really is across clinical trials and real-world studies, and synthesize what the literature tells us about why people leave. To build that evidence base, the team searched MEDLINE, PubMed, Cochrane CENTRAL, and Embase from two thousand three, roughly when smartphones emerged, through June two thousand nineteen. They required studies to involve adults, address a chronic disease, use a mobile app as the intervention, and actually report some measure of dropout or attrition. That last criterion turned out to be surprisingly restrictive. The initial search returned one thousand four hundred twenty articles. After removing duplicates and screening, thirty-six went to full review. Nineteen were excluded for covering children, acute illness, or non-app platforms, or simply for failing to report extractable dropout data. That left seventeen studies in the final analysis. Nine were randomized controlled trials, and eight were observational studies, with participant numbers ranging from twenty to nearly two hundred thousand. Now for the headline finding: the pooled dropout rate across all seventeen studies was forty-three percent, with a ninety-five percent confidence interval running from twenty-nine to fifty-seven percent. Nearly half of patients, on average, stopped using the apps before the intervention was complete. That is a striking number on its own. But the breakdown between study types tells you something even more important. Randomized controlled trials showed a dropout rate of forty percent. Observational studies, which capture real-world use without researcher reminders, check-ins, or incentives, showed forty-nine percent. The gap makes sense once you think about it: in a clinical trial, you have a team actively trying to keep people engaged. In the real world, you just have the app. And the real world wins, which is to say it loses. There is also a statistical caveat the authors are honest about. Heterogeneity — the degree to which the studies varied from each other — was extraordinarily high, with an I-squared statistic above ninety-nine percent. That means the pooled estimate of forty-three percent is better understood as a floor than a precise figure. The true range is wide. One observational trial found that only two percent of users had sustained continuous engagement. Some short clinical trials reported retention above seventy percent. What this heterogeneity reflects is a field that hasn't yet agreed on what dropout even means. A single app login counted as non-dropout in one trial would be treated as disengagement in another. The field needs agreed standards. Importantly, the analysis also found that follow-up duration did not predict dropout rates — people weren't simply losing interest over time in a predictable way. Attrition was happening fast and staying high, regardless of how long the study ran. So the numbers tell us there is a serious problem. But numbers don't explain why people quit. The qualitative synthesis in the review gets at that, and it pushes back on some common assumptions in digital health design. The honest starting point is that most of the included studies simply didn't ask why people stopped. More than thirty studies that initially met inclusion criteria failed to report dropout in any extractable form. The field has largely been counting bodies out the door without asking where they went. Where reasons were examined, a few consistent themes emerged. Usability mattered. When users found apps difficult to navigate or couldn't connect through the app to a real health professional, they left. When feedback was solicited and used to improve the interface, engagement improved. The lesson is straightforward: a hard-to-use app doesn't get used. Perceived benefit was another driver. People who saw their health improving were more likely to continue. Interestingly, people who perceived their own health as poor were also more motivated to stay, because they felt urgency. The group most likely to disengage was in the middle — those who weren't in crisis but weren't seeing clear gains either. That's a large portion of the chronic disease population. Life disruption and competing demands also appeared. People managing multiple interventions simultaneously were more likely to persist, perhaps because they were more generally committed to their health. Conversely, shifts in illness severity, life circumstances, or simply running out of motivation pushed people away. There is an equity dimension here too. The review links sustained app use to higher health literacy, younger age, and postgraduate education. Younger participants dropped out less. More educated participants dropped out less. That creates a troubling pattern: apps may work best for people who are already better positioned to manage their health, and worst for the populations who most need additional support. Tailored messaging is often proposed as the fix — personalizing the content to keep people engaged. The evidence here is cautious. Tailored messages may have the potential to improve adherence, as the review puts it, but tailoring alone doesn't address the more fundamental problems: poor usability, lack of perceived progress, absence of human connection, and real-life disruption. Designing around behavioral theory and integrating pathways to actual clinical support appear to matter more. The review closes with a charge for the field, and it has three parts. First, the measurement problem. Underreporting of dropout is rampant — more than thirty eligible studies couldn't be included because they simply didn't report attrition in a usable way. That has to change. Second, the definition problem. Studies use incompatible definitions of dropout, making comparisons nearly meaningless. Third, the granularity problem. The included studies were so heterogeneous that disease-specific estimates weren't possible. As the literature grows, future analyses should break down dropout by disease state — diabetes, hypertension, heart disease — because the dynamics are likely different across conditions. What should you walk away with? App-based interventions for chronic disease face a dropout crisis, and it is not a fringe problem — it's the median experience. A forty-three percent pooled dropout rate, with real-world conditions likely pushing that higher, means that close to half of patients in these programs disengage before the intervention has a chance to work. The apps that retain people tend to be usable, connect users to clinical support, and deliver perceptible benefit. The apps that don't, which is most of them, lose people quickly and disproportionately from the populations with the greatest need. Meyerowitz-Katz and colleagues are not arguing that app-based interventions are worthless. The clinical evidence for their potential is real. But the gap between what apps could do and what they actually deliver in practice is enormous, and that gap is largely made of people who quit. Until the field takes dropout seriously — measuring it consistently, studying it qualitatively, and designing against it from the start — the promise of digital health will remain, for most patients, just that: a promise. This lecture was created by ennepō. Go to https://ennepo.ai to Discover, Create and Follow the latest research in your field. Read when you can. Listen when you want to.

Chronic disease is one of the defining health challenges of our time. The prevalence of diabetes nearly doubled from under five percent in the 1990s to more than eight percent today, and the economic and social costs keep climbing. So when smartphones arrived and researchers started showing that app-based interventions could improve clinical markers, such as weight, glycated hemoglobin, and medication adherence, the excitement was understandable.

Here was a tool that could sit in a patient's pocket, nudge them toward better choices, and scale to millions of people at minimal cost. The promise was real.

The problem is that most people stop using these apps. Not gradually, not reluctantly — they just quit. Meyerowitz-Katz and colleagues, in their systematic review and meta-analysis, flag that prior work found as many as ninety-eight percent of users engaged with an app only briefly before dropping out or reducing use to a level unlikely to help manage their disease.

That number is striking enough to demand a harder look. Their study set out to do exactly that: quantify how bad the dropout problem really is across clinical trials and real-world studies, and synthesize what the literature tells us about why people leave.

To build that evidence base, the team searched MEDLINE, PubMed, Cochrane CENTRAL, and Embase from two thousand three, roughly when smartphones emerged, through June two thousand nineteen. They required studies to involve adults, address a chronic disease, use a mobile app as the intervention, and actually report some measure of dropout or attrition. That last criterion turned out to be surprisingly restrictive.

The initial search returned one thousand four hundred twenty articles. After removing duplicates and screening, thirty-six went to full review. Nineteen were excluded for covering children, acute illness, or non-app platforms, or simply for failing to report extractable dropout data.

That left seventeen studies in the final analysis. Nine were randomized controlled trials, and eight were observational studies, with participant numbers ranging from twenty to nearly two hundred thousand.

Now for the headline finding: the pooled dropout rate across all seventeen studies was forty-three percent, with a ninety-five percent confidence interval running from twenty-nine to fifty-seven percent. Nearly half of patients, on average, stopped using the apps before the intervention was complete. That is a striking number on its own.

But the breakdown between study types tells you something even more important. Randomized controlled trials showed a dropout rate of forty percent. Observational studies, which capture real-world use without researcher reminders, check-ins, or incentives, showed forty-nine percent.

The gap makes sense once you think about it: in a clinical trial, you have a team actively trying to keep people engaged. In the real world, you just have the app. And the real world wins, which is to say it loses.

There is also a statistical caveat the authors are honest about. Heterogeneity — the degree to which the studies varied from each other — was extraordinarily high, with an I-squared statistic above ninety-nine percent. That means the pooled estimate of forty-three percent is better understood as a floor than a precise figure.

The true range is wide. One observational trial found that only two percent of users had sustained continuous engagement. Some short clinical trials reported retention above seventy percent.

What this heterogeneity reflects is a field that hasn't yet agreed on what dropout even means. A single app login counted as non-dropout in one trial would be treated as disengagement in another. The field needs agreed standards.

Importantly, the analysis also found that follow-up duration did not predict dropout rates — people weren't simply losing interest over time in a predictable way. Attrition was happening fast and staying high, regardless of how long the study ran.

So the numbers tell us there is a serious problem. But numbers don't explain why people quit. The qualitative synthesis in the review gets at that, and it pushes back on some common assumptions in digital health design.

The honest starting point is that most of the included studies simply didn't ask why people stopped. More than thirty studies that initially met inclusion criteria failed to report dropout in any extractable form. The field has largely been counting bodies out the door without asking where they went.

Where reasons were examined, a few consistent themes emerged. Usability mattered. When users found apps difficult to navigate or couldn't connect through the app to a real health professional, they left.

When feedback was solicited and used to improve the interface, engagement improved. The lesson is straightforward: a hard-to-use app doesn't get used. Perceived benefit was another driver.

People who saw their health improving were more likely to continue. Interestingly, people who perceived their own health as poor were also more motivated to stay, because they felt urgency. The group most likely to disengage was in the middle — those who weren't in crisis but weren't seeing clear gains either. That's a large portion of the chronic disease population.

Life disruption and competing demands also appeared. People managing multiple interventions simultaneously were more likely to persist, perhaps because they were more generally committed to their health. Conversely, shifts in illness severity, life circumstances, or simply running out of motivation pushed people away.

There is an equity dimension here too. The review links sustained app use to higher health literacy, younger age, and postgraduate education. Younger participants dropped out less.

More educated participants dropped out less. That creates a troubling pattern: apps may work best for people who are already better positioned to manage their health, and worst for the populations who most need additional support.

Tailored messaging is often proposed as the fix — personalizing the content to keep people engaged. The evidence here is cautious. Tailored messages may have the potential to improve adherence, as the review puts it, but tailoring alone doesn't address the more fundamental problems: poor usability, lack of perceived progress, absence of human connection, and real-life disruption.

Designing around behavioral theory and integrating pathways to actual clinical support appear to matter more.

The review closes with a charge for the field, and it has three parts. First, the measurement problem. Underreporting of dropout is rampant — more than thirty eligible studies couldn't be included because they simply didn't report attrition in a usable way.

That has to change. Second, the definition problem. Studies use incompatible definitions of dropout, making comparisons nearly meaningless.

Third, the granularity problem. The included studies were so heterogeneous that disease-specific estimates weren't possible. As the literature grows, future analyses should break down dropout by disease state — diabetes, hypertension, heart disease — because the dynamics are likely different across conditions.

What should you walk away with? App-based interventions for chronic disease face a dropout crisis, and it is not a fringe problem — it's the median experience. A forty-three percent pooled dropout rate, with real-world conditions likely pushing that higher, means that close to half of patients in these programs disengage before the intervention has a chance to work.

The apps that retain people tend to be usable, connect users to clinical support, and deliver perceptible benefit. The apps that don't, which is most of them, lose people quickly and disproportionately from the populations with the greatest need.

Meyerowitz-Katz and colleagues are not arguing that app-based interventions are worthless. The clinical evidence for their potential is real. But the gap between what apps could do and what they actually deliver in practice is enormous, and that gap is largely made of people who quit.

Until the field takes dropout seriously — measuring it consistently, studying it qualitatively, and designing against it from the start — the promise of digital health will remain, for most patients, just that: a promise.

This lecture was created by ennepō.

Go to https://ennepo.ai to Discover, Create and Follow the latest research in your field.

Read when you can. Listen when you want to.

More in Health Professions