You've seen the dashboards. Utilization up 40% year over year. Member satisfaction scores hovering around 92%. Cost-per-visit trending down. The ROI spreadsheet looks like a work of art. But there's a problem nobody in the benefits world is talking about: we're measuring the wrong thing.
The entire industry evaluates telehealth based on isolated episodes - a single 15-minute video visit, a quick prescription, a satisfied member. We treat these transactions as wins. We miss the bigger picture entirely. Let me show you what your data is hiding.
The Ghost Chart problem
In traditional primary care, your doctor sees the whole person. They know your A1c is creeping up, you missed your mammogram, and you recently lost your job. They connect the dots. Now consider a typical telehealth encounter:
A member logs on for a sinus infection. The provider prescribes an antibiotic in eight minutes. The member rates the experience five stars. The health plan saves $50 compared to an urgent care visit. What did we miss?
- Was that sinus infection a side effect of a new immunosuppressant prescribed by a specialist last week?
- Is this the third upper-respiratory visit in six months - signaling undiagnosed sleep apnea or diabetes?
- Did the member mention anxiety in passing, but the visit was coded as acute sinusitis?
The ghost chart is the patient's real medical history - the one that lives on the PCP's EMR, the specialist's system, and the pharmacy database. It never touches the telehealth platform. When we evaluate telehealth effectiveness solely on the episode, we celebrate the transaction while ignoring the fragmentation.
Cost avoidance vs. cost attribution
Here's where it gets messy. The standard ROI model for telehealth assumes that avoiding one ED visit is a net positive. But what about the downstream costs of poor coordination? Let me walk you through a real scenario:
- Telehealth visit: Member uses a vendor for a sore throat. Prescribed steroids.
- Result: Steroids spike blood glucose.
- Outcome: Member - a diabetic - ends up in the ER for hyperglycemia two weeks later.
- Accounting: The ER visit is charged to the medical bucket.
- The reality: The telehealth vendor's report shows a "successful diversion." The medical carrier sees a $5,000 ER claim. No one connects the dots.
From a systems architecture perspective, the health plan is paying for a telemedicine solution that is functionally independent from its care management and disease management platforms. Until the data flows in a closed loop, we're not evaluating telehealth effectiveness. We're evaluating digital triage effectiveness - a much lower bar.
A new framework: The 3-Point Integration Score
To truly evaluate a telehealth solution, stop looking at the vendor's dashboard. Start looking at your own claims data and member behavior after the visit. Stop asking: "Did the member get treated fast?" Start asking these three questions instead.
1. The Care Disruption Rate
What it is: The percentage of telehealth visits that resulted in a break in continuity of care - a canceled PCP visit, a medication change that contradicted a chronic care plan, or a failure to follow up on a specialist referral.
Why it matters: If a telehealth visit prevents a diabetic from seeing their PCP for a routine check-up, you've increased long-term risk, even if you saved $50 that day.
What to look for: Can the vendor schedule a follow-up within the member's medical home? Or do they create an isolated, disconnected chart?
2. The Diagnostic Churn Rate
What it is: The rate at which a telehealth visit leads to a new misdiagnosis or a redundant test or visit within 30 days.
Why it matters: Classic example - prescribing a Z-Pak for a viral infection. The member feels worse in three days, sees their PCP, gets the correct diagnosis, and incurs a new copay. The system paid twice.
What to look for: A high diagnostic churn rate means the vendor is prioritizing "member satisfaction scripts" over clinical accuracy - and that hurts your medical loss ratio.
3. The Data Return on Investment
What it is: Does the vendor push structured data (not a PDF) back into your health plan's core health information exchange or care management platform? Or do they hoard it?
Why it matters: A vendor that refuses to provide a Continuity of Care Document or HL7 feed is creating a silo. Your wellness coach, your disease management nurse, your analytics team - none of them can see what happened in that visit.
What to look for: The vendor is generating intelligence about your population. If that intelligence stays locked in their platform, they are stealing data from your population health strategy.
What to ask in your next QBR
Stop accepting the standard dashboard. Here's what to demand:
- "Show me the percentage of visits that resulted in a closed-loop referral to a PCP in our network."
- "Show me the specific diagnosis code for the visit and the pharmacy claim generated. Now show me if that same member has a primary care relationship. Did the PCP agree with the treatment?"
- "What is your data integration protocol with our claims administrator? Can your platform update a member's risk profile in real time - or does it sit in a separate data lake?"
The bottom line
Telehealth is not a destination. It's a gateway. We've been evaluating the paint color and the welcome mat, while ignoring that the house is on fire in the other room.
The most effective telehealth provider is not the one with the fastest connection. It's the one that disappears into the broader benefits ecosystem - leaving behind a fully coordinated, documented member journey.
Evaluate that. You'll see the real ROI.