Efficacy vs Real-World Effectiveness

Two words that sound alike

Efficacy and effectiveness are easy to mix up, and health marketing often blurs them. Efficacy is how an intervention performs under ideal, controlled conditions. Effectiveness is how it performs under real-world conditions. [1] A regulator-focused review puts it the same way: efficacy is performance under the conditions of clinical trials, effectiveness is performance in everyday clinical practice. [2] This page explains why the gap matters when you read about emerging treatments and technologies. It is education, not medical advice.

How the studies differ

This table is adapted from a published primer on the two trial types. [1] The primer adds that the two are a continuum, not a strict either-or, since a pure efficacy or pure effectiveness study is probably impossible. [1]

Why efficacy can overstate real-world benefit

Several things have to go right for a proven intervention to help people in practice: it must be available, clinicians must identify who should get it and recommend it, and patients must accept and keep using it. [1] A trial usually removes these obstacles, for example by providing the intervention free and by supporting adherence. [1]

The primer gives an example from liver cancer screening. Ultrasound had a sensitivity of 63% for detecting early disease in prospective efficacy studies, but only 32% in a recent effectiveness study, a gap linked to low use and the skill needed to run the test. [1]

Real-world differences are not only about logistics. A drug regulator's review describes biological and behavioral variability between patients as a source of the efficacy-effectiveness gap. [2] So a trial result is best read as "what is possible in a defined group," not "what you will get."

What "real-world evidence" means

The FDA defines real-world data as data about patient health status or health care delivery that are routinely collected, for example from electronic health records, insurance claims, registries and digital health technologies. Real-world evidence is the clinical evidence about use, benefits or risks of a medical product that comes from analyzing those data. [3]

The FDA says it has long used such data to monitor the safety of approved drugs, and has used real-world evidence to support effectiveness only on a more limited basis. [3] Real-world studies can show how a product performs in broad groups of people. They are also open to the confounding problems described in observational studies and confounding, because patients are not randomly assigned.

Reading claims about emerging treatments

• "Proven in trials" usually refers to efficacy in a selected group. Ask who was excluded.
• "Works in the real world" needs real-world data, ideally compared with a fair comparison group.
• A single device or product cannot borrow another's results; each needs its own evidence.
• Efficacy for a lab marker is not efficacy for a patient-important outcome; see surrogate vs patient-important outcomes.

The primer also notes that an analysis of product evaluations for health technology assessments found efficacy data was often assumed to be effectiveness data. [1] Keeping the two separate is one way to avoid overreading a headline.

For the earlier steps that come before either question, see feasibility vs safety vs efficacy studies and how we label evidence. If you are considering a treatment, talk with a clinician who knows your health history.