Skip to content
AlternativeMed

How to Read an Acupuncture Study: Questions to Ask

A practical set of questions for reading any acupuncture study or news story: the comparison used, who was blinded, how big the difference was, and whether results were registered in advance.

Content last updated . This page has not been medically reviewed.

Why this helps

Headlines such as "acupuncture works" or "acupuncture is just placebo" usually flatten a more complicated picture. You do not need a statistics degree to ask good questions. Each question below comes with an example from published research. This is a reading guide, not medical advice; for background on trial types, see understanding evidence in complementary health.

Ten questions to ask

QuestionWhy it mattersExample from research
  1. What was acupuncture compared with?
Beating no treatment is easier than beating a shamNCCIH notes benefit has often been greater against no treatment than against sham [1]
  1. Was a sham used, and what kind?
Penetrating shams may have effects of their ownSmaller differences in trials that used a penetrating needle as the sham [2]
  1. Who was blinded?
Practitioners rarely can beClinicians were not blinded in any of 13 pain trials [3]
  1. How was the outcome measured?
Self-rated pain is open to expectationCochrane found larger placebo effects for patient-involved outcomes [4]
  1. How big was the difference, in real terms?
"Statistically significant" can still be smallAbout 4 mm on a 100 mm pain scale, which the authors called lacking clinical relevance [3]
  1. Is it one trial or a combined review?
Single small trials can misleadIndividual patient data from 39 trials and 20,827 people [2]
  1. Did the benefit last?
Short-term relief may fadeEffect fell about 15% by one year in one large analysis [2]
  1. Was it registered in advance?
Prevents switching outcomesOnly 19.3% of 88 acupuncture trials were registered before starting [5]
  1. Is the treatment fully described?
You cannot judge or repeat what is not reportedSTRICTA lists rationale, needling, regimen, other treatment, practitioner and control [6]
  1. Who was studied?
Results may not carry over to your conditionEach trial covers specific conditions only; do not generalize

Reading the numbers

  • Compare against the right group. In the GERAC low back pain trial, 47.6% responded to real acupuncture, 44.2% to sham and 27.4% to usual care. [7] Both acupuncture groups beat usual care; real and sham were close.
  • Standard deviations (SDs). Some reviews report effects in SDs: about 0.5 versus no acupuncture and about 0.2 versus sham in one large analysis. [2] The gap against sham is the smaller number.
  • Check the follow-up. In one trial, the acupuncture groups were ahead of usual care on dysfunction at one year, but not on symptoms. [8]

Bias checks borrowed from Cochrane

Cochrane's risk-of-bias tool for randomized trials looks at bias from the randomization process, from deviations from the intended treatment, and from missing outcome data. [9] It also checks bias in measuring the outcome and in selecting which result to report. [9] Allocation concealment (hiding upcoming assignments) is not the same thing as blinding during the trial. [9] Reading the "methods" section for these items tells you a lot.

Red flags

  • A claim of "proven" from one small trial.
  • No comparison group, or only a waitlist.
  • Primary outcome in the paper different from the registered one. [5]
  • Results reported only as percentages without absolute numbers.
  • A story that blends traditional ideas (qi, meridians) with trial results as if one proves the other. See traditional frameworks vs biomedical explanations.

Where to go next

Look at the sham-controlled picture in acupuncture vs sham and the trial-bias background in quality and bias in acupuncture trials. Ask your clinician before changing any treatment based on a study.

Frequently asked questions

What is a sham in an acupuncture study?

NCCIH describes sham procedures such as a device that pokes the skin without penetrating it. [1]

Is a bigger trial always better?

Not always. Size helps, but design matters: bias can come from the randomization process, missing data, how outcomes are measured and which result is reported. [9]

What does "clinically relevant" mean?

It means a change big enough to matter to a patient. One review found a difference of about 4 mm on a 100 mm pain scale and judged it lacking clinical relevance. [3]

Should I trust a review more than a single trial?

Usually a well-run review that combines many trials is more informative, such as individual patient data from 39 trials. [2] But reviews inherit the flaws of the trials inside them.

What is STRICTA?

It is a checklist for reporting acupuncture trials, an official extension of CONSORT, with six items and 17 sub-items. [6]

References
  1. NCCIH. Acupuncture: Effectiveness and Safety. Read 2026-10-22.
  2. Vickers AJ et al. Acupuncture for chronic pain: update of an individual patient data meta-analysis. J Pain 2018. Read 2026-10-22.
  3. Madsen MV, Gotzsche PC, Hrobjartsson A. Acupuncture treatment for pain: systematic review of randomised clinical trials with acupuncture, placebo acupuncture, and no acupuncture groups. BMJ 2009. Read 2026-10-22.
  4. Hrobjartsson A, Gotzsche PC. Placebo interventions for all clinical conditions. Cochrane Database Syst Rev 2010. Read 2026-10-22.
  5. Empirical evidence for outcome reporting bias in randomized clinical trials of acupuncture: comparison of registered records and subsequent publications. Trials 2015. Read 2026-10-22.
  6. MacPherson H et al. Revised STandards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA): extending the CONSORT statement. J Altern Complement Med 2010. Read 2026-10-22.
  7. Haake M et al. German Acupuncture Trials (GERAC) for chronic low back pain. Arch Intern Med 2007. Read 2026-10-22.
  8. Cherkin DC et al. A randomized trial comparing acupuncture, simulated acupuncture, and usual care for chronic low back pain. Arch Intern Med 2009. Read 2026-10-22.
  9. Higgins JPT et al. Cochrane Handbook, Chapter 8: Assessing risk of bias in a randomized trial. Read 2026-10-22.
Education, not medical advice. This page is for general information. It does not diagnose or treat any condition and is not a substitute for care from a qualified health professional. Natural does not automatically mean safe. Ask a clinician or pharmacist before changing your care, especially if you take medication, are pregnant or breastfeeding, or have a health condition.