How Brain Supplement Trials Are Designed and Why Results Disagree
How trials of brain supplements are built, and the plain reasons two studies of the same ingredient can point in different directions.
Content last updated . This page has not been medically reviewed.
Studies of "brain" supplements often disagree because they are not really asking the same question. They may test different people, different products, different lengths of time and different memory or attention tests. Some are also small or at higher risk of bias. A single positive result, or a single negative one, rarely settles anything. This page explains the design ideas; it does not tell you what to take. Ask a clinician or pharmacist about your own situation.
What a well-designed trial looks like
The research body NCCIH (part of the US National Institutes of Health) describes the "gold standard" as a randomized, placebo-controlled trial. [1] Volunteers are assigned by chance to the test product or to a placebo, an inactive look-alike. Comparing the two groups suggests whether changes came from the product or occurred by chance. [1]
The same page explains the placebo effect: a beneficial outcome that comes from a person's expectation that an intervention will help. [1] That matters for memory and focus, where people can usually tell how they feel but cannot easily measure it. A trial without a placebo group cannot separate the product from expectation.
Practice effects and the tests themselves
People often do better on a cognitive test simply because they have done it before. Researchers call this a practice effect. A large 2026 study of the Cogstate test among nurses describes practice effects as improvements with repeated exposure that must be addressed, and found that repetition may obscure age-related decline over short follow-up. [6] That study tested a test, not a supplement, but the lesson carries over: a trial needs a control group taking the same tests, otherwise practice can look like a benefit.
A better score on a test is not the same as a better day
Test scores and daily life can differ. In one meta-analysis of ginkgo extract in people with Alzheimer's disease, cognitive function improved somewhat, yet the analysis of effects on daily life found no difference from placebo. [5] Evidence labels used on this site: "mixed" means studies point both ways; "insufficient" means too little reliable research; "Proper evidence not found" means we looked and did not find usable trials.
Comparing products without head-to-head trials
Network meta-analyses try to rank products that were never tested against each other. One 2026 analysis of two herbal extracts in healthy adults itself noted that the lack of direct comparisons may limit the strength of its evidence. [7] Treat rankings of this kind as a prompt for better trials, not as a verdict.
Related pages
Start with what nootropics are, then whether they work. For study types in general, see evidence types and study designs. To check advertising language, see brain supplement marketing claims checked.
Frequently asked questions
Why do two studies of the same ingredient disagree?
They often differ in who was studied, the product, the length and the tests used. [4] Reviews of ginkgo found acute positive results that were not replicated. [3]
What is a placebo-controlled trial?
Volunteers are randomly assigned to a test product or an inactive look-alike, and results are compared. [1]
Does a positive result in young adults apply to older adults?
Not automatically. The sources we read treat healthy young adults and older adults with memory problems as separate groups. [3] [5]
Is a bigger test-score gain the same as a real-life benefit?
No. In the ginkgo example above, scores improved while daily-life measures did not differ from placebo. [5]
Can a trial tell me what is safe for me?
No. Talk to a clinician or pharmacist, especially if you take medicines, are pregnant or have kidney or liver conditions. [8]
More details: evidence, limits and cautions
The details behind this page: cautions, limits of the evidence and where sources disagree. Open any note to read it.
Why results disagree: the common reasons
| Reason | What the sources show | How strong the point is |
|---|---|---|
| Different people studied | A Cochrane review of L-carnitine in cognitively healthy people found only two eligible trials, and all participants were young adults. [2] A separate review of ginkgo in healthy people under 60 judged the evidence from longer-term studies largely negative, a finding for that group only. [3] | Results from one group do not transfer to another |
| Many outcomes, few repeats | Acute ginkgo studies used multiple outcomes and reported benefits on some measures at particular time points. [3] The review found these were either not replicated or directly contradicted by other studies. [3] | Picking the one positive test out of many is a known weak spot |
| Different tests | A review of herbal and nutritional products in older adults found that measures of cognition varied across studies. [4] The carnitine trials also assessed different cognitive outcomes. [2] | Hard to combine or compare studies |
| Short or small studies | In that older-adult review, most studies were parallel, randomized, placebo-controlled designs of 12 weeks. [4] NCCIH notes one ginkgo review called for more research because of small sample size, inconsistent findings and study quality. [5] | Short trials cannot show long-term effects |
| Risk of bias | The same review judged 14 of 21 studies to have a high risk of bias [4] and concluded that the quality of evidence was low. [4] | Weak designs can look positive by chance |
| Short versus long follow-up | NCCIH summarizes a Cochrane review that found no evidence of cognitive benefit from B vitamins over 6 to 24 months. [5] A later meta-analysis of studies lasting more than 12 months suggested B vitamins may slow cognitive decline. [5] | Different time frames and populations can give different answers |
Safety and who should ask first
Trial volunteers are screened, and a trial result is not personal advice. Supplements can interact with medicines, interfere with lab tests or have dangerous effects during surgery, so tell your health care professional about everything you use. [8] The FDA does not have the authority to approve dietary supplements for safety and effectiveness. [8] People who are pregnant or breastfeeding, give supplements to children, have kidney or liver conditions, or take prescribed medicines should ask a clinician or pharmacist first. If you are worried about memory change, see a clinician rather than trying products. See medication interactions and quality testing and certifications.
References
- NCCIH, Placebo Effect (updated January 2020). Read 2026-10-22.
- Cochrane, L-carnitine for cognitive enhancement in people without cognitive impairment, 2017 (PubMed 28349514). Read 2026-10-22.
- Canter and Ernst, Ginkgo biloba is not a smart drug: systematic review, Hum Psychopharmacol 2007 (PubMed 17480002). Read 2026-10-22.
- Cave et al., Herbal and nutritional medicines and cognitive function in older adults: systematic review, Syst Rev 2023 (PubMed 37592293). Read 2026-10-22.
- NCCIH, Dietary Supplements and Cognitive Function, Dementia, and Alzheimer’s Disease: What the Science Says (July 2022). Read 2026-10-22.
- Murchland et al., Improvements in Cogstate Test Performance Depend on Number and Frequency of Prior Tests, Alzheimer Dis Assoc Disord 2026 (PubMed 42224199). Read 2026-10-22.
- Comparative effects of Bacopa monnieri and Ginkgo biloba on cognitive functions: systematic review and network meta-analysis, Phytomedicine 2026 (PubMed 41678913). Read 2026-10-22.
- FDA, FDA 101: Dietary Supplements. Read 2026-10-22.