Rubric condition met: A meta-analysis of 31 placebo-controlled RCTs in rested healthy adults with a consistent direction, publicly funded.
A 2025 meta-analysis of 31 randomized, double-blind, placebo-controlled trials (1,455 rested healthy adults) found better accuracy on attention tests (g = 0.27); it was publicly funded and the effect did not vary with habitual intake. In other populations, a meta-analysis in sleep-deprived people and a Cochrane review in shift workers point the same way, though the Cochrane trials had a high risk of bias; neither is part of this grade. A focused review argues that in habitual users much of the acute benefit may reflect reversal of withdrawal, so the grade covers acute effects only.
How sure are we?
Evidence maturity: Established A 2025 meta-analysis of 31 randomized, double-blind, placebo-controlled trials in rested healthy adults, publicly funded, plus a preregistered independent RCT (NCT02461693, 205 enrolled, registered June 1, 2015 at the start of enrollment).
Who paid for the studies
Mostly independent
Risk of bias
Not assessed: the 2025 meta-analysis abstract reports no risk-of-bias rating and the full text was not read
Trial registry check
NCT02461693 registered at the start of enrollment (first submitted June 1, 2015; start June 2015); primary outcomes include vigilance proportion correct and mean time to a correct hit
Publication bias
Not assessed: no funnel or small-study test reported in the abstracts read
Outcome measured
A test score, rating scale or performance measure
Who was studied
Matched
Doses used in studies
About 40-300 mg (0.5-4 mg/kg) single doses; effects below and above 200 mg
Could rise: Already at the top grade.
Could fall: Would move to B if an independent, preregistered RCT of 100 or more rested habitual users, with a washout control, found no effect on its primary attention outcome.
Science is provisional. This grade reflects the evidence we found as of . Next review: .
Maturity sits beside each grade. The grade says what the evidence shows; maturity says how much of it there is and how well it is confirmed.
Established
many trials from several independent teams, including at least one registered in advance
Emerging
two or more trials, or one large registered trial, not yet independently confirmed
Early signal
one trial, small pilots, or results only on secondary outcomes
Mechanistic only
lab, animal or biomarker data, or uncontrolled reports; no controlled human results
each study this grade rests on, by publication year and design. Solid: effect versus the comparator; half-filled: mixed; hollow: no effect; dashed: result not recorded yet. Larger marks had more participants.Show the numbers
Study
Year
Design
Participants
Result
James 2005
2005
focused review
not recorded
result not recorded
McLellan 2016
2016
narrative review
not recorded
result not recorded
George 2018
2018
RCT
205
result not recorded
Kl 2025
2025
meta-analysis
1455
result not recorded
Randomization to randomization probability: Estimating treatment effects under actual conditions of use.
George BJ, Li P, Lieberman HR. Randomization to randomization probability: Estimating treatment effects under actual conditions of use Psychol Methods, 2018. PMID 28406674
Result not recorded
Design
Methods paper reporting a preregistered, double-blind RCT (randomization to randomization probability design)
Sample
n = 205
Population
Adults (single 200 mg dose vs placebo)
Funding
National Institutes of Health (PubMed grant list: NIDDK R25 DK099080, T32 DK062710, P30 DK056336; NHLBI R25 HL124208)
Effects of caffeine on performance and mood: withdrawal reversal is the most plausible explanation.
James JE, Rogers PJ. Effects of caffeine on performance and mood: withdrawal reversal is the most plausible explanation Psychopharmacology (Berl), 2005. PMID 16001109
Result not recorded
Design
Focused review
Population
Habitual caffeine consumers vs low/non-consumers
Funding
not stated
A systematic review and meta-analysis of the acute effect of caffeine on attention.
Kløve K, Petersen A. A systematic review and meta-analysis of the acute effect of caffeine on attention Psychopharmacology (Berl), 2025. PMID 40335666
Result not recorded
Design
Systematic review and meta-analysis of 31 randomized, double-blind, placebo-controlled trials
Sample
n = 1,455
Population
Rested healthy adults
Funding
Danmarks Frie Forskningsfond, Danmarks Frie Forskningsfond 9037-00169b
A review of caffeine's effects on cognitive, physical and occupational performance.
McLellan TM, Caldwell JA, Lieberman HR. A review of caffeine's effects on cognitive, physical and occupational performance Neurosci Biobehav Rev, 2016. PMID 27612937
Result not recorded
Design
Narrative review
Population
Adults, including military and occupational groups
Funding
US Army Medical Research and Materiel Command; US Department of Defense (Crossref funder list)
Search and history
Search (): caffeine[ti] AND (cognit*[tiab] OR attention[tiab] OR vigilance[tiab]) AND (meta-analysis[pt] OR systematic review[pt]) AND 2024:2026[dp]
Graded A (awaiting approval)
A to A (awaiting approval) (maturity: established): Maturity, bias summary and re-check date added
A to A (approved) (maturity: established): Editor sign-off November 16, 2026: grade matches the editor-approved final page
A, strong: what grade A means
At least one meta-analysis or three independent randomized trials in the relevant healthy population, pointing the same way, with low or some risk of bias, at doses legally available.