Evidence Standards Appendix

How we grade research, from meta-analyses to tradition, and which sources count.

This appendix sets out how PBTWeb’s research teams grade the evidence behind a product and which sources they accept. It exists so that when a review says an ingredient is “well supported” or “traditional use only”, you know exactly what that means and can check the reasoning yourself.

I. The Evidence Grades

GradeType of evidenceWhat it can and cannot tell you
Grade ASystematic reviews and meta-analyses of randomised trialsPooled results from multiple controlled human studies. The strongest support an ingredient can have.
Grade BIndividual randomised controlled trialsA single well-run human trial with a placebo group. Strong, but one trial can be wrong; replication matters.
Grade CObservational and cohort studiesAssociations in populations. Useful for dietary patterns; cannot prove a supplement caused an effect.
Grade DSmall, open-label or pilot human studiesEarly human data without a control group. Suggestive at best.
Grade EAnimal and laboratory (in vitro) studiesMechanistic findings in cells or animals. Explain how something might work; do not show that it does in people.
Grade FTraditional useDocumented historical use in a medical tradition. Evidence of safety at traditional doses and of plausibility, not of efficacy.

A review states the highest grade available for the specific ingredient, form and dose in the product. A grade-A meta-analysis of a 500 mg extract does not support a product containing an undisclosed amount of that extract inside a 150 mg blend.

II. Three Questions Applied to Every Study

  1. Same ingredient? Species, plant part, extract ratio and standardisation must match the product.
  2. Same dose? The study dose is compared with the label dose. When the label hides the dose, the comparison is impossible and the review says so.
  3. Same people? A trial in patients with a diagnosed condition does not describe what happens in healthy adults, and vice versa.

III. Sources We Accept

IV. Sources We Do Not Accept as Evidence

  • Manufacturer websites and sales pages (used only to record claims, never to support them)
  • Other review sites and affiliate blogs
  • Testimonials, influencer content and before/after photos
  • Press releases without an accompanying published study
  • Studies funded by the seller unless independently replicated

V. How Grades Appear in Reviews

Each review states the grade for the key ingredient in plain words — for example “grade B: one randomised trial at a higher dose than this label provides” — and links to the source. Where the only support is grade E or F, the review says the product is plausible but unproven, and the verdict is written accordingly.

Related Resources