Skip to main content

Method, sources and evidence grades

The study asks one question of every contaminant a manufacturer advertises: is there a certification listing for this exact model that carries it? This page is how that question was asked, what answers were allowed, and which of them the evidence could not support.

Claims and listings read through 2026-09-16. The finding and the limits are on the study page.

The claim side

The population is the marketed claim, not the certified product. Each record in the product corpus carries the manufacturer's own contaminant statements with the URL they were read from and the date they were read; 1,453 such entries across 174 records were read for this release.

A claim enters the scored set only when its subject resolves against a reviewed contaminant table. The table is reviewed and not generated, and that is load-bearing rather than fussy: a loose substring match passes "Chromium-6" against a listing for trivalent chromium, which is a different species with a different health basis, and fails "PFAS" against a listing that carries PFOA and PFOS by name. Both directions were measured before the rule was written. An entry is added only after someone reads a real listing and records the certifier's verbatim wording, which is why unreviewed vocabulary waits in a queue instead of being guessed at.

46 records yielded no scorable contaminant claim, of which 3 carry no marketing claim in the corpus at all. They stay in the denominator of what was scanned and out of the count of claims scored; both numbers are published so neither can be quietly chosen after the fact.

The join, and the three answers it is allowed to give

A claim is checked against the listed claims of every standard the product's certification evidence holds, pooled, never against one standard in isolation โ€” a chlorine claim can legitimately resolve through an aesthetic-effects listing while the same product's reverse osmosis claims sit under a different standard.

Two standards are excluded from the pool on purpose. The material-content standards attest that a product is made without lead, not that it removes lead, and pooling their wording would verify a marketed "removes lead" against a listing that says nothing of the kind. Those rows are partitioned rather than discarded: they still count as a listing we read, so they can corroborate an absence, and they are still reported as what the product does hold.

Verified
A listing this study read carries the contaminant for this model, or a certificate someone read and recorded does.
Not listed
A listing this study read does not carry it, and the absence is corroborated โ€” see below.
Not determinable
Nobody can say from the evidence held. This is where the study deliberately diverges from the publish gate the matching logic came from: a gate fails closed and reports an unbacked contaminant, whereas recording the same case as "not listed" would be publishing a finding about a listing nobody has read.

What makes an absence honest

"No listing carries this" is a claim about the world, so it needs evidence in the same way a positive claim does. Two shapes qualify. The stronger one is that a listing for this model was read and the contaminant is not on it โ€” the directory demonstrably returned the product. The weaker one is that no listing was found and the recorded query proves a search ran with an adequate term and that same directory returned a real listing somewhere else in the same run.

That last condition is the positive control, and it proves the search executed. It does not prove the term was adequate, which is why term length is checked separately: a two-character query once produced a confident "no results" at a directory where the manufacturer is in fact listed. A query the URL does not record corroborates nothing. Anything short of both conditions lands in not determinable, never in not listed. In this release the directories with a positive control were IAPMO, NSF, WQA.

The same rule governs the re-reads published beside the named cases on the study page. Each records the URL, the HTTP status and the bytes returned, because a search that matched nothing and a search that never ran read identically in prose. A read that does not complete is recorded as blocked and is never reported as an absence.

Scope, stated as a boundary rather than implied

A "not listed" verdict means no IAPMO R&T, NSF International and WQA Gold Seal listing this study read carries the contaminant. It does not mean uncertified: CSA Group, ICC and UL Solutions are accredited for drinking water treatment units and this corpus holds none of their listings.

In other words: this release reads IAPMO R&T, NSF International and WQA Gold Seal. CSA Group, ICC and UL Solutions are accredited for drinking water treatment units and are not indexed here, so a product certified only by one of them would appear in this study as unlisted. Every absence on the study page is scoped to the bodies named in that sentence, and none of them is a statement that a product is uncertified.

Why the headline rate is withheld

Unreviewed vocabulary carries no verdict: 469 distinct subject terms across 806 claim entries are neither verified nor unbacked, because nobody has yet checked what the certifiers call them. A rate over the scored claims alone would drop that queue out of its own denominator and then be quoted as a rate over the market.

The generator therefore emits no study-level rate while the queue is open, and a test asserts the artifact carries none. The whole queue is published on the study page so a later release can be diffed against this one term by term rather than count by count.

Prior art, with the evidence grade of each reading

This review was done before any figure was computed, because a study whose novelty is assumed gets dismissed on novelty. It found that the closest comparable work is a commercial certification-corpus study, not the academic literature โ€” and that two premises this study was originally scoped on were wrong. Both corrections are carried below rather than buried.

VerifiedWaterFilterData (2026)

Evidence grade: read-in-full โ€” retrieved and read in full.

Measured: the composition of the certified-filter corpus โ€” which standard each certified filter holds, and how many filters are certified per contaminant.

Sample: 5,682 certified filters from NSF, WQA and IAPMO public listings.

Leaves unanswered: how many marketed claims have no listing behind them. Its universe is the certification listing, so a filter with no certification is absent from the denominator and the unbacked-claim population is unmeasurable by construction.

VerifiedWaterFilterData (July 2026). "Most Water Filters Are Certified for Taste โ€” Not Health." Published under CC BY 4.0 with a downloadable dataset. Retrieved 2026-09-19.

MassDEP / UMass Amherst (2023)

Evidence grade: read-in-full โ€” retrieved and read in full.

Measured: PFAS6 in the effluent of consumer point-of-use devices at 100% and 200% of the manufacturer's rated throughput, against the Massachusetts PFAS6 MCL of 20 ng/L.

Sample: 17 devices, 51 water samples, one water source โ€” the Harbor Trace well, Townsend, Massachusetts.

Leaves unanswered: whether the contaminants these devices advertise removing are listed anywhere. It used manufacturer claims to select devices and then measured performance, never scoring one against the other.

MassDEP & UMass Amherst Department of Civil and Environmental Engineering, Per- and Polyfluoroalkyl Substances (PFAS) Point-of-Use Treatment System Study, Final Report, November 2023. 12 of the 17 devices exceeded the MCL at rated volume; 3 of the 17 held NSF/ANSI 53 certification and all three passed.

Tang, Lytle, Achtemeier & Tully (2023)

Evidence grade: read-in-full โ€” retrieved and read in full.

Measured: whether NSF/ANSI 53 certified filters achieve the certification benchmark for lead in practice.

Sample: 1,678 filters across 23 studies โ€” the largest device sample in the literature.

Leaves unanswered: whether a filter's advertising matches its listing. Its population is defined by already holding the certification, so an uncertified over-claimer cannot enter it.

Tang, M., Lytle, D., Achtemeier, R., Tully, J. (2023). "Reviewing performance of NSF/ANSI 53 certified water filters for lead removal." Water Research 244:120425. 96% of the tested devices met the benchmark.

Teymoorian, Dinh, Barbeau & Sauvรฉ (2024)

Evidence grade: read-in-full โ€” retrieved and read in full.

Measured: removal of up to 75 targeted PFAS by pitcher-type point-of-use filters across two contrasting tap-water sources.

Sample: 5 pitcher filters, 2 water sources.

Leaves unanswered: how often the pairing disagrees across the market. Its Table 1 puts the held certificate next to the marketed PFOA/PFOS claim for five filters and stops there.

Teymoorian, T., Dinh, Q.T., Barbeau, B., Sauvรฉ, S. (2024). "Performance of pitcher-type POU filters for the removal of 75 PFAS from drinking water." Frontiers in Environmental Chemistry. It records that Aquagear is not NSF-certified for PFAS removal and that the manufacturer provides third-party performance data on its website.

Herkert et al. (2020)

Evidence grade: secondary โ€” not read in full โ€” figures taken from two independent secondaries that agree.

Measured: PFAS removal by in-home filters as actually installed and maintained by residents.

Sample: 89 systems across 73 residences in North Carolina.

Leaves unanswered: what any of those systems was certified or advertised to remove โ€” certification status is not recorded at all.

Herkert, N.J. et al. (2020). Environmental Science & Technology Letters 7(3):178-184. The publisher returned HTTP 403 to every transport tried, so the figures here come from two independent secondaries that agree: Duke University's press release and the description in Teymoorian et al. (2024).

Consumer Reports

Evidence grade: unretrieved โ€” not retrieved (paywalled).

Measured: taste and odour reduction, flow rate and clogging in its own laboratory; for contaminants it verifies the manufacturer's certification claim rather than measuring it.

Sample: not disclosed โ€” the ratings are behind a paywall.

Leaves unanswered: any aggregate. It performs this study's check one model at a time and publishes no count of claims checked, no count that failed, and no dataset.

Consumer Reports, Best Water Filter Buying Guide, section "How CR Tests Water Filters". The public methodology page was read in full; the ratings tables and any sample size are paywalled and were not retrieved.

European Commission / CPC Network (2021)

Evidence grade: read-in-full โ€” retrieved and read in full.

Measured: whether online environmental marketing claims were substantiated.

Sample: 344 claims examined in detail, screened by consumer authorities across 27 countries.

Leaves unanswered: the same audit in a sector with a public certification register to score against, which is what makes a verdict checkable rather than a matter of judgement.

European Commission, IP/21/269, 28 January 2021, "Screening of websites for greenwashing: half of green claims lack evidence." In 42% of cases authorities had reason to believe the claim may be false or deceptive โ€” note the wording the regulator chose.

WQA Gold Seal programme guide

Evidence grade: read-in-full โ€” retrieved and read in full.

Measured: nothing โ€” it is the scheme document.

Sample: not applicable.

Leaves unanswered: the distance between the literature a manufacturer submits and what it then says at retail. WQA's literature review evaluates the installation manual, the performance data sheet and the data label; none of them is the product page.

Water Quality Association, The Gold Standard: Your Guide to WQA's Gold Seal Product Certification Program.

US EPA consumer guidance

Evidence grade: read-in-full โ€” retrieved and read in full.

Measured: nothing โ€” it is consumer guidance.

Sample: not applicable.

Leaves unanswered: how often the check it recommends would fail. EPA tells a consumer to verify the listing themselves and names the accredited bodies to verify it with.

US EPA, Identifying Drinking Water Filters Certified to Reduce PFAS, last updated 18 November 2025.

US FTC Health Products Compliance Guidance

Evidence grade: read-in-full โ€” retrieved and read in full.

Measured: nothing โ€” it is enforcement guidance.

Sample: not applicable.

Leaves unanswered: how many filter claims in market meet the bar. It requires competent and reliable scientific evidence before a claim is made, and does not treat third-party certification as the only way to hold it.

US FTC, Health Products Compliance Guidance, section III.B. The asymmetry it creates is load-bearing for this study: an uncertified claim is not automatically an unsubstantiated one.

One correction is worth stating on its own, because the loose version of it circulates. The Massachusetts point-of-use study is often summarised as showing that filters fail to meet "state contaminant standards". It tested one family of contaminants against one standard, on influent from one well in Townsend, Massachusetts โ€” and the devices in it that held NSF/ANSI 53 certification all passed. It is evidence that certification worked, not that it failed, and anyone pitching it the other way will be corrected by the people most likely to check.

Provenance

Derived from apps/website/data/products/records/*.json (174 records, read through 2026-09-16) by apps/website/scripts/certifications/study/build-study-artifact.ts. Regenerate with: bun run apps/website/scripts/certifications/study/build-study-artifact.ts

  • Marketed claims read through 2026-09-16.
  • Listings verified through 2026-09-16.
  • Certifier directories checked through 2026-09-16.

Those dates are read off the inputs, never off a build clock, so two runs over the same committed corpus produce the same bytes. A separate test anchors the artifact to the newest dated read in the corpus โ€” newest rather than merely present, because an artifact built from an older read names dates that all still exist and looks entirely legitimate.

The whole release, including every dated re-read behind the named cases, is downloadable as one JSON file under CC BY 4.0.

By TapWaterData Editorial.

Get the Weekly Water Brief

One email a week on water testing, treatment, and what water-quality data means for your home.

One email a week. Unsubscribe anytime.