AFACT-A
Procurement-ready
- Fabrication rate < 1%
- Zero severity-4 omissions
- Composite ≥ 0.97
MedAttest is the independent certification body for clinical AI accuracy. FACT certification — Fabrication, Accuracy & Completeness Testing — is the procurement standard for ambient AI medical scribes. Think SOC 2, but for what the AI writes in the chart.
There is no objective way to know whether the AI fabricates findings, omits critical clinical facts, or makes unsupported inferences. Vendors self-report accuracy on closed benchmarks. Buyers have nothing independent to point to.
FACT gives both sides a common, verifiable standard.
Vendor-chosen test set. Vendor-defined scoring. No adversarial pressure. No independent review.
Third-party encounters with known ground truth, adversarial traps, severity-weighted scoring, and clinician adjudication.
Every certification run is reproducible, severity-aware, and snapshotted against the exact FACT criteria version in effect.
MedAttest sends a battery of physician-authored synthetic patient encounters — primary care, cardiology, psychiatry — to the vendor's AI.
134 verified clinical facts · 30 adversarial fabrication traps · 0 PHI
Every assertion in the AI-generated note is extracted and scored against ground truth by a physician-calibrated AI judge: grounded, fabricated, or unsupported inference. Omission detection catches what the AI failed to document, weighted by clinical severity.
Grounded / Fabricated / Unsupported · Severity 1–4 omission weighting
Low-confidence judgments are routed to licensed clinicians, whose rulings always override the AI judge. Severity-3 and 4 omissions and fabrications are always human-reviewed.
Clinician override is final · Judge is continuously recalibrated
Vendors receive a composite score and a FACT tier — A, B, C, or fail — against published criteria. FACT-A requires a fabrication rate under 1% and zero severity-4 omissions.
Composite score · Tier A / B / C / Fail · Published criteria
Certified vendors get a versioned public trust page and FACT badge, a shareable PDF attestation with a confidential claim-level appendix, and a CHAI-compatible JSON export.
Public trust page · FACT badge · PDF + CHAI-compatible JSON
Severity-aware by design — a missed drug allergy isn't scored like a missed social-history detail.
FACT criteria are snapshotted into every certification run, so an attestation never silently changes meaning.
Fabrication rate
Fabrication rate
Same synthetic encounters. Same ground truth. The FACT report makes the delta visible to procurement, governance, and patient-safety committees before deployment.
Third-party testing against ground truth known only to MedAttest — not a vendor benchmark dressed up as one.
Adversarial traps in every encounter. Designed to surface fabrications that random sampling misses entirely.
AI judge for scale, licensed physicians for the calls that matter. The judge is continuously calibrated against clinician rulings.
A missed drug allergy is not scored like a missed social-history detail. Clinical impact shapes the math.
FACT criteria are snapshotted into every certification run, so an attestation never silently changes meaning.
All test encounters are synthetic. Nothing sensitive ever touches the platform — not in transit, not at rest.
A FACT-A badge and a public trust page shorten procurement cycles. Stop answering one-off security and accuracy questionnaires for every health system — point them at your versioned attestation.
Start a certification runDefensible purchasing, AI governance, and patient safety in one document. Use the vendor registry to compare FACT tiers, fabrication rates, and severity-weighted omission scores side by side.
Look up a vendor's FACT report