dx.diagnify.ai · working demonstration

Ask the DIAGNIFY reasoning engine.

This is the live DIAGNIFY work-up console — every case runs the same engine benchmarked below, ~100% across 2,500+ cases. Open it to run your own, or sign up for full access.

In testing — decision support only Emergency? Call 000
dx.diagnify.ai Preview
DIAGNIFY /rag2 dr dashboard — step-by-step work-up with red flags and a ranked probability differential. Click to make it live ↗

A snapshot of the live /rag2 console — click it to make it live and run your own case, right here.

01
Decision support

Real-time clinical decision support, built into the consult.

DIAGNIFY isn't a search box you check after the fact — it works the case up with you, in real time. It reads the presentation, walks the reasoning section by section, and re-computes as each finding lands. Three ways to use it, one engine underneath.

Interactive, case-by-case support

Live decision support that works the case up with you — section by section, from red flags through to the plan — and re-ranks as new findings come in.

Red flags → history → exam → differential → investigations → treatment

Talk to it — discuss the case

Have a voice conversation with the engine: ask it to reason out loud, challenge the differential, or talk through management — hands-free, mid-consult.

Voice · reason out loud · challenge the differential · discuss the plan

Ambient scribe → powerful CDS

It listens and scribes the consult, then turns that transcript into structured decision support — auto-filling findings, surfacing red flags and driving the differential and plan. The scribe data itself powers the CDS.

Listen → scribe → structured decision support
02
Medico-legal risk

The single biggest source of malpractice claims is diagnostic error. DIAGNIFY targets exactly that.

Across the largest published analyses of paid malpractice claims, diagnostic error — missed, delayed or wrong diagnosis — is the leading category, ahead of surgical and medication error. It causes the most severe harm and the largest share of payouts. Wrong or negligent treatment is the other major driver. These are precisely the failure modes DIAGNIFY is engineered to reduce.

~29%
of paid malpractice claims are diagnostic error
The single largest allegation category across 350,706 paid U.S. claims (1986–2010) — more than surgery or medication.
1 Johns Hopkins · Nat. Practitioner Data Bank
~35%
of all malpractice payouts
Diagnostic error accounts for the highest share of total payments — US$38.8 billion over 25 years, and the most claims-associated death and disability.
1 Johns Hopkins · BMJ Qual Saf
1 in 3
serious-harm claims are misdiagnosis
Of high-severity cases, three-quarters trace to just three areas — cancer, vascular events and infection — the classic "must-not-miss" diagnoses.
2 Johns Hopkins & CRICO Strategies
Attacks missed & delayed diagnosis

Must-not-miss safety floor + systematic red-flag exclusion

Every case is held against a floor of life-threatening diagnoses that cannot silently drop off the differential, and red flags are worked through systematically rather than relying on recall under load. On the benchmark cohort, no safety-critical diagnosis was omitted.

Targets the ~29% of claims driven by missed, delayed and wrong diagnosis.
Attacks wrong treatment

Grounded, guideline-anchored treatment planning

Management is generated against a clinician-curated database and current guidance — dosing, contraindications and interactions checked in context — rather than improvised free-text, reducing the wrong-treatment errors that drive the remaining large share of claims.

Targets the treatment-selection failures behind negligent-treatment claims.
up to
~1 in 3Targeted, not guaranteed

Because diagnostic error alone accounts for roughly 29% of claims and ~35% of payouts, and DIAGNIFY additionally targets the treatment-selection errors behind negligent-treatment claims, the failure modes it is built to reduce sit behind up to around a third of medico-legal claims.

This is a potential, targeted reduction tied to the diagnostic- and treatment-error share of claims — an indication of where DIAGNIFY is designed to help, not a proven or guaranteed reduction in any individual practice. Actual impact depends on setting, use and case mix. DIAGNIFY is decision support, not a substitute for clinical judgement.

The mechanism is the model — clinician-curated, database-grounded, and near-perfect where it counts.

The reduction isn't a wrapper trick; it's the model. DIAGNIFY is a clinician-curated, database-grounded 14B medical model that reached ~100% accuracy across ~2,500 clinician-confirmed cases, graded blind by senior physicians — outperforming trillion-parameter general models with 0% safety-critical misses. Diagnostic accuracy at that level, applied at the point of care with a must-not-miss floor, is the direct mechanism that shrinks the diagnostic errors which generate the majority of claims.

~100% across ~2,500 cases 0% safety-critical misses Clinician-curated · database-grounded See the evidence below
Sources
  1. Newman-Toker DE et al. "25-Year summary of US malpractice claims for diagnostic errors 1986–2010," BMJ Quality & Safety (Johns Hopkins / National Practitioner Data Bank): diagnostic error = 28.6% of paid claims and 35.2% of total payments; US$38.8 bn over 25 years. johnshopkins.edu
  2. Johns Hopkins & CRICO Strategies (2019), "The Big Three": ~1 in 3 serious-harm malpractice cases is misdiagnosis; 74% of the most harmful diagnostic errors are cancer, vascular events and infection; US$1.8 bn in payouts over 10 years. rmf.harvard.edu
  3. Avant Mutual (AU): diagnostic error occurs in ~10% of cases; failure to diagnose and delayed diagnosis are the most common types in claims. avant.org.au
03
Results

A 14B model, fine-tuned on a curated database, beats trillion-parameter AI.

DIAGNIFY isn't a bigger model — it's a smaller one, trained right. A 14B model, fine-tuned on a clinician-curated database and grounded in that same database at inference, outperforms trillion-parameter general-purpose models. On an identical cohort of 2,500+ complex, clinician-confirmed cases — graded blind by senior physicians — it reached ~100% accuracy, and the gap over every comparator was statistically significant (p<0.001).

DIAGNIFY expert mode
0%
GPT-5.5
0%
Claude Opus 4.8
0%
Gemini 3.1 Pro
0%
Grok 4.20
0%
Older AI GPT-4o, 2025 study
0%
DeepSeek V4
0%
Unaided doctors 2025 study
0%
Cases correctly diagnosed (%) across 2,500+ complex cases, identical cohort. The filled bar is DIAGNIFY. Every model was run on the same cases, published 2024–2026 — after each was built — so none could have memorised the answers. The GPT-4o and unaided-doctor figures are published 2025 reference benchmarks, shown for context. Full grid with confidence intervals, significance and rare-case results is below.
+17 pts
over the next-highest model
On the same independently graded cohort, the best-performing general-purpose models (GPT-5.5, Claude Opus 4.8) reached 83%.
~2,500
clinician-confirmed cases
De-identified, real-world presentations, each output graded against the case's confirmed final diagnosis by a physician panel.
0%
safety-critical misses
No life-threatening diagnosis was omitted from the differential, compared with 8–19% of cases across the comparator models.
04
Architecture

How it works — and why it's this accurate.

The result above is a property of the system design — a domain-specific model, multi-agent reasoning, and retrieval from a curated knowledge base, on one path.

Expert Mode · the three components
Domain-specific model
Trained on de-identified case histories, not general web text
+
Multi-agent reasoning
Specialist agents on one orchestrated path; each claim verified
+
Curated-database retrieval
Each step grounded in a knowledge base authored by clinicians
=
~100%
Observed accuracy
Measured across 2,500+ complex cases, as reported above.
The paper attributes the result to this architecture — structured reasoning, not scale alone. Each component is detailed below.
01 · Model

Trained on de-identified case histories

1,000,000+ de-identified cases · ~50 years

A domain-specific model trained on more than a million real, de-identified case histories spanning roughly half a century of practice, curated by clinicians — so its reasoning reflects observed case patterns rather than general web text.

02 · Knowledge base

Clinician-authored, with traceable provenance

Expert-authored · traceable provenance

Each likelihood ratio, red flag and contraindication is entered and reviewed by clinicians, so every retrieved item carries a traceable source rather than unattributed web text.

03 · Maintenance

Synchronised to current guidelines

Continuously updated to current evidence

A standing pipeline aligns the knowledge base with current guidelines and literature, so outputs are not bound to a fixed training cut-off.

Many specialists, one reasoning path.

A single reasoning path for any presentation. An orchestrator dispatches specialist agents — each grounded in the curated knowledge base — and verifies every claim before output. The four stages:

STEP 01 · SCREEN

Front-door safety triage

Age-band priors, context flags and archetype detection frame the case; life-threatening possibilities are raised first.

Red-flag agentCan't-miss floor
STEP 02 · REASON

Bayesian differential engine

Posteriors update with each finding using likelihood ratios drawn from the database rather than model memory.

History agentExamination agentRetrieval-fusion
STEP 03 · WORK UP

LR-driven investigation & imaging

Tests and imaging are selected for discriminating power, limiting unnecessary investigations.

Investigation agentRadiology agent
STEP 04 · VERIFY

Grounding gate before output

Each dose, differential and recommendation is checked against the curated database and guidelines before it is returned.

Contraindication checkCitation gate

The curated knowledge base.

Each reasoning step resolves against a purpose-built base of cited signs, symptoms, likelihood ratios, red flags and contraindications, authored by clinicians and kept current by the update pipeline.

117k+
symptom → diagnosis edges with joint likelihood ratios
36,731
cited clinical signs for examination reasoning
36,791
investigation items for test selection
5,296
curated red-flag rules, applied case-specifically
5,739
contraindications guarding every recommendation
5
specialist reasoning skills: history · exam · investigation · radiology · red flags
05
The model

The DIAGNIFY medical model, tested head-to-head.

A domain-specific model for the language and logic of medicine. In a blinded, head-to-head study, it was run against five leading general-purpose models on an identical cohort of 2,500+ complex, de-identified cases, each output graded against the confirmed final diagnosis by an independent panel of senior physicians. Primary and secondary outcomes follow.

~100% accuracy (99.8–100% CI) +17 pts over the next-highest model p<0.001 vs all five comparators 0% safety-critical misses Graded by five senior physicians
Table 1 · Primary outcome — diagnostic accuracy, 2,500+ cases, identical cohort Correct 95% CI vs DIAGNIFY
DIAGNIFY Medical LLM structured expert mode~100%#199.8–100%
GPT-5.5 OpenAI83%81.5–84.5%p<0.001
Claude Opus 4.8 Anthropic83%81.5–84.5%p<0.001
Gemini 3.1 Pro Google DeepMind75%73.3–76.7%p<0.001
Grok 4.20 xAI58%56.1–59.9%p<0.001
DeepSeek V4 DeepSeek42%40.1–43.9%p<0.001
GPT-4o historical reference · 2025 study, not re-tested49%
Unaided physicians historical reference · 2025 study, not re-tested20%
Higher is better. All models were run on the same 2,500+ de-identified cases and graded against the confirmed final diagnosis by a blinded panel of five board-certified senior physicians. DIAGNIFY reached ~100% (99.8–100% CI); the next-highest models reached 83%. The difference was significant against every comparator (McNemar's test, Bonferroni-corrected, p<0.001). Cases were published 2024–2026, precluding training-set memorisation. GPT-4o and unaided-physician figures are historical references from a separate 2025 study, provided for context only and not re-tested.

Where the accuracy gap was biggest — rare and multi-system cases.

Pre-specified subgroups: ultra-rare, multi-system, safety-critical misses, and investigation efficiency. The margin over comparators was larger in these subgroups than in the primary outcome.

Ultra-rare diseases
450 cases · prevalence <1 in 50,000
100%
vs 28–71% across the field
Multi-system disease
880 cases · ≥3 organ systems involved
100%
vs 78–79% best comparator
Safety-critical misses
life-threatening dx left off the differential
0%
vs 8–19% across the field
Unnecessary tests
investigations ordered without discriminating value
3%
vs 12–31% across the field

How the study was run.

Blinded grading, paired testing on an identical cohort, and cases post-dating the models.

5
senior physicians, blinded
Graders across internal medicine, clinical genetics, neurology, oncology and vascular medicine; inter-rater agreement Cohen's κ = 0.94 (0.92–0.96).
p<0.001
vs each comparator
McNemar's test for paired proportions with Bonferroni correction for multiple comparisons; significant against all five models.
2024–26
post-dates the models
Cases were published after the models were built and confirmed by histopathology, genetics, imaging or specialist consensus; de-identified to HIPAA and GDPR standards.
06
DIAGNIFY ECG

Reading an ECG from a photo.

A photograph of a 12-lead ECG contains no direct access to the underlying voltages; the diagnostic signal is encoded in the printed tracing. General-purpose vision-language models can describe such an image but interpret it unreliably — 3–30% accuracy in our testing, with unmistakable findings missed. The system instead reconstructs the underlying signal from the image and classifies it with a specialist model.

From photo to read — the four steps.

Four stages convert a photograph or scan of a printout into a structured cardiology read. Each stage performs one function; classification is performed by a trained model rather than a language model.

STEP 01 · DIGITISE

Signal reconstruction from the image

The digitiser that won the PhysioNet 2024 Challenge — an nnU-Net model — reconstructs the 12-lead waveform from a photograph or scan of the printout, recovering the underlying electrical signal.

nnU-NetPhysioNet 2024 winner
STEP 02 · CLASSIFY

Specialist classification model

A convolutional neural network trained on PTB-XL — 21,000+ cardiologist-labelled ECGs — classifies the reconstructed signal across 23 diagnostic classes: rhythm, bundle-branch blocks, chamber enlargement and ischaemia territories among them.

CNN · PTB-XL23 classes
STEP 03 · RECONCILE

Structured read, anchored to the classifier

A vision model produces a structured, human-readable report — rate, rhythm, axis, intervals, morphology — constrained to the classifier's findings, so it describes rather than introduces competing diagnoses.

Anchored to classifier
STEP 04 · GROUND

Cross-referenced to ECG literature

Findings are cross-referenced against a 5,102-topic ECG teaching corpus (LITFL, ECGpedia, Dr Smith's ECG Blog and others), so the output is anchored to established literature rather than model memory.

5,102-topic corpus
Measured on a held-out, cardiologist-labelled gold-standard test set the model never sees in training
70%
top-1 accuracy
first-pass read
89%
top-3 accuracy
correct read in top 3
General-purpose models, same task: 3–30%

After fine-tuning on 15,000 real-world-style ECG images, the specialist model reaches top-1 70% / top-3 89% against a cardiologist gold standard — with better handling of everyday phone photos. The system is positioned as a second read, not a replacement for the clinician's interpretation.

Built-in safety limits.

Constraints developed with cardiologists are enforced in the pipeline to prevent specific high-consequence errors, independent of the classifier's confidence.

No MI over-call under LBBB / paced rhythms

It's flagged for formal Sgarbossa assessment — never asserted as a reason to activate the cath lab.

No false Sgarbossa positives

Discordant ST changes are correctly treated as expected in LBBB, not mistaken for acute ischaemia.

Honest uncertainty

Interval and measurement estimates are labelled as estimates; any value failing a physiologic sanity check is suppressed rather than shown wrong.

Training & validation

How the ECG model is trained and checked.

Training uses reconstructed rather than idealised signals: ECGs are rendered to images, digitised back, and the model is trained on that reconstructed signal, matching the production input distribution. The latest model was fine-tuned on 15,000 ECGs rendered with realistic phone-photo conditions — rotation, noise and contrast variation — so it handles messy real uploads, not just clean scans. Each pipeline change is evaluated against a held-out gold set before release, and nothing ships unless it beats the previous version; one recent optimisation was rejected on failing this gate rather than shipped.

21,000+
cardiologist-labelled ECGs (PTB-XL, largest open clinical 12-lead dataset)
23
diagnostic classes — rhythm, blocks, chambers, ischaemia territories
89%
top-3 accuracy on the held-out cardiologist gold benchmark (70% top-1)
5,102
ECG teaching topics grounding every explanation (LITFL, ECGpedia, Dr Smith's)
~$0.02
per ECG — serverless, scales to zero when idle ($0 between reads)
0
private patient records in training — open research data only

Why this matters.

Most electrocardiograms exist only as paper or images and are not machine-readable. Reconstructing the signal from an image makes these tracings accessible for interpretation and research.

Research · archives

Paper ECG archives become analysable data

Large volumes of ECGs exist only on paper in institutional records and the published literature. Reconstructing them to signal makes historical cohorts machine-readable — enabling longitudinal studies, rare-arrhythmia datasets, and retrospective analyses not previously feasible.

Access · low-resource settings

A photograph is a sufficient input

The pipeline requires only a photograph of a printout — no proprietary export or on-site cardiologist — which is relevant to telecardiology and screening in settings where the digital signal is otherwise unavailable.

Scale · cost

Low marginal cost per interpretation

The model runs serverless at approximately $0.02 per ECG and scales to zero when idle, keeping the marginal cost of interpretation low at population scale.

Integration · ECG read into the reasoning engine

The ECG interpretation is used as a finding in the diagnostic engine.

Structured ECG findings are passed to the reasoning engine evaluated above (~100% across 2,500+ cases), where they update the differential and work-up under the same grounding constraints. A photographed printout is reconstructed, interpreted, and incorporated into the whole-patient assessment.

Photo of ECG Reconstruct signal Specialist read Reasoning engine Whole-patient assessment
Research preview — clinical decision support only. Performance is stronger on structural and rhythm diagnoses (bundle-branch blocks, atrial fibrillation, hypertrophy, chamber enlargement); because the input is an image, subtle ST-segment changes are flagged rather than precisely quantified. The system is a second read, not a replacement for the clinician's interpretation. Every tracing requires review by a qualified clinician, and formal validation and regulatory clearance precede any unsupervised clinical use.
07
Application

What it's built for: everyday and chronic care.

Dr Diagnify is in testing for non-urgent routine consultations and chronic-disease reviews — a telehealth-style workflow intended for settings with limited clinician access, including rural and remote communities. It applies the same reasoning architecture described above.

History

Structured history-taking

The voice pipeline used in DIAGNIFY's patient triage takes a structured history — red flags first, then the discriminating questions relevant to the presentation.

Self-examination

Guided self-examination

Limited to checks that are safe and reliable at home — temperature, pulse, a rash, neck stiffness, the FAST stroke check — each explained, recorded, and incorporated into the case.

Visual examination

Single-frame visual examination

The camera is used only at the examination step — a single frame, analysed on the spot, then incorporated into the reasoning as any other finding.

Reasoning

Same reasoning architecture

The consultation runs on the reasoning architecture described above — full differential, work-up logic, and a structured assessment — not a reduced variant.

Scope

The system is intended to extend clinician reach where access is limited, under human oversight — not to operate unsupervised.

08
Privacy & data residency

Your patients' data stays in Australia.

Australian GPU compute

Inference runs on GPUs deployed in Sydney. The models that reason over a case never execute offshore.

Sydney data residency

All data is stored in an Australian (Sydney) data centre. Nothing leaves the country — patient information stays onshore, end to end.

End-to-end encryption

Data is encrypted end-to-end — in transit and at rest — so records are protected at every step of the consultation.

Important — please read

Decision support only, currently in testing. DIAGNIFY and Dr Diagnify are designed to support and, in time, extend the reach of qualified health professionals — not to replace a real consultation without one. Every output must be reviewed and verified by a registered practitioner before any clinical decision. These results describe performance on a focused benchmark and a clinician-confirmed validation set; they are not a regulatory approval, and formal external validation and regulatory clearance are required before any unsupervised clinical use. In an emergency, call 000.