Skip to content

Add report reconciliation: compare official radiologist report against image analysis #58

Description

@Liohtml

Part of #51. Builds on the cross-validation step (#52). This is the
market-differentiating feature
— no existing consumer product does it.

Summary

Let the user provide the official radiologist report (paste text, or ingest a
DICOM SR / PDF), and have MedCheck reconcile it against its own image-derived
findings and the ML signals: which official findings the model can localize, where
they are, and any regions the model flagged that the report did not mention — each
framed as "ask your doctor about this," never as a contradiction or a new
diagnosis.

Why (research-backed)

Market research found the landscape is siloed and nobody reconciles report vs.
image
for patients:

  • Text explainers (Scanslated, Read My MRI, ChatGPT) explain the words but
    never read the pixels → can't validate anything.
  • Viewers (Horos, Weasis, OHIF) show pixels but explain nothing.
  • Second-opinion services (DocPanel, Mediphany $95–300) do both but are paid,
    slow, closed, human.
  • The closest research prototype (ReXplain) only highlights image regions; it's
    unreleased.

Reconciliation also has clinical grounding: subspecialty second reads find
~20–25% clinically significant discrepancies, and everyday radiology
discrepancy is ~3–5% — so "here's what your report says, here's where it is, and
here's something to ask about" is genuinely useful, while staying on the safe side
of the regulatory line (it explains/locates an existing human report rather
than issuing findings).

⚠️ Positioning / safety (see epic #51)

  • Frame strictly as comprehension + question-preparation: "Your report
    mentions X — here is the region"
    and "the analysis also looked at Y; the report
    doesn't mention it — consider asking your doctor."
  • Never state the radiologist is wrong, never present a model finding as a
    diagnosis, never say a region is normal/abnormal definitively.
  • This keeps MedCheck in the educational track; presenting autonomous image
    findings to a patient as truth would make it a regulated device.

Proposed implementation

Acceptance criteria

  • Accepts an official report (text minimum; SR/PDF as follow-ons).
  • Produces corroborated / report-only / analysis-only buckets with locations
    where available.
  • All output uses question-preparation framing; no contradiction/diagnosis
    language (unit-tested phrasing guardrails).
  • Ingested report text is PHI-scrubbed (Add robust DICOM de-identification step (tag scrubbing + burned-in PHI + optional defacing) #57).
  • Tests: matching logic (synonyms via RadLex), three buckets, framing guard,
    empty-report no-op.

Dependencies

Strong synergy with #52 (validation), #53 (segmentation locations), #54 (DICOM SR
parsing), #57 (PHI scrubbing of ingested text).

Effort

~2–3 days. No heavy deps for the text path.

References (session research)

Consumer-tool market gap analysis; subspecialty second-read discrepancy ~20–25%;
everyday radiology discrepancy 3–5%; ReXplain (arXiv 2410.00441).

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions