|
| 1 | +--- |
| 2 | +layout: pw44-project |
| 3 | + |
| 4 | +permalink: /:path/ |
| 5 | + |
| 6 | +project_title: Using automatic AI segmentation tools for Imaging Data Commons data enrichment |
| 7 | +category: Segmentation / Classification / Landmarking |
| 8 | +presenter_location: |
| 9 | + |
| 10 | +key_investigators: |
| 11 | + |
| 12 | +- name: Lena Giebeler |
| 13 | + affiliation: RWTH Aachen |
| 14 | + country: Germany |
| 15 | + |
| 16 | +- name: Andrey Fedorov |
| 17 | + affiliation: BWH |
| 18 | + country: USA |
| 19 | + |
| 20 | +- name: Lalith Kumar Shiyam Sundar |
| 21 | + affiliation: LMU |
| 22 | + country: Germany |
| 23 | + |
| 24 | +--- |
| 25 | + |
| 26 | +# Project Description |
| 27 | + |
| 28 | +<!-- Add a short paragraph describing the project. --> |
| 29 | + |
| 30 | + |
| 31 | +This project builds on work carried out during [PW43](https://projectweek.na-mic.org/PW43_2025_Montreal/Projects/EvaluatingConcordanceOfAiBasedAnatomySegmentationModels/) and on the work ["In Search of Truth: Evaluating Concordance of AI-Based Anatomy Segmentation Models"](https://www.arxiv.org/pdf/2512.15921). |
| 32 | + |
| 33 | +Our overall goal is to enrich images available in [Imaging Data Commons](https://learn.canceridc.dev/) with segmentations and quantitative features. |
| 34 | + |
| 35 | +In this work, we developed a practical workflow to compare AI-based anatomy segmentation models in the absence of ground truth annotations. Segmentation outputs from different models were harmonized into a standardized representation, enabling structure-wise comparison and efficient visual review. Using this framework, we evaluated six open-source segmentation models, TotalSegmentator 1.5, TotalSegmentator 2.6, Auto3DSeg, MOOSE, MultiTalent, and CADS, on 18 CT scans from the NLST dataset hosted by the [Imaging Data Commons](https://learn.canceridc.dev). While agreement varied across anatomical structures, MOOSE and CADS showed consistent results across all evaluated structures and did not show visible segmentation errors during visual comparison. In contrast, the other four models produced visible segmentation errors or deficiencies in rib and vertebrae structures. |
| 36 | + |
| 37 | +The goal of this Project Week is to select a representative subset of the NLST dataset, run the MOOSE segmentation model on it, and use radiomic features to identify and visually inspect potential segmentation outliers to confirm robustness of the model. Stretch goal is to process all of the CTs in NLST (or even beyond NLST) with MOOSE to generate segmentations and radiomics features, for the subsequent ingestion into Imaging Data Commons. |
| 38 | + |
| 39 | +In addition, the 3DSlicer [CrossSegmentationExplorer](https://github.com/ImagingDataCommons/CrossSegmentationExplorer) extension described in the preprint should be finished and published as an extension for 3D Slicer. |
| 40 | + |
| 41 | + |
| 42 | + |
| 43 | +## Objective |
| 44 | + |
| 45 | +<!-- Describe here WHAT you would like to achieve (what you will have as end result). --> |
| 46 | + |
| 47 | + |
| 48 | +1. Evaluate how the MOOSE segmentation model performs on a representative subset of the NLST dataset, as the previously analyzed subset did not capture all relevant dataset characteristics. |
| 49 | +2. Publish the CrossSegmentationExplorer extension in 3DSlicer |
| 50 | +3. Identify any new segmentation models known in the community that might be suitable for automatic segmentation tasks. |
| 51 | + |
| 52 | + |
| 53 | + |
| 54 | + |
| 55 | +## Approach and Plan |
| 56 | + |
| 57 | +<!-- Describe here HOW you would like to achieve the objectives stated above. --> |
| 58 | + |
| 59 | + |
| 60 | +1. Define criteria for NLST subset selection |
| 61 | +2. Run MOOSE on that subset and extract radiomic features |
| 62 | +3. Analyze feature distributions to detect outliers |
| 63 | +4. Visually review outlier cases in Slicer |
| 64 | + |
| 65 | + |
| 66 | + |
| 67 | + |
| 68 | +## Progress and Next Steps |
| 69 | + |
| 70 | +<!-- Update this section as you make progress, describing of what you have ACTUALLY DONE. |
| 71 | + If there are specific steps that you could not complete then you can describe them here, too. --> |
| 72 | + |
| 73 | + |
| 74 | +1. Describe specific steps you **have actually done**. |
| 75 | + |
| 76 | + |
| 77 | + |
| 78 | + |
| 79 | +# Illustrations |
| 80 | + |
| 81 | +<!-- Add pictures and links to videos that demonstrate what has been accomplished. --> |
| 82 | + |
| 83 | + |
| 84 | +_No response_ |
| 85 | + |
| 86 | + |
| 87 | + |
| 88 | +# Background and References |
| 89 | + |
| 90 | +<!-- If you developed any software, include link to the source code repository. |
| 91 | + If possible, also add links to sample data, and to any relevant publications. --> |
| 92 | + |
| 93 | + |
| 94 | +- Imaging Data Commons [documentation](https://learn.canceridc.dev/) [portal](https://portal.imaging.datacommons.cancer.gov/explore/) |
| 95 | +- Preprint: ["In Search of Truth: Evaluating Concordance of AI-Based Anatomy Segmentation Models"](https://www.arxiv.org/pdf/2512.15921) |
| 96 | +- 3DSlicer [CrossSegmentationExplorer](https://github.com/ImagingDataCommons/CrossSegmentationExplorer) extension |
| 97 | +- This project is continuing earlier PW42 project [“Review of segmentation results quality across various multi-organ segmentation models”](https://projectweek.na-mic.org/PW42_2025_GranCanaria/Projects/ReviewOfSegmentationResultsQualityAcrossVariousMultiOrganSegmentationModels/) and PW43 project ["Evaluating concordance of AI-based anatomy segmentation models"](https://projectweek.na-mic.org/PW43_2025_Montreal/Projects/EvaluatingConcordanceOfAiBasedAnatomySegmentationModels/) |
| 98 | + |
0 commit comments