Difference between revisions of "VolCT - Group 1B"
Jump to navigation
Jump to search
Mmcnittgray (talk | contribs) |
(Update links in Round 2 Images and Results to include new TCIA inclusion of results) |
||
| (40 intermediate revisions by 3 users not shown) | |||
| Line 1: | Line 1: | ||
==Current Goals & Status:== | ==Current Goals & Status:== | ||
| − | + | ''' Question''': What is the minimum detectable level of change in patient datasets under a “No Change” condition? | |
| − | ** AIMS: For patient datasets acquired over a very short time interval (“no change” condition”) investigate variance in measuring change in volume, diameter and bi-directional diameters of lesions | + | ** '''AIMS''': For patient datasets acquired over a very short time interval (“no change” condition”) investigate variance in measuring change in volume, diameter and bi-directional diameters of lesions |
** Investigate inter-observer variability in each task | ** Investigate inter-observer variability in each task | ||
** Investigate Intra-observer variability in each task | ** Investigate Intra-observer variability in each task | ||
| − | ** Methods - Materials | + | **'''Methods - Materials''' |
*** Image Data from MSK Coffee Break Experiment | *** Image Data from MSK Coffee Break Experiment | ||
*** 32 NSCLC patients, imaged twice on same scanner over period < 15 minutes | *** 32 NSCLC patients, imaged twice on same scanner over period < 15 minutes | ||
| Line 12: | Line 12: | ||
*** Selected one lesion per patient | *** Selected one lesion per patient | ||
*** no outcome data | *** no outcome data | ||
| − | *** Publicly Available on | + | *** Publicly Available on TCIA |
| − | ** Methods - Readings | + | ** '''Methods - Readings''' |
*** 5 readers | *** 5 readers | ||
*** Read CT at timepoint 1, CT at timepoint 2 and repeat either CT timepoint 1 or timeoint 2 to assess intra-reader variability | *** Read CT at timepoint 1, CT at timepoint 2 and repeat either CT timepoint 1 or timeoint 2 to assess intra-reader variability | ||
| − | ** Methods - Measurements | + | ** '''Methods - Measurements''' |
*** Measure Single Longest Diameter, manually (SLD) | *** Measure Single Longest Diameter, manually (SLD) | ||
*** Measure Longest Diameter and Perpendicular Diameter; take product to obtain Product of Diameters (POD) | *** Measure Longest Diameter and Perpendicular Diameter; take product to obtain Product of Diameters (POD) | ||
| Line 24: | Line 24: | ||
** The Order of Readers, Lesions and Measurement Methods were Randomized (Measurements done in Blocks of 10) | ** The Order of Readers, Lesions and Measurement Methods were Randomized (Measurements done in Blocks of 10) | ||
| − | ** Analyses | + | ** ''' Analyses''' |
*** Pooled Analysis across readers and lesions; Percent Difference between Scan 1 and Scan 2 for each measurement method | *** Pooled Analysis across readers and lesions; Percent Difference between Scan 1 and Scan 2 for each measurement method | ||
*** Subgroup Analyses: (a) Based on Measureable/Non-Measureable lesions identified by Mike O'Neal of CoreLabs; (b) Difficult, Moderate and Easy as Identified by Mike McNitt-Gray | *** Subgroup Analyses: (a) Based on Measureable/Non-Measureable lesions identified by Mike O'Neal of CoreLabs; (b) Difficult, Moderate and Easy as Identified by Mike McNitt-Gray | ||
| − | * Progress Reports | + | * '''Progress Reports''' |
| − | + | *[[Media:Update Group 1B 4-19-2011-Dr-McNitt-Gray.pdf|QIBA CT Volumetrics,Group 1B:(Patient Image Datasets), 4.19.2011 - Dr. McNitt-Gray]] | |
| − | * | ||
| + | * '''Analysis Reports''' | ||
| + | *[[Media:QIBA Exp1B CoffeeBreak Descriptive Statistics 24Sep10.pdf|Exp 1B Coffee Break Descriptive Statistics - 24Sep2010]] | ||
| + | *[[Media:QIBA Exp1B CoffeeBreak summary Table 26Jan11 RECIST Measureable or NOT.pdf|QIBA_Exp1B_Coffee Break Summary Table_26Jan11_RECIST_Measureable_or_NOT]] | ||
| + | *[[Media:QIBA Exp1B CoffeeBreak Descriptive Statistics 25Mar11 SUBJ Assess EZ Mod Diff.pdf|Exp 1B Coffee Break Descriptive Statistics - 25Mar2011_Subjective Assessments_EZ_mod_diff]]** | ||
| + | *[[Media:QIBA Exp1B CoffeeBreak summaryTable minmumDect 18Apr11.pdf|QIBA_Exp1B_CoffeeBreak_summaryTable_minimum Detectable Change_ 18Apr2011]] | ||
| − | * Related | + | * '''Methods Related Documents''' |
| + | *[[Media:QIBA Exp1B CoffeeBreak lesion UCLA detailsv3-2.xls|QIBA_Exp1b_Coffee_Break_List of lesions with coordinates and pictures]] | ||
| + | *[[Media:Naming Convention QIBA 1B Experiment 2 26Aug09.xls|Naming Convention for the QIBA Group 1B Experiment and randomization scheme]] | ||
*[[Vol-CT - 1B Group Call Summaries]] | *[[Vol-CT - 1B Group Call Summaries]] | ||
| − | *[[ | + | * '''Other Related Documents''' |
| − | + | * Related Profile: [[CT_Lung_Nodule_Volume_Quantification_Profile#Activity:_Measurement| Lung Vol Quantification - Measurement Activity]] | |
*[[Media:Proposed Group 1B Questions and Datasets 2008-2-10-Dr-McNitt-Gray.ppt|Proposed Group 1B Questions & Datases (2009-02-10) -- Feedback Welcome -- Dr. McNitt-Gray]] | *[[Media:Proposed Group 1B Questions and Datasets 2008-2-10-Dr-McNitt-Gray.ppt|Proposed Group 1B Questions & Datases (2009-02-10) -- Feedback Welcome -- Dr. McNitt-Gray]] | ||
*[[Media:ACRIN 6678 QC Parmeters for CT Scan Measurements.pdf|ACRIN 6678 Quality Control Parameters for CT Scan Tumor Volumetric Measurements]] | *[[Media:ACRIN 6678 QC Parmeters for CT Scan Measurements.pdf|ACRIN 6678 Quality Control Parameters for CT Scan Tumor Volumetric Measurements]] | ||
| − | * [http://www.virtualscopics.com/pdf/ConferencePapers/Ashton_Manchester.pdf Conference | + | * [https://web.archive.org/web/20110206162336/http://www.virtualscopics.com/pdf/ConferencePapers/Ashton_Manchester.pdf Conference Poster] on Reproducibility and Accuracy of Uni- and Bi-Dimensional Tumor Measurements from MRI and CT Volumes, which looks at RECIST, WHO and Volume measurements. |
| + | |||
| + | * '''Final Report''' | ||
| + | *[http://dx.doi.org/10.1016/j.tranon.2015.01.001 McNitt-Gray et al. Determining the Variability of Lesion Size Measurements from CT Patient Data Sets Acquired under “No Change” Conditions] | ||
| + | |||
| + | ==Downloadable Images and [[:Category:Datasets|Data Sets]]== | ||
| + | ===Round 2 Images and Results=== | ||
| + | *[https://www.cancerimagingarchive.net/ TCIA] - [https://wiki.cancerimagingarchive.net/display/Public/RIDER+Collections RIDER] [https://wiki.cancerimagingarchive.net/display/Public/RIDER+Lung+CT Lung CT Images] - (MSKCC Coffee Break) - Used as No Change Cases ''link posted 12.29.2012 updated 05.24.2023'' | ||
| + | *[https://www.cancerimagingarchive.net/ TCIA] (formerly at [https://wiki.nci.nih.gov/display/NBIA/NBIA+CBIIT+Instance+Retirement+Notice NBIA]) - [https://wiki.cancerimagingarchive.net/display/Public/RIDER+Collections RIDER] [https://wiki.cancerimagingarchive.net/display/Public/RIDER+Pilot Pilot CT Images] - Used as With Change Distractors ''link posted 12.29.2012 updated 05.24.2023'' | ||
| + | *[http://www.dclunie.com/data/QIBA_CT_1BR2_DICOM_results_20121229.tar.bz2 DICOM Result Files (SR,SEG,PR)] ''posted 12.29.2012'' - now also at [https://www.cancerimagingarchive.net/ TCIA] [https://wiki.cancerimagingarchive.net/pages/viewpage.action?pageId=70228818 QIBA VolCT Group 1B Round 2 No Change Size Measurements (QIBA-VolCT-1B)] ''posted 05.24.2023'' | ||
| + | *[[Media:NOTES.TCIA.QIBA CT 1BR2.release.doc| Release notes describing collection contents]] ''posted 12.29.2012'' | ||
| + | *[[Media:ClinicalTrialResults 20121229 QIBA.doc| Description of SR encoding template]] ''posted 12.29.2012'' | ||
| − | *[[Media: | + | *[[Media:UCLA CoffeeBreak lesion detailsv3-2 May 2011.xls|Excel File describing "No Change" cases (filenames, slice location, x,y coordinates, etc.)]] |
| + | *[[Media:QIBA 1B clinical workflow change lesions v2.xls|Excel File describing "Change" cases (filenames, slice location, x,y coordinates, etc.)]] | ||
| + | *[[Media:ActualResults allreaders 20120826.xls|Tabulated reader results]] ''version 08.12.2012'' ''posted 02.05.2013'' | ||
| − | *[[Media: | + | ===Round 1 Images and Results=== |
| + | *[[Media:ActualResults tabulated 20100804.xls|Tabulated reader results]] ''version 08.04.2010'' ''posted 02.05.2013'' | ||
Latest revision as of 10:53, 24 May 2023
Current Goals & Status:
Question: What is the minimum detectable level of change in patient datasets under a “No Change” condition?
- AIMS: For patient datasets acquired over a very short time interval (“no change” condition”) investigate variance in measuring change in volume, diameter and bi-directional diameters of lesions
- Investigate inter-observer variability in each task
- Investigate Intra-observer variability in each task
- Methods - Materials
- Image Data from MSK Coffee Break Experiment
- 32 NSCLC patients, imaged twice on same scanner over period < 15 minutes
- Thin slice (1.25 mm thick) image data
- Selected one lesion per patient
- no outcome data
- Publicly Available on TCIA
- Methods - Materials
- Methods - Readings
- 5 readers
- Read CT at timepoint 1, CT at timepoint 2 and repeat either CT timepoint 1 or timeoint 2 to assess intra-reader variability
- Methods - Measurements
- Measure Single Longest Diameter, manually (SLD)
- Measure Longest Diameter and Perpendicular Diameter; take product to obtain Product of Diameters (POD)
- Contour Full Boundary of lesion with semiautomated tool; calculate volume (Vol)
- Extract other measures as well (SLD from POD measureement; SLD from VOl and POD from Vol).
- The Order of Readers, Lesions and Measurement Methods were Randomized (Measurements done in Blocks of 10)
- Methods - Readings
- Analyses
- Pooled Analysis across readers and lesions; Percent Difference between Scan 1 and Scan 2 for each measurement method
- Subgroup Analyses: (a) Based on Measureable/Non-Measureable lesions identified by Mike O'Neal of CoreLabs; (b) Difficult, Moderate and Easy as Identified by Mike McNitt-Gray
- Analyses
- Analysis Reports
- Exp 1B Coffee Break Descriptive Statistics - 24Sep2010
- QIBA_Exp1B_Coffee Break Summary Table_26Jan11_RECIST_Measureable_or_NOT
- Exp 1B Coffee Break Descriptive Statistics - 25Mar2011_Subjective Assessments_EZ_mod_diff**
- QIBA_Exp1B_CoffeeBreak_summaryTable_minimum Detectable Change_ 18Apr2011
- Methods Related Documents
- QIBA_Exp1b_Coffee_Break_List of lesions with coordinates and pictures
- Naming Convention for the QIBA Group 1B Experiment and randomization scheme
- Other Related Documents
- Related Profile: Lung Vol Quantification - Measurement Activity
- Proposed Group 1B Questions & Datases (2009-02-10) -- Feedback Welcome -- Dr. McNitt-Gray
- ACRIN 6678 Quality Control Parameters for CT Scan Tumor Volumetric Measurements
- Conference Poster on Reproducibility and Accuracy of Uni- and Bi-Dimensional Tumor Measurements from MRI and CT Volumes, which looks at RECIST, WHO and Volume measurements.
Downloadable Images and Data Sets
Round 2 Images and Results
- TCIA - RIDER Lung CT Images - (MSKCC Coffee Break) - Used as No Change Cases link posted 12.29.2012 updated 05.24.2023
- TCIA (formerly at NBIA) - RIDER Pilot CT Images - Used as With Change Distractors link posted 12.29.2012 updated 05.24.2023
- DICOM Result Files (SR,SEG,PR) posted 12.29.2012 - now also at TCIA QIBA VolCT Group 1B Round 2 No Change Size Measurements (QIBA-VolCT-1B) posted 05.24.2023
- Release notes describing collection contents posted 12.29.2012
- Description of SR encoding template posted 12.29.2012
- Excel File describing "No Change" cases (filenames, slice location, x,y coordinates, etc.)
- Excel File describing "Change" cases (filenames, slice location, x,y coordinates, etc.)
- Tabulated reader results version 08.12.2012 posted 02.05.2013
Round 1 Images and Results
- Tabulated reader results version 08.04.2010 posted 02.05.2013