Difference between revisions of "VolCT - Group 1B"

From QIBA Wiki
Jump to navigation Jump to search
(Add link to open access paper)
(47 intermediate revisions by 5 users not shown)
Line 1: Line 1:
 
==Current Goals & Status:==
 
==Current Goals & Status:==
  
−
* Question: What is measurement variation for different software/user methods for a reference set of image data?
+
''' Question''': What is the minimum detectable level of change in patient datasets under a “No Change” condition?
−
** Intra-rater reliability, i.e., test-retest precision for pre-specified tumors (a.k.a. "marked up") by single image analysis operators
+
** '''AIMS''': For patient datasets acquired over a very short time interval (“no change” condition”) investigate variance in measuring change in volume, diameter and bi-directional diameters of lesions
−
** Ground Truth:  Pooled from all image analyses meeting quality criteria to estimate confidence intervals around "true" volume.
+
** Investigate inter-observer variability in each task
−
** Approach: Patient Change Data from RIDER Database:
+
** Investigate Intra-observer variability in each task
−
*** > 300 cases as of Sept 2008
+
 
−
*** Most with multiple time points
+
** '''Methods - Materials'''
−
*** Few with thin slice (<1.5 mm thick) image data
+
*** Image Data from MSK Coffee Break Experiment
−
*** No contours provided (user has to provide their own as part of measurement)
+
*** 32 NSCLC patients, imaged twice on same scanner over period < 15 minutes
 +
*** Thin slice (1.25 mm thick) image data
 +
*** Selected one lesion per patient
 
*** no outcome data
 
*** no outcome data
 
*** Publicly Available on NCIA
 
*** Publicly Available on NCIA
 +
 +
** '''Methods - Readings'''
 +
*** 5 readers
 +
*** Read CT at timepoint 1, CT at timepoint 2 and repeat either CT timepoint 1 or timeoint 2 to assess intra-reader variability
 +
** '''Methods - Measurements'''
 +
*** Measure Single Longest Diameter, manually (SLD)
 +
*** Measure Longest Diameter and Perpendicular Diameter; take product to obtain Product of Diameters (POD)
 +
*** Contour Full Boundary of lesion with semiautomated tool; calculate volume (Vol)
 +
*** Extract other measures as well (SLD from POD measureement; SLD from VOl and POD from Vol).
 +
** The Order of Readers, Lesions and Measurement Methods were Randomized (Measurements done in Blocks of 10)
 +
 +
** ''' Analyses'''
 +
*** Pooled Analysis across readers and lesions; Percent Difference between Scan 1 and Scan 2 for each measurement method
 +
*** Subgroup Analyses: (a) Based on Measureable/Non-Measureable lesions identified by Mike O'Neal of CoreLabs; (b) Difficult, Moderate and Easy as Identified by Mike McNitt-Gray
 +
 +
* '''Progress Reports'''
 +
*[[Media:Update Group 1B 4-19-2011-Dr-McNitt-Gray.pdf|QIBA CT Volumetrics,Group 1B:(Patient Image Datasets), 4.19.2011 - Dr. McNitt-Gray]]
 +
 +
* '''Analysis Reports'''
 +
*[[Media:QIBA_Exp1B_CoffeeBreak_Descriptive_Statistics_24Sep10.pdf |Exp 1B Coffee Break Descriptive Statistics - 24Sep2010]]
 +
*[[Media:QIBA_Exp1B_CoffeeBreak_summary_Table_26Jan11_RECIST_Measureable_or_NOT.pdf‎ |QIBA_Exp1B_Coffee Break Summary Table_26Jan11_RECIST_Measureable_or_NOT]]
 +
*[[Media:QIBA_Exp1B_CoffeeBreak_Descriptive_Statistics_25Mar11_SUBJ_Assess_EZ_Mod_Diff.pdf‎ |Exp 1B Coffee Break Descriptive Statistics - 25Mar2011_Subjective Assessments_EZ_mod_diff]]**
 +
*[[Media:QIBA_Exp1B_CoffeeBreak_summaryTable_minmumDect_18Apr11.pdf‎|QIBA_Exp1B_CoffeeBreak_summaryTable_minimum Detectable Change_ 18Apr2011]]
 +
 +
* '''Methods Related Documents'''
 +
*[[Media:QIBA_Exp1B_CoffeeBreak_lesion_UCLA_detailsv3-2.xls‎‎‎|QIBA_Exp1b_Coffee_Break_List of lesions with coordinates and pictures]]
 +
*[[Media:Naming Convention QIBA 1B Experiment 2 26Aug09.xls|Naming Convention for the QIBA Group 1B Experiment and randomization scheme]]
 +
 +
*[[Vol-CT  - 1B Group Call Summaries]]
 +
 +
* '''Other Related Documents'''
 
* Related Profile: [[CT_Lung_Nodule_Volume_Quantification_Profile#Activity:_Measurement| Lung Vol Quantification - Measurement Activity]]
 
* Related Profile: [[CT_Lung_Nodule_Volume_Quantification_Profile#Activity:_Measurement| Lung Vol Quantification - Measurement Activity]]
  
−
*[[Vol-CT  - 1B Group Call Summaries]]
+
*[[Media:Proposed Group 1B Questions and Datasets 2008-2-10-Dr-McNitt-Gray.ppt|Proposed Group 1B Questions & Datases (2009-02-10) -- Feedback Welcome -- Dr. McNitt-Gray]]
−
*[[Media:Proposed_Group_1B_Questions_and_Datasets_2008-11-05v2.ppt|Proposed Group 1B Questions & Datasets (2008-11-05-v2) -- This is the powerpoint file that the 1B Group developed from our last conf call. Comments welcome - Mike]]
+
*[[Media:ACRIN 6678 QC Parmeters for CT Scan Measurements.pdf|ACRIN 6678 Quality Control Parameters for CT Scan Tumor Volumetric Measurements]]
 +
 
 +
* [https://web.archive.org/web/20110206162336/http://www.virtualscopics.com/pdf/ConferencePapers/Ashton_Manchester.pdf Conference Poster] on Reproducibility and Accuracy of Uni- and Bi-Dimensional Tumor Measurements from MRI and CT Volumes, which looks at RECIST, WHO and Volume measurements.
 +
 
 +
* '''Final Report'''
 +
*[http://dx.doi.org/10.1016/j.tranon.2015.01.001 McNitt-Gray et al. Determining the Variability of Lesion Size Measurements from CT Patient Data Sets Acquired under “No Change” Conditions]
 +
 
 +
==Downloadable Images and [[:Category:Datasets|Data Sets]]==
 +
===Round 2 Images and Results===
 +
*TCIA RIDER Lung CT Images - [https://wiki.cancerimagingarchive.net/display/Public/RIDER+Collections Collection Description] - [https://public.cancerimagingarchive.net/ncia/home.jsf Login, Search, Download] - (MSKCC Coffee Break) - Used as No Change Cases ''link posted 12.29.2012''
 +
*NBIA RIDER Pilot CT Images - [https://wiki.nci.nih.gov/display/CIP/RIDER Collection Description] - [https://imaging.nci.nih.gov/ncia/home.jsf Login, Search, Download] - Used as With Change Distractors ''link posted 12.29.2012''
 +
*[http://www.dclunie.com/data/QIBA_CT_1BR2_DICOM_results_20121229.tar.bz2 DICOM Result Files (SR,SEG,PR)] ''posted 12.29.2012''
 +
*[[Media:NOTES.TCIA.QIBA_CT_1BR2.release.doc| Release notes describing collection contents]] ''posted 12.29.2012''
 +
*[[Media:ClinicalTrialResults_20121229_QIBA.doc‎| Description of SR encoding template]] ''posted 12.29.2012''
 +
 
 +
*[[Media:UCLA_CoffeeBreak_lesion_detailsv3-2_May_2011.xls|Excel File describing "No Change" cases (filenames, slice location, x,y coordinates, etc.)]]
 +
*[[Media:QIBA_1B_clinical_workflow_change_lesions_v2.xls|Excel File describing "Change" cases (filenames, slice location, x,y coordinates, etc.)]]
 +
*[[Media:actualResults_allreaders_20120826.xls|Tabulated reader results]] ''version 08.12.2012'' ''posted 02.05.2013''
 +
 
 +
===Round 1 Images and Results===
 +
*[[Media:actualResults_tabulated_20100804.xls|Tabulated reader results]] ''version 08.04.2010'' ''posted 02.05.2013''

Revision as of 12:59, 29 September 2020

Current Goals & Status:

Question: What is the minimum detectable level of change in patient datasets under a “No Change” condition?

    • AIMS: For patient datasets acquired over a very short time interval (“no change” condition”) investigate variance in measuring change in volume, diameter and bi-directional diameters of lesions
    • Investigate inter-observer variability in each task
    • Investigate Intra-observer variability in each task
    • Methods - Materials
      • Image Data from MSK Coffee Break Experiment
      • 32 NSCLC patients, imaged twice on same scanner over period < 15 minutes
      • Thin slice (1.25 mm thick) image data
      • Selected one lesion per patient
      • no outcome data
      • Publicly Available on NCIA
    • Methods - Readings
      • 5 readers
      • Read CT at timepoint 1, CT at timepoint 2 and repeat either CT timepoint 1 or timeoint 2 to assess intra-reader variability
    • Methods - Measurements
      • Measure Single Longest Diameter, manually (SLD)
      • Measure Longest Diameter and Perpendicular Diameter; take product to obtain Product of Diameters (POD)
      • Contour Full Boundary of lesion with semiautomated tool; calculate volume (Vol)
      • Extract other measures as well (SLD from POD measureement; SLD from VOl and POD from Vol).
    • The Order of Readers, Lesions and Measurement Methods were Randomized (Measurements done in Blocks of 10)
    • Analyses
      • Pooled Analysis across readers and lesions; Percent Difference between Scan 1 and Scan 2 for each measurement method
      • Subgroup Analyses: (a) Based on Measureable/Non-Measureable lesions identified by Mike O'Neal of CoreLabs; (b) Difficult, Moderate and Easy as Identified by Mike McNitt-Gray
  • Conference Poster on Reproducibility and Accuracy of Uni- and Bi-Dimensional Tumor Measurements from MRI and CT Volumes, which looks at RECIST, WHO and Volume measurements.

Downloadable Images and Data Sets

Round 2 Images and Results

Round 1 Images and Results

Retrieved from "https://qibawiki.rsna.org/index.php?title=VolCT_-_Group_1B&oldid=16010"