Difference between revisions of "Assessment Procedure Guidance"

From QIBA Wiki
Jump to navigation Jump to search
Line 1: Line 1:
'''Current Document :''' [[Media:AssessmentProcedureGuidance-2018.04.03.docx|QIBA Assessment Procedure Guidance]] ''2018.04.03'' DRAFT
+
'''Current Document :''' [[Media:AssessmentProcedureGuidance-2019.03.05.docx|QIBA Assessment Procedure Guidance]] ''2019.03.05''
  
 
This Guidance supplements the [[QIBA Profile Template]] and the [[Claim Guidance]] by describing the process of developing appropriate procedures to assess profile requirements, particularly those related to the statistical assumptions underlying the claim (e.g. the repeatability coefficient for the volumes generated by the tumor segmentation software).
 
This Guidance supplements the [[QIBA Profile Template]] and the [[Claim Guidance]] by describing the process of developing appropriate procedures to assess profile requirements, particularly those related to the statistical assumptions underlying the claim (e.g. the repeatability coefficient for the volumes generated by the tumor segmentation software).
Line 6: Line 6:
 
===Suggestions===
 
===Suggestions===
 
Submit suggested improvements/gaps in this document by adding bullets here:
 
Submit suggested improvements/gaps in this document by adding bullets here:
:*
+
:* Section 2 would benefit from more examples from other biomarker groups
 +
:* In the Site Assessment Datasets section:
 +
::* Consider referencing the Metrology papers for more detail. Perhaps some discussion of "study design" for a test-retest dataset on humans.
 +
::* Consider expressing some material in this subsection as a table of characteristics and pros and cons for different types of datasets. Precision, Bias, Linearity and Regression Slope assessments will prioritize some of the characteristics differently, leading to different conclusions.
 +
::* Consider laying out some of the relevant considerations/rationales for the mentioned "judgement call" and perhaps cite some papers that have made one choice or another as instructive examples.
  
 
They will be reviewed by the Process Committee and addressed in upcoming versions.
 
They will be reviewed by the Process Committee and addressed in upcoming versions.
  
 
===Past Versions===
 
===Past Versions===
 +
*
 +
*[[Media:AssessmentProcedureGuidance-2018.04.03.docx|QIBA Assessment Procedure Guidance]] ''2018.04.03''
 
*[[Media:AssessmentProcedureGuidance-2018.03.06bNO.docx|QIBA Assessment Procedure Guidance]] ''2018.03.06''
 
*[[Media:AssessmentProcedureGuidance-2018.03.06bNO.docx|QIBA Assessment Procedure Guidance]] ''2018.03.06''
 
*[[Media:AssessmentProcedureGuidance-2018.02.20.docx|QIBA Assessment Procedure Guidance]] ''2018.02.20''
 
*[[Media:AssessmentProcedureGuidance-2018.02.20.docx|QIBA Assessment Procedure Guidance]] ''2018.02.20''

Revision as of 01:56, 19 February 2021

Current Document : QIBA Assessment Procedure Guidance 2019.03.05

This Guidance supplements the QIBA Profile Template and the Claim Guidance by describing the process of developing appropriate procedures to assess profile requirements, particularly those related to the statistical assumptions underlying the claim (e.g. the repeatability coefficient for the volumes generated by the tumor segmentation software).


Suggestions

Submit suggested improvements/gaps in this document by adding bullets here:

  • Section 2 would benefit from more examples from other biomarker groups
  • In the Site Assessment Datasets section:
  • Consider referencing the Metrology papers for more detail. Perhaps some discussion of "study design" for a test-retest dataset on humans.
  • Consider expressing some material in this subsection as a table of characteristics and pros and cons for different types of datasets. Precision, Bias, Linearity and Regression Slope assessments will prioritize some of the characteristics differently, leading to different conclusions.
  • Consider laying out some of the relevant considerations/rationales for the mentioned "judgement call" and perhaps cite some papers that have made one choice or another as instructive examples.

They will be reviewed by the Process Committee and addressed in upcoming versions.

Past Versions