Difference between revisions of "Review Process"

From QIBA Wiki
Jump to navigation Jump to search
m
 
(18 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 +
[[Image:QIBA_WIKI_BLURB.jpg|600px]]
 +
 +
 
__NOTOC__
 
__NOTOC__
Prior to publishing a Public Comment Profile, a Consensus Profile, a Technically Confirmed Profile, Claim Confirmed Profile or a Clinically Confirmed Profile:
+
Profiles are reviewed/approved by their parent Profile Authoring Group at [[QIBA Profile Stages|each Stage]]:
* The process steps for review and approval do not differ depending on the stage
+
* The review/approval steps are the same for each stage, but the '''[[QIBA Profile Stages|criteria differ]]'''  
* '''[[QIBA Profile Stages|The criteria do differ depending on the stage]]'''
+
* The '''[[Public Comment Process|Public Comment Review]]''' is another process that specifically covers soliciting and resolving comments that can come from beyond the Committee.
  
  
 
Remember, this is the QA point for your work.  It doesn't have to be perfect.  '''It does have to be good'''.
 
Remember, this is the QA point for your work.  It doesn't have to be perfect.  '''It does have to be good'''.
  
==Review (Biomarker Committee)==
+
==Review (Profile Authoring Group)==
The following review process is strongly recommended, but Biomarker Committees are not required to follow this specific process.
+
The following review process is strongly recommended, but Profile Authoring Groups are not required to follow this specific process.
* Authors/Editor of the Profile request content review once they feel work on the current stage has been completed
+
* ''Editor'' of the Profile requests content review once they feel work on the current stage has been completed
* Biomarker Committee assigns/'''recruits reviewers''' for Profile sections
+
* ''Profile Authoring Group'' assigns/'''recruits reviewers''' for Profile sections
 
** Ideally each section should be covered by more than one reviewer
 
** Ideally each section should be covered by more than one reviewer
 
** Reviewing assignments can be divided up any way that is convenient
 
** Reviewing assignments can be divided up any way that is convenient
 
** It is helpful to have some reviewers read through the profile in its entirety (finds inconsistencies/gaps)
 
** It is helpful to have some reviewers read through the profile in its entirety (finds inconsistencies/gaps)
* Reviewers check the Profile meets the '''[[QIBA Profile Stages|criteria for the stage]]''' as well as '''[[How_to_Write_a_Profile#Follow_Profile_Writing_Guidelines|guidelines for clarity/quality]]'''  
+
* ''Reviewers'' check the Profile meets the '''[[QIBA Profile Stages|criteria for the stage]]''' as well as '''[[How_to_Write_a_Profile#Follow_Profile_Writing_Guidelines|guidelines for clarity/quality]]'''  
 
** A two week window for the reviewers to do their work is suggested
 
** A two week window for the reviewers to do their work is suggested
* Reviewers '''report back''' to the Biomarker Committee
+
* ''Reviewers'' '''report back''' to the Profile Authoring Group
* The Authors and Biomarker Committee resolve any questions/comments/clarifications raised by the reviewers
+
* ''Authors and Profile Authoring Group'' resolve any questions/comments/clarifications raised by the reviewers
 
+
* ''Co-chair'' accepts a motion to send the document to ballot
 
 
==Approve (Biomarker Committee)==
 
The main purpose of Biomarker Committee approval is to confirm that all the detailed contents are correct and the profile meets the criteria for the stage.
 
* The Secretariat circulates a '''[[Balloting Process|Ballot]]''' asking Biomarker Committee members to approve that the content of the Profile meets the '''[[QIBA Profile Stages|criteria for the stage]]'''
 
** Generally the ballot period should be 2-4 weeks to allow time to review the full Profile text
 
** In the case of approving to publish for Public Comment, it is acceptable to instead hold a vote during a committee meeting.
 
  
 +
==Approve (Profile Authoring Group)==
 +
The main purpose of '''Profile Authoring Group''' approval is to '''confirm that all the detailed contents are correct, and the Profile meets the criteria''' for the stage.
  
==Approve (Coordinating Committee)==
+
* ''Profile Authoring Group'' submits the '''Profile document''' and, if approving for a stage after Public Comment, the '''[[QIBA Profile Stages|supporting document for that stage]]'''
The main purpose of Coordinating Committee approval is to confirm that the profile is hitting the intended mark (e.g. the claim is on target) and to bring fresh eyes to the overall document (it is understandable, unburdensome and likely to be effective).
+
* ''Profile Authoring Group'' circulates a '''[[Committee_Procedures#Email_Ballot|Ballot]]''' asking Profile Authoring Group members to approve that the content of the '''Profile meets the [[QIBA Profile Stages|criteria for the stage]]'''
* The Biomarker Committee provides the details of the BC ballot (highlighting any unresolved ballot comments) and requests approval to publish from the Coordinating Committee
+
** The Profile document and supporting document are attached to or linked from the ballot
** Note that some Coordinating Committees only meet once every several months so the Biomarker Committee is advised to check on that to avoid missing a window
+
** The ballot period should be 2-5 weeks (typically 30 days) to allow time to review the full Profile text
* The Coordinating Committee puts on an upcoming meeting agenda a '''[[Voting Process|Vote]]''' in committee asking members to approve the Profile for publication.
+
** In the case of approving to publish for Public Comment, it is acceptable to instead hold a vote during a meeting.
** Since there is a lengthy document involved, the agenda notification should be circulated at least 2 weeks before the meeting.
+
* ''Profile Authoring Group members'' review the profile and supporting document and confirm '''Profile meets the [[QIBA Profile Stages|criteria for the stage]]'''
** The Coordinating Committee may choose to do a [[Balloting Process|ballot]] if that would be faster than waiting for the next meeting
+
* ''Profile Authoring Group'' reviews and ratifies the '''[[Committee_Procedures#Email_Ballot|Ballot]]''' results
 +
* ''Profile Authoring Group'' reviews any contentious ballot comment resolutions

Latest revision as of 17:37, 19 January 2024

QIBA WIKI BLURB.jpg


Profiles are reviewed/approved by their parent Profile Authoring Group at each Stage:

  • The review/approval steps are the same for each stage, but the criteria differ
  • The Public Comment Review is another process that specifically covers soliciting and resolving comments that can come from beyond the Committee.


Remember, this is the QA point for your work. It doesn't have to be perfect. It does have to be good.

Review (Profile Authoring Group)

The following review process is strongly recommended, but Profile Authoring Groups are not required to follow this specific process.

  • Editor of the Profile requests content review once they feel work on the current stage has been completed
  • Profile Authoring Group assigns/recruits reviewers for Profile sections
    • Ideally each section should be covered by more than one reviewer
    • Reviewing assignments can be divided up any way that is convenient
    • It is helpful to have some reviewers read through the profile in its entirety (finds inconsistencies/gaps)
  • Reviewers check the Profile meets the criteria for the stage as well as guidelines for clarity/quality
    • A two week window for the reviewers to do their work is suggested
  • Reviewers report back to the Profile Authoring Group
  • Authors and Profile Authoring Group resolve any questions/comments/clarifications raised by the reviewers
  • Co-chair accepts a motion to send the document to ballot

Approve (Profile Authoring Group)

The main purpose of Profile Authoring Group approval is to confirm that all the detailed contents are correct, and the Profile meets the criteria for the stage.

  • Profile Authoring Group submits the Profile document and, if approving for a stage after Public Comment, the supporting document for that stage
  • Profile Authoring Group circulates a Ballot asking Profile Authoring Group members to approve that the content of the Profile meets the criteria for the stage
    • The Profile document and supporting document are attached to or linked from the ballot
    • The ballot period should be 2-5 weeks (typically 30 days) to allow time to review the full Profile text
    • In the case of approving to publish for Public Comment, it is acceptable to instead hold a vote during a meeting.
  • Profile Authoring Group members review the profile and supporting document and confirm Profile meets the criteria for the stage
  • Profile Authoring Group reviews and ratifies the Ballot results
  • Profile Authoring Group reviews any contentious ballot comment resolutions