Difference between revisions of "Public Comment Process"

From QIBA Wiki
Jump to navigation Jump to search
(33 intermediate revisions by 3 users not shown)
Line 1: Line 1:
Public Comment is intended to allow both regular participants in QIBA Activities and also those who don't have the time to dedicate to regular participation to contribute their thoughts on proposed specifications.  Comments are accepted from all.
+
Public Comment is intended to allow both regular participants in QIBA Activities and also those who don't have the time to dedicate to regular participation a chance to contribute their thoughts on proposed specifications before they are formally releasedIt's also an excellent chance to engage relevant stakeholder individuals and organizations. Comments are accepted from all.
  
A procedure is outlined below listing what is done (by whom).
+
NOTE: ''If you receive few or no public comments, that's a'' '''bad sign.'''  Presuming we didn't hit perfection on the first try, it means we didn't convince people it was important enough to read in any great detail.  That bodes poorly for our ability to convince people it is important enough to read and conform to.  Good outreach is a significant part of Public Comment.  It's our first stage at marketing the Profile.
  
Period: 30 days
 
  
* Post PC draft of Document on the Wiki (author/secretariat)
+
Period: 30 days (may be longer at the discretion of the committee)
* Send announcement to mailing lists (secretariat)
+
 
** detail location of document, period of comment, method of submission
+
* ''Biomarker Committee'' '''[[Review Process|reviews and approves for public comment]]'''
* Email comments to secretariat (Commenters)
+
* ''Editor'' tidies up PC draft (e.g. "accept all changes" in Word) and submits to RSNA Staff
** Helpful to have a form ''<<borrow from IHE and insert link here to the form>>''
+
* ''RSNA Staff'' '''[[Publication Process|publishes PC draft]]'''
** commenters include committee members, other QIBA People, external bodies
+
* The Profile has now reached the [[QIBA Profile Stages|Public Comment Stage]]. Work toward [[QIBA Profile Stages|Consensus]] begins.
 +
 
 +
 
 +
* ''RSNA Staff'' sends PC announcement to mailing lists
 +
** detail location of document to be reviewed, deadline for comment submission, method of submission
 +
** provide a link to the [http://tinyurl.com/QIBA-Public-Comment-Form QIBA Public Comment Form]
 +
** reach out to any organizations and individuals that might have and interest or expertise to contribute
 +
* ''Commenters'' submit comments to RSNA Staff (via web form or emailed comment form)
 +
** commenters include committee members, other QIBA people, external bodies
 
** this is the key point for asynchronous engagement
 
** this is the key point for asynchronous engagement
* Collate all comments into a spreadsheet (secretariat/author)
+
** please use the comment forms; it saves the Editor having to transcribe your comments
** sort by line number and severity (H is group discussion, M, also, L is author call)
+
 
* Review comments (profile writing committee)
+
 
** walk through document
+
* ''RSNA Staff/editor'' collate all comments into a resolution spreadsheet (see [https://docs.google.com/spreadsheets/d/1o3_ssHHIABGKNesUJ_-jL5RYqSx9Eq4o6C2dlIsHQo4/edit?usp=sharing Google Sheet template] or '''[[:Media:QIBA_Public_Comment_Template-2011.01.doc | Word table]]'''
** each comment may be
+
** sort by line number and priority (Low/Med/High)
*** accepted, change made as requested
+
** re-title the leftmost column from "Leave Blank" to "#"
*** rejected, (document reason, e.g. out of scope,  
+
** fill the leftmost column with incrementing numbers.  Now you can refer to "Comment #43", or re-sort the table if you like
*** adapted, accepted but resolved differently than proposed
+
** re-title the rightmost column from "Leave Blank" to "Resolution"
* Record resolution in spreadsheet
+
* ''Editor'' resolves comments with priority Low
 +
** turn on Change Tracking in Word
 +
** for most Low comments (typos), fix it in the Profile document and enter "Done" in the Resolution column of the resolution table
 +
** if any Low comments prove problematic, elevate to Med
 +
* ''Biomarker Committee'' reviews Med & High comments
 +
** step through the resolution table
 +
** each comment may be:
 +
*** accepted = proposed text accepted as is
 +
*** rejected = committee does not agree with issue (document reason, e.g. out of scope, )
 +
*** resolved = issue accepted but resolved differently than proposed
 +
** consider getting a 3-person sub-committee to take a first pass at this and focus the full committee on items needing discussion
 +
* ''Editor'' records decision and explanation (as needed) in the Resolution column of the resolution table/spreadsheet
 +
** The Google template includes a status column with codewords to track completion progress.
 +
 
 +
 
 +
* ''RSNA Staff'' posts resolution spreadsheet and change-tracked Profile Document on the Wiki
 +
** This helps people review the resolution of their comments and the changes that resulted from the Public Comment process
 +
* ''Biomarker Committee'' [[Review Process|reviews and approves as Consensus]]
 +
* ''Modality Coordination Committee'' [[Review Process|reviews and approves as Consensus]]
 +
* ''Editor'' tidies up Consensus draft (e.g. "accept all changes" in Word) and submits to RSNA Staff
 +
* ''RSNA Staff'' '''[[Publication Process|publishes Consensus draft]]'''
 +
* The Profile has now reached the [[QIBA Profile Stages|Consensus Stage]].

Revision as of 16:43, 9 July 2019

Public Comment is intended to allow both regular participants in QIBA Activities and also those who don't have the time to dedicate to regular participation a chance to contribute their thoughts on proposed specifications before they are formally released. It's also an excellent chance to engage relevant stakeholder individuals and organizations. Comments are accepted from all.

NOTE: If you receive few or no public comments, that's a bad sign. Presuming we didn't hit perfection on the first try, it means we didn't convince people it was important enough to read in any great detail. That bodes poorly for our ability to convince people it is important enough to read and conform to. Good outreach is a significant part of Public Comment. It's our first stage at marketing the Profile.


Period: 30 days (may be longer at the discretion of the committee)


  • RSNA Staff sends PC announcement to mailing lists
    • detail location of document to be reviewed, deadline for comment submission, method of submission
    • provide a link to the QIBA Public Comment Form
    • reach out to any organizations and individuals that might have and interest or expertise to contribute
  • Commenters submit comments to RSNA Staff (via web form or emailed comment form)
    • commenters include committee members, other QIBA people, external bodies
    • this is the key point for asynchronous engagement
    • please use the comment forms; it saves the Editor having to transcribe your comments


  • RSNA Staff/editor collate all comments into a resolution spreadsheet (see Google Sheet template or Word table
    • sort by line number and priority (Low/Med/High)
    • re-title the leftmost column from "Leave Blank" to "#"
    • fill the leftmost column with incrementing numbers. Now you can refer to "Comment #43", or re-sort the table if you like
    • re-title the rightmost column from "Leave Blank" to "Resolution"
  • Editor resolves comments with priority Low
    • turn on Change Tracking in Word
    • for most Low comments (typos), fix it in the Profile document and enter "Done" in the Resolution column of the resolution table
    • if any Low comments prove problematic, elevate to Med
  • Biomarker Committee reviews Med & High comments
    • step through the resolution table
    • each comment may be:
      • accepted = proposed text accepted as is
      • rejected = committee does not agree with issue (document reason, e.g. out of scope, )
      • resolved = issue accepted but resolved differently than proposed
    • consider getting a 3-person sub-committee to take a first pass at this and focus the full committee on items needing discussion
  • Editor records decision and explanation (as needed) in the Resolution column of the resolution table/spreadsheet
    • The Google template includes a status column with codewords to track completion progress.