Difference between revisions of "Committee Procedures"

From QIBA Wiki
Jump to navigation Jump to search
 
(37 intermediate revisions by 4 users not shown)
Line 1: Line 1:
==Organizational Structure==
+
<font color="red">NOTICE: These instructions are accessible on the QIBA Wiki as a historical reference only! Independent Profile Authoring Groups are required to oversee the various developmental stages from Draft to Public Comment to Consensus based on the current QUIC endorsement criteria, found HERE:</font> https://qibawiki.rsna.org/images/9/95/QUIC-Review-Criteria-for-New-Profiles-FINAL-v23SEPT2023.pdf.
* '''Steering Committee''' is established by RSNA
 
** Responsible for managing the strategic direction, processes and inftrastructure for QIBA and overall oversight of the QIBA activities and committees.
 
* '''Modality Committees''' are established by the Steering Committee
 
** Responsible for coordinating modality areas of QIBA, and to formalize (i.e., vote, on) decisions when needed.
 
* '''Technical Committees''' are established by the Modality Committee
 
** Responsible for selecting biomarkers, drafting Profiles and protocols, and coordinating groundwork.
 
** '''Groundwork Committees''' are established by the Technical Committee as needed to carry out specific groundwork projects.
 
** '''Authoring Groups''' are established by a Technical Committee as needed to write Profiles and/or protocols.
 
  
  
==Committee Membership==
+
==Meeting Procedures==
* '''Steering Committee''' members are appointed by the RSNA.
+
The goal is group consensus and the input and endorsement of imaging community stakeholders on major decisions.
* '''Modality Committee''' members can be self-nominated, but must have participated in at least 50% of teleconferences during the previous 12 months. Retention of modality committee membership will require participation in at least 50% of teleconferences. Participation in teleconferences will be assessed on a rolling basis every 6 months. New members can be added to Modlality Committees every 6 months based on their participation in a tleast 50% of TC calls during the previous 12 months. The minimum level of teleconference participation is established by the Steering Committee and can be changed by the Steering Committee if it sees fit to do so.
 
* '''Technical, Groundwork and Authoring Committees''' are "open" committees
 
** '''"Open" committees''' are open to anyone with a relevant interest.
 
** '''Committee Co-Chairs''' can direct RSNA staff to add names to the roster.
 
** '''Groundwork Groups''' and '''Authoring Committees''' are typically volunteer subsets of their parent Technical Committee
 
* '''Rosters''' for each Technical Committee are posted on the Wiki.
 
  
 +
* When participation at a given meeting is not open to all committee members, (e.g., it takes place at an '''“invitation-only” face-to-face event and remote access is not provided for the committee meeting'''), that meeting '''will not be considered an official meeting''' of that committee.  No official decisions will be made and attendance will not count toward or against voting privileges.
 +
** The chair will need to ensure that attendance records are captured and submitted to the Profile Authoring Group members.
  
==Decision Making==
+
A record of committee decisions and rationale is necessary to be effective and learn.  
* Goal: group consensus and imaging community input and endorsement on major decisions.
+
* ''Profile Authoring Group scribe'' records minutes (call summaries) for meetings 
* Recorded vote required for procedural decisions
+
* ''Chairs'' are strongly encouraged to support Profile Authoring Group scribes by reviewing/correcting the draft minutes circulated 
** Key group decisions, such as public dissemination of documents, are subject to approval by Modality Committees
+
* ''Profile Authoring Group Chairs'' maintain '''[[Committees|rosters of the members of each committee]]''' and their participation.  Those details are used to determine which members currently have '''[[Voting Privileges]]'''
** Majority of participating members passes
+
** ''Members'' who believe their attendance record is in error should contact Profile Authoring Group Chairs.
** Negative votes must be discussed
 
* For recorded votes:
 
** Meeting attendee names and vote outcome will be recorded in minutes.
 
  
 +
==Voting==
 +
Most committee work doesn't need a vote.  At the discretion of committee chairs and members, however, decisions can be put to a vote during meetings.  This also facilitates recording key decisions in the minutes.
  
==Committee Functions==
+
* ''Chairs'' accept motions, seconds, discussion, and then call for a vote
 +
** At its simplest, the ''Chair'' asks for objections, then asks for abstentions, and "Profile Authoring Group scribe'' notes those names.  The rest of those present with voting privileges can safely be assumed to have voted in favor.
 +
* ''Members'' who have '''[[Voting Privileges]]''' count towards quorum and may vote.
 +
* ''Chairs'' resolve negative votes and large numbers of abstentions per the '''[[Committee Procedures#Consensus Process|consensus process]]'''
 +
** details of the resolution discussion in the minutes are desirable
 +
* ''Profile Authoring Group scribe'' records the motion, the tally of those against/abstaining/in-favor, and the details of negative votes in the minutes.
 +
** If attendance, eligibility and quorum cannot be determined during the meeting, vote results will be ratified after the call and entered into the minutes by the ''Profile Authoring Group scribe''.
  
*'''Steering Committee:'''
+
==Email Ballot==
**Manage Relationships and Optimize Communications
+
Substantive decisions, such as whether a Profile is advanced to the next stage, are put to ballot. This allows more deliberation on the subject material than a vote in committee.
***Create a collaborative, multidisciplinary environment that fosters communication among imaging groups and other medical disciplines involved in the research, approval, and use of quantitative imaging biomarkers (QIBs)
 
***Educate stakeholders about Profiles
 
***Provide content and administrative support of web sites/ Wikis
 
***Support face-to-face meetings
 
**Determine and Manage Process
 
***Develop ways of working, organizing, etc. across the various entities.
 
***Utilize principles from imaging science to undertand clinical image information content and utility.
 
***Adopt a statistically rigorous framework for determining and reducing sources of variation.
 
***Lay out a process for certification of compliance tot he Profile and how this relates to regulatory pathways.
 
**Coordinate Quantitative Imaging Biomarker Evaluation
 
***Evaluate clinical needs for biomarkers for each therapeutic area.
 
***Develop and maintain public infrastructure for biomarker-specific data and associated metadata.
 
***Oversee inputs and works-in-progress of teams; mantain scorecard.
 
**Influence Regulatory Pathways
 
***Clarify and optimize pathway for imaging biomarkers to become widely available.
 
***Develop process guidance with regulatory agencies inclusive of drug development and patient care.
 
***Plan and hold workshops with FDA.
 
**Explore Self-funded Models to Maintain Forward Progress
 
***Define what size adn scope of offort is sustainable and over what period of time.
 
  
*'''Modality Committees''' (Most of the this work is delegated to Technical Committees)
+
A committee may initiate an email ballot on a document by approving a motion to do so (i.e. officially deciding the document is ready for ballot).  Alternatively, Chairs may initiate email ballots at their own discretion after assuring appropriate discussion and review by the committee, and if there are multiple chairs then a simple majority of the chairs must approve the action.
**Based on the clinical context and needs, identify and prioritize biomarkers to pursue ("work item selection").
+
 
***Propose
+
* ''Chairs'' submit the ballot question and length of the ballot period to RSNA Staff
***Evaluate
+
** The ballot period may be specified by the particular procedure that calls for a ballot
***Approve
+
** The ballot period is generally not less than 14 days to allow adequate time to review the material and vote
**For each selected biomarker:
+
** If reviewing lengthy documents or collecting feedback within member organizations is involved 30 days is suggested for the ballot period
***Profile development
+
* ''Profile Authoring Group scribe'' emails the ballot to all members with '''[[Voting Privileges]]''' on the committee making the decision
****Production
+
* ''Profile Authoring Group scribe'' emails a notification of ineligibility to the rest of the members of the committee making the decision
****UPICT protocol
+
** Members who do not have Voting Privileges will thus be aware of the ballot and are still permitted to submit comments
****Provisional goals
+
** Members who believe their attendance record is in error can review of their attendance with the Profile Authoring Group scribe or Chairs, and if they are found to be eligible will be sent a ballot
****Draft and Review text
+
* ''Profile Authoring Group scribe'' compiles the ballot responses and comments for the Chairs
****Collect and Resolve Public Comment
+
** o At the discretion of the Chairs, comments submitted by non-voting members may be stricken
***Real world validation ("Field-testing")
+
* ''Chairs'' ratify the resulting tally and comments within a reasonable period of time (preferably in the next committee meeting) per the consensus process
****Approve
+
* ''Profile Authoring Group scribe'' records resolution results/rationale in the minutes
****Trial implementation
+
 
****Collectand Resolve feedback
+
==Quorum==
***Publication
+
For a vote or ballot to be valid, at least 50% of those with voting privileges must have participated (by either voting in favor, objecting, or abstaining).
****Prepare
+
 
****Approve
+
==Consensus Process==
****Publish
+
As a group setting standards on behalf of a community, the Profile Authoring Groups actively seek to pursue Consensus.
**Reference Object(s) and Support Material(s) for Experimentation and Quality Control (QC)
+
 
***Phantoms traceable to recognized physical standards
+
* a vote/ballot passes with a quorum of votes and a majority of votes in favor, but
***Digital Reference Objects (DRO)
+
** a '''negative vote or votes should result in subsequent discussion''' to
***Definition of comprehensive QC program, including data analysis and reporting requirements
+
*** '''understand the reason''' for such (a) negative vote(s) and '''attempt to find a compromise or resolution'''; associated edits to the document under ballot do not typically require re-balloting
**Identification of Technical Characteristics and Standards
+
** a '''large number of abstentions''' may also warrant discussion; it may indicate many people have:
***Assess intrinsic scanner variablity, minimum detectable change, and limits of quantification.
+
*** misgivings
***Identification and assessment of intra- and inter-reader bias and variance across scanners and centers.
+
*** not been able to adequately evaluate the question
**Clinical Performance Groundwork
+
 
***Develop a process map detailing steps to meet regulatory and payer requirements.
+
Participants concerned that a reasonable attempt at consensus has not been made should consider raising the issue with the chair(s) of the Profile Authoring Group.
***Perform studies necessary if literature does not fully support the process map. These may be retrospective or prospective (e.g.,assessment of intra- and inter-reader sensitivity and specificity for specific clinical utility).
+
 
**Clinical Efficacy Groundwork
+
==Profile Authoring Group Leadership==
***Characterize value in clinical trials
+
*Profile Authoring Groups are encouraged to have 2 or 3 leaders who are preferably drawn from diverse backgrounds (Researchers, Clinicians, Physicists, Vendors, Regulators, etc.) 
***Characterize value in clinical practice
+
** If not possible, groups are permitted to have some concentration but should discuss plans to expand the breadth of stakeholder representation at least annually
***Compare new biomarker and 'accepted-as-standard' method
 
***Develop/ merge databases from trials in support of achieving statistical power
 
**FDA Qualification
 
***Request letter
 
***Briefing document(s)
 
***Full data package
 
**Device Compliance
 
***Determine compliabce testing methods
 
****Acquisition
 
****Post-procesing
 
***Device version tracking
 
  
 
==See Also==
 
==See Also==
 
* [[Committees|QIBA Committees]]
 
* [[Committees|QIBA Committees]]

Latest revision as of 17:32, 19 January 2024

NOTICE: These instructions are accessible on the QIBA Wiki as a historical reference only! Independent Profile Authoring Groups are required to oversee the various developmental stages from Draft to Public Comment to Consensus based on the current QUIC endorsement criteria, found HERE: https://qibawiki.rsna.org/images/9/95/QUIC-Review-Criteria-for-New-Profiles-FINAL-v23SEPT2023.pdf.


Meeting Procedures

The goal is group consensus and the input and endorsement of imaging community stakeholders on major decisions.

  • When participation at a given meeting is not open to all committee members, (e.g., it takes place at an “invitation-only” face-to-face event and remote access is not provided for the committee meeting), that meeting will not be considered an official meeting of that committee. No official decisions will be made and attendance will not count toward or against voting privileges.
    • The chair will need to ensure that attendance records are captured and submitted to the Profile Authoring Group members.

A record of committee decisions and rationale is necessary to be effective and learn.

  • Profile Authoring Group scribe records minutes (call summaries) for meetings
  • Chairs are strongly encouraged to support Profile Authoring Group scribes by reviewing/correcting the draft minutes circulated
  • Profile Authoring Group Chairs maintain rosters of the members of each committee and their participation. Those details are used to determine which members currently have Voting Privileges
    • Members who believe their attendance record is in error should contact Profile Authoring Group Chairs.

Voting

Most committee work doesn't need a vote. At the discretion of committee chairs and members, however, decisions can be put to a vote during meetings. This also facilitates recording key decisions in the minutes.

  • Chairs accept motions, seconds, discussion, and then call for a vote
    • At its simplest, the Chair asks for objections, then asks for abstentions, and "Profile Authoring Group scribe notes those names. The rest of those present with voting privileges can safely be assumed to have voted in favor.
  • Members who have Voting Privileges count towards quorum and may vote.
  • Chairs resolve negative votes and large numbers of abstentions per the consensus process
    • details of the resolution discussion in the minutes are desirable
  • Profile Authoring Group scribe records the motion, the tally of those against/abstaining/in-favor, and the details of negative votes in the minutes.
    • If attendance, eligibility and quorum cannot be determined during the meeting, vote results will be ratified after the call and entered into the minutes by the Profile Authoring Group scribe.

Email Ballot

Substantive decisions, such as whether a Profile is advanced to the next stage, are put to ballot. This allows more deliberation on the subject material than a vote in committee.

A committee may initiate an email ballot on a document by approving a motion to do so (i.e. officially deciding the document is ready for ballot). Alternatively, Chairs may initiate email ballots at their own discretion after assuring appropriate discussion and review by the committee, and if there are multiple chairs then a simple majority of the chairs must approve the action.

  • Chairs submit the ballot question and length of the ballot period to RSNA Staff
    • The ballot period may be specified by the particular procedure that calls for a ballot
    • The ballot period is generally not less than 14 days to allow adequate time to review the material and vote
    • If reviewing lengthy documents or collecting feedback within member organizations is involved 30 days is suggested for the ballot period
  • Profile Authoring Group scribe emails the ballot to all members with Voting Privileges on the committee making the decision
  • Profile Authoring Group scribe emails a notification of ineligibility to the rest of the members of the committee making the decision
    • Members who do not have Voting Privileges will thus be aware of the ballot and are still permitted to submit comments
    • Members who believe their attendance record is in error can review of their attendance with the Profile Authoring Group scribe or Chairs, and if they are found to be eligible will be sent a ballot
  • Profile Authoring Group scribe compiles the ballot responses and comments for the Chairs
    • o At the discretion of the Chairs, comments submitted by non-voting members may be stricken
  • Chairs ratify the resulting tally and comments within a reasonable period of time (preferably in the next committee meeting) per the consensus process
  • Profile Authoring Group scribe records resolution results/rationale in the minutes

Quorum

For a vote or ballot to be valid, at least 50% of those with voting privileges must have participated (by either voting in favor, objecting, or abstaining).

Consensus Process

As a group setting standards on behalf of a community, the Profile Authoring Groups actively seek to pursue Consensus.

  • a vote/ballot passes with a quorum of votes and a majority of votes in favor, but
    • a negative vote or votes should result in subsequent discussion to
      • understand the reason for such (a) negative vote(s) and attempt to find a compromise or resolution; associated edits to the document under ballot do not typically require re-balloting
    • a large number of abstentions may also warrant discussion; it may indicate many people have:
      • misgivings
      • not been able to adequately evaluate the question

Participants concerned that a reasonable attempt at consensus has not been made should consider raising the issue with the chair(s) of the Profile Authoring Group.

Profile Authoring Group Leadership

  • Profile Authoring Groups are encouraged to have 2 or 3 leaders who are preferably drawn from diverse backgrounds (Researchers, Clinicians, Physicists, Vendors, Regulators, etc.)
    • If not possible, groups are permitted to have some concentration but should discuss plans to expand the breadth of stakeholder representation at least annually

See Also