Difference between revisions of "Committee Procedures"

From QIBA Wiki
Jump to navigation Jump to search
(29 intermediate revisions by 4 users not shown)
Line 1: Line 1:
==Organizational Structure==
 
* '''Steering Committee''' is established by RSNA
 
** Responsible for managing the strategic direction, processes and inftrastructure for QIBA and overall oversight of the QIBA activities and committees.
 
* '''Modality Committees''' are established by the Steering Committee
 
** Responsible for coordinating modality areas of QIBA, and to formalize (i.e., vote, on) decisions when needed.
 
* '''Technical Committees''' are established by the Modality Committee
 
** Responsible for selecting biomarkers, drafting Profiles and protocols, and coordinating groundwork.
 
** '''Groundwork Committees''' are established by the Technical Committee as needed to carry out specific groundwork projects.
 
** '''Authoring Groups''' are established by a Technical Committee as needed to write Profiles and/or protocols.
 
  
 +
==Meeting Procedures==
 +
The goal is group consensus and the input and endorsement of imaging community stakeholders on major decisions.
  
==Committee Membership==
+
* When participation at a given meeting is not open to all committee members, (e.g. it takes place at an '''“invitation-only” face-to-face event and remote access is not provided for the committee meeting'''), that meeting '''will not be considered an official meeting''' of that committee. No official decisions will be made and attendance will not count toward or against voting privileges.  
* '''Steering Committee''' members are appointed by the RSNA.
+
** Typically, RSNA staff are present at meetings and capturing attendance.  If staff is not present, the chair will need to ensure that attendance records are captured and submitted to RSNA staff.
* '''Modality Committee''' members can be self-nominated, but must have participated in at least 50% of teleconferences during the previous 12 months. Retention of modality committee membership will require participation in at least 50% of teleconferences. Participation in teleconferences will be assessed on a rolling basis every 6 months. New members can be added to Modlality Committees every 6 months based on their participation in a tleast 50% of TC calls during the previous 12 months. The minimum level of teleconference participation is established by the Steering Committee and can be changed by the Steering Committee if it sees fit to do so.
+
** If possible, it is still desirable for minutes to be recorded, but the unofficial status will be noted
* '''Technical, Groundwork and Authoring Committees''' are "open" committees
 
** '''"Open" committees''' are open to anyone with a relevant interest.
 
** '''Committee Co-Chairs''' can direct RSNA staff to add names to the roster.
 
** '''Groundwork Groups''' and '''Authoring Committees''' are typically volunteer subsets of their parent Technical Committee
 
* '''Rosters''' for each Technical Committee are posted on the Wiki.
 
  
 +
A record of committee decisions and rationale is necessary to be effective and learn.
 +
* ''RSNA Staff'' records minutes (call summaries) for meetings of Committees (but not Task Forces)
 +
* ''Chairs'' are strongly encouraged to support RSNA Staff by reviewing/correcting the draft minutes circulated by RSNA Staff
 +
* ''RSNA Staff'' maintains '''[[Committees|rosters of the members of each committee]]''' and their participation.  Those details are used to determine which members currently have '''[[Voting Privileges]]'''
 +
** ''Members'' who believe their attendance record is in error should contact RSNA Staff
  
==Decision Making==
+
==Voting==
* Goal: group consensus and imaging community input and endorsement on major decisions.
+
Most committee work doesn't need a vote.  At the discretion of committee chairs and members, however, decisions can be put to a vote during meetings.  This also facilitates recording key decisions in the minutes.
* Recorded vote required for procedural decisions
 
** Key group decisions, such as public dissemination of documents, are subject to approval by Modality Committees
 
** Majority of participating members passes
 
** Negative votes must be discussed
 
* For recorded votes:
 
** Meeting attendee names and vote outcome will be recorded in minutes.
 
  
 +
* ''Chairs'' accept motions, seconds, discussion, and then call for a vote
 +
** At its simplest, the ''Chair'' asks for objections, then asks for abstentions, and "RSNA Staff'' notes those names.  The rest of those present with voting privileges can safely be assumed to have voted in favor
 +
* ''Members'' who have '''[[Voting Privileges]]''' count towards quorum and may vote
 +
* ''Chairs'' resolve negative votes and large numbers of abstentions per the '''[[Committee Procedures#Consensus Process|consensus process]]'''
 +
** details of the resolution discussion in the minutes is desirable
 +
* ''RSNA Staff'' records the motion, the tally of those against/abstaining/in-favor, and the details of negative votes in the minutes
 +
** If attendance, eligibility and quorum cannot be determined during the meeting, vote results will be ratified after the call and entered into the minutes by ''RSNA Staff''
  
==Committee Functions==
+
==Email Ballot==
 +
Substantive decisions, such as whether a Profile is advanced to the next stage, are put to ballot. This allows more deliberation on the subject material than a vote in committee.
  
*'''Steering Committee:'''
+
A committee may initiate an email ballot on a document by approving a motion to do so (i.e. officially deciding the document is ready for ballot). Alternatively, Chairs may initiate email ballots at their own discretion after assuring appropriate discussion and review by the committee, and if there are multiple chairs then a simple majority of the chairs must approve the action.
**Manage Relationships and Optimize Communications
 
***Create a collaborative, multidisciplinary environment that fosters communication among imaging groups and other medical disciplines involved in the research, approval, and use of quantitative imaging biomarkers (QIBs)
 
***Educate stakeholders about Profiles
 
***Provide content and administrative support of web sites/ Wikis
 
***Support face-to-face meetings
 
**Determine and Manage Process
 
***Develop ways of working, organizing, etc. across the various entities.
 
***Utilize principles from imaging science to undertand clinical image information content and utility.
 
***Adopt a statistically rigorous framework for determining and reducing sources of variation.
 
***Lay out a process for certification of compliance tot he Profile and how this relates to regulatory pathways.
 
**Coordinate Quantitative Imaging Biomarker Evaluation
 
***Evaluate clinical needs for biomarkers for each therapeutic area.
 
***Develop and maintain public infrastructure for biomarker-specific data and associated metadata.
 
***Oversee inputs and works-in-progress of teams; mantain scorecard.
 
**Influence Regulatory Pathways
 
***Clarify and optimize pathway for imaging biomarkers to become widely available.
 
***Develop process guidance with regulatory agencies inclusive of drug development and patient care.
 
***Plan and hold workshops with FDA.
 
**Explore Self-funded Models to Maintain Forward Progress
 
***Define what size adn scope of offort is sustainable and over what period of time.
 
  
*'''Modality Committees''' (Most of the this work is delegated to Technical Committees)
+
* ''Chairs'' submit the ballot question and length of the ballot period to RSNA Staff
**Based on the clinical context and needs, identify and prioritize biomarkers to pursue ("work item selection").
+
** The ballot period may be specified by the particular procedure that calls for a ballot
***Propose
+
** The ballot period is generally not less than 14 days to allow adequate time to review the material and vote
***Evaluate
+
** If reviewing lengthy documents or collecting feedback within member organizations is involved 30 days is suggested for the ballot period
***Approve
+
* ''RSNA Staff'' emails the ballot to all members with '''[[Voting Privileges]]''' on the committee making the decision
**For each selected biomarker:
+
* ''RSNA Staff'' emails a notification of ineligibility to the rest of the members of the committee making the decision
***Profile development
+
** Members who do not have Voting Privileges will thus be aware of the ballot and are still permitted to submit comments
****Production
+
** Members who believe their attendance record is in error can review of their attendance with RSNA Staff and if they are found to be eligible will be sent a ballot
****UPICT protocol
+
* ''RSNA Staff'' compiles the ballot responses and comments for the Chairs
****Provisional goals
+
** o At the discretion of the Chairs, comments submitted by non-voting members may be stricken
****Draft and Review text
+
* ''Chairs'' ratify the resulting tally and comments within a reasonable period of time (preferably in the next committee meeting) per the consensus process
****Collect and Resolve Public Comment
+
* ''RSNA Staff'' records resolution results/rationale in the minutes
***Real world validation ("Field-testing")
+
 
****Approve
+
==Quorum==
****Trial implementation
+
For a vote or ballot to be valid, at least 50% of those with voting privileges must have participated (by either voting in favor, objecting, or abstaining).
****Collectand Resolve feedback
+
 
***Publication
+
==Consensus Process==
****Prepare
+
As a group setting standards on behalf of a community, QIBA Committees actively seek to pursue Consensus.
****Approve
+
 
****Publish
+
* a vote/ballot passes with a quorum of votes and a majority of votes in favor, but
**Reference Object(s) and Support Material(s) for Experimentation and Quality Control (QC)
+
** a '''negative vote or votes should result in subsequent discussion''' to
***Phantoms traceable to recognized physical standards
+
*** '''understand the reason''' for such (a) negative vote(s) and '''attempt to find a compromise or resolution'''; associated edits to the document under ballot do not typically require re-balloting
***Digital Reference Objects (DRO)
+
** a '''large number of abstentions''' may also warrant discussion; it may indicate many people have:
***Definition of comprehensive QC program, including data analysis and reporting requirements
+
*** misgivings
**Identification of Technical Characteristics and Standards
+
*** not been able to adequately evaluate the question
***Assess intrinsic scanner variablity, minimum detectable change, and limits of quantification.
+
 
***Identification and assessment of intra- and inter-reader bias and variance across scanners and centers.
+
Participants concerned that a reasonable attempt at consensus has not been made should first consider raising the issue with the chair of the Biomarker Committee. Failing that, the chairs of the Coordinating Committee or QIBA Steering Committee may be consulted.
**Clinical Performance Groundwork
+
 
***Develop a process map detailing steps to meet regulatory and payer requirements.
+
==Committee Leadership==
***Perform studies necessary if literature does not fully support the process map. These may be retrospective or prospective (e.g.,assessment of intra- and inter-reader sensitivity and specificity for specific clinical utility).
+
* Coordinating Committees, Biomarker Committees and Task Forces are encouraged to have 2 or 3 leaders who are preferably drawn from diverse backgrounds (Researchers, Clinicians, Physicists, Vendors, Regulators, etc.)
**Clinical Efficacy Groundwork
+
** If not possible, committees are permitted to have some concentration but should discuss plans to expand the breadth of stakeholder representation at least annually
***Characterize value in clinical trials
 
***Characterize value in clinical practice
 
***Compare new biomarker and 'accepted-as-standard' method
 
***Develop/ merge databases from trials in support of achieving statistical power
 
**FDA Qualification
 
***Request letter
 
***Briefing document(s)
 
***Full data package
 
**Device Compliance
 
***Determine compliabce testing methods
 
****Acquisition
 
****Post-procesing
 
***Device version tracking
 
  
 
==See Also==
 
==See Also==
 
* [[Committees|QIBA Committees]]
 
* [[Committees|QIBA Committees]]

Revision as of 21:13, 19 May 2020

Meeting Procedures

The goal is group consensus and the input and endorsement of imaging community stakeholders on major decisions.

  • When participation at a given meeting is not open to all committee members, (e.g. it takes place at an “invitation-only” face-to-face event and remote access is not provided for the committee meeting), that meeting will not be considered an official meeting of that committee. No official decisions will be made and attendance will not count toward or against voting privileges.
    • Typically, RSNA staff are present at meetings and capturing attendance. If staff is not present, the chair will need to ensure that attendance records are captured and submitted to RSNA staff.
    • If possible, it is still desirable for minutes to be recorded, but the unofficial status will be noted

A record of committee decisions and rationale is necessary to be effective and learn.

  • RSNA Staff records minutes (call summaries) for meetings of Committees (but not Task Forces)
  • Chairs are strongly encouraged to support RSNA Staff by reviewing/correcting the draft minutes circulated by RSNA Staff
  • RSNA Staff maintains rosters of the members of each committee and their participation. Those details are used to determine which members currently have Voting Privileges
    • Members who believe their attendance record is in error should contact RSNA Staff

Voting

Most committee work doesn't need a vote. At the discretion of committee chairs and members, however, decisions can be put to a vote during meetings. This also facilitates recording key decisions in the minutes.

  • Chairs accept motions, seconds, discussion, and then call for a vote
    • At its simplest, the Chair asks for objections, then asks for abstentions, and "RSNA Staff notes those names. The rest of those present with voting privileges can safely be assumed to have voted in favor
  • Members who have Voting Privileges count towards quorum and may vote
  • Chairs resolve negative votes and large numbers of abstentions per the consensus process
    • details of the resolution discussion in the minutes is desirable
  • RSNA Staff records the motion, the tally of those against/abstaining/in-favor, and the details of negative votes in the minutes
    • If attendance, eligibility and quorum cannot be determined during the meeting, vote results will be ratified after the call and entered into the minutes by RSNA Staff

Email Ballot

Substantive decisions, such as whether a Profile is advanced to the next stage, are put to ballot. This allows more deliberation on the subject material than a vote in committee.

A committee may initiate an email ballot on a document by approving a motion to do so (i.e. officially deciding the document is ready for ballot). Alternatively, Chairs may initiate email ballots at their own discretion after assuring appropriate discussion and review by the committee, and if there are multiple chairs then a simple majority of the chairs must approve the action.

  • Chairs submit the ballot question and length of the ballot period to RSNA Staff
    • The ballot period may be specified by the particular procedure that calls for a ballot
    • The ballot period is generally not less than 14 days to allow adequate time to review the material and vote
    • If reviewing lengthy documents or collecting feedback within member organizations is involved 30 days is suggested for the ballot period
  • RSNA Staff emails the ballot to all members with Voting Privileges on the committee making the decision
  • RSNA Staff emails a notification of ineligibility to the rest of the members of the committee making the decision
    • Members who do not have Voting Privileges will thus be aware of the ballot and are still permitted to submit comments
    • Members who believe their attendance record is in error can review of their attendance with RSNA Staff and if they are found to be eligible will be sent a ballot
  • RSNA Staff compiles the ballot responses and comments for the Chairs
    • o At the discretion of the Chairs, comments submitted by non-voting members may be stricken
  • Chairs ratify the resulting tally and comments within a reasonable period of time (preferably in the next committee meeting) per the consensus process
  • RSNA Staff records resolution results/rationale in the minutes

Quorum

For a vote or ballot to be valid, at least 50% of those with voting privileges must have participated (by either voting in favor, objecting, or abstaining).

Consensus Process

As a group setting standards on behalf of a community, QIBA Committees actively seek to pursue Consensus.

  • a vote/ballot passes with a quorum of votes and a majority of votes in favor, but
    • a negative vote or votes should result in subsequent discussion to
      • understand the reason for such (a) negative vote(s) and attempt to find a compromise or resolution; associated edits to the document under ballot do not typically require re-balloting
    • a large number of abstentions may also warrant discussion; it may indicate many people have:
      • misgivings
      • not been able to adequately evaluate the question

Participants concerned that a reasonable attempt at consensus has not been made should first consider raising the issue with the chair of the Biomarker Committee. Failing that, the chairs of the Coordinating Committee or QIBA Steering Committee may be consulted.

Committee Leadership

  • Coordinating Committees, Biomarker Committees and Task Forces are encouraged to have 2 or 3 leaders who are preferably drawn from diverse backgrounds (Researchers, Clinicians, Physicists, Vendors, Regulators, etc.)
    • If not possible, committees are permitted to have some concentration but should discuss plans to expand the breadth of stakeholder representation at least annually

See Also