Difference between revisions of "Committee Procedures"

From QIBA Wiki
Jump to navigation Jump to search
 
(25 intermediate revisions by 3 users not shown)
Line 1: Line 1:
==Organizational Structure==
+
<font color="red">NOTICE: These instructions are accessible on the QIBA Wiki as a historical reference only! Independent Profile Authoring Groups are required to oversee the various developmental stages from Draft to Public Comment to Consensus based on the current QUIC endorsement criteria, found HERE:</font> https://qibawiki.rsna.org/images/9/95/QUIC-Review-Criteria-for-New-Profiles-FINAL-v23SEPT2023.pdf.
* '''Steering Committee''' is established by RSNA
 
** Responsible for managing the strategic direction, processes and inftrastructure for QIBA and overall oversight of the QIBA activities and committees.
 
* '''Modality Coordinating Committees''' are established by the Steering Committee
 
** Responsible for coordinating Biomarker Committees within their modality.
 
* '''Biomarker Committees''' are proposed by the Modality Coordinating Committee and approved by the Steering Committee
 
** Responsible for drafting Profiles and protocols, and coordinating associated groundwork and field testing.
 
** '''Task Forces''' are established by the Biomarker Committee as needed to:
 
*** Plan and carry out specific groundwork projects.
 
*** Write Profiles and/or protocols.
 
* '''Process Committee''' is established by the Steering Committee
 
** Responsible for defining processes and tools to promote consistent quality work product by the QIBA Committees and Task Forces.
 
* '''QIDW Oversight Committee''' is established by the Steering Committee
 
** Responsible for managing the establishment and effective operations of the Quantitative Imaging Data Warehouse.
 
  
==Committee Membership==
 
* '''Steering Committee''' members are appointed by the RSNA.
 
* '''Modality Coordinating Committee''' members can be self-nominated, but must have participated in at least 50% of teleconferences during the previous 12 months. Retention of modality committee membership will require participation in at least 50% of teleconferences. Participation in teleconferences will be assessed on a rolling basis every 6 months. New members can be added to Modality Committees every 6 months based on their participation in at least 50% of BC calls during the previous 12 months. The minimum level of teleconference participation is established by the Steering Committee and can be changed by the Steering Committee if it sees fit to do so.
 
* '''Biomarker Committees''' are "open" committees
 
** '''"Open" committees''' are open to anyone with a relevant interest.
 
** '''Committee Co-Chairs''' can direct RSNA staff to add names to the roster.
 
** '''Task Forces''' are typically volunteer subsets of their parent Biomarker Committee
 
* '''Rosters''' for each Biomarker Committee are posted on the Wiki.
 
  
==Committee Leadership==
+
==Meeting Procedures==
* Coordinating Committees, Biomarker Committees and Task Forces are encouraged to have 2 or 3 leaders who are preferably drawn from diverse backgrounds (Researchers, Clinicians, Physicists, Vendors, Regulators, etc.).  If not possible, some concentration is permitted and a plan to expand stakeholder representation is recommended.
+
The goal is group consensus and the input and endorsement of imaging community stakeholders on major decisions.
  
==Decision Making==
+
* When participation at a given meeting is not open to all committee members, (e.g., it takes place at an '''“invitation-only” face-to-face event and remote access is not provided for the committee meeting'''), that meeting '''will not be considered an official meeting''' of that committee.  No official decisions will be made and attendance will not count toward or against voting privileges.  
* Goal: group consensus and imaging community input and endorsement on major decisions.
+
** The chair will need to ensure that attendance records are captured and submitted to the Profile Authoring Group members.
* Recorded vote required for procedural decisions
 
** Key group decisions, such as public dissemination of documents, are subject to approval by Modality Coordinating Committees
 
** Majority of participating members passes
 
** Negative votes must be discussed
 
* For recorded votes:
 
** Meeting attendee names and vote outcome will be recorded in minutes.
 
  
==Committee Functions==
+
A record of committee decisions and rationale is necessary to be effective and learn.
 +
* ''Profile Authoring Group scribe'' records minutes (call summaries) for meetings 
 +
* ''Chairs'' are strongly encouraged to support Profile Authoring Group scribes by reviewing/correcting the draft minutes circulated 
 +
* ''Profile Authoring Group Chairs'' maintain '''[[Committees|rosters of the members of each committee]]''' and their participation.  Those details are used to determine which members currently have '''[[Voting Privileges]]'''
 +
** ''Members'' who believe their attendance record is in error should contact Profile Authoring Group Chairs.
  
*'''Steering Committee:'''
+
==Voting==
**Manage Relationships and Optimize Communications
+
Most committee work doesn't need a vote.  At the discretion of committee chairs and members, however, decisions can be put to a vote during meetings. This also facilitates recording key decisions in the minutes.
***Create a collaborative, multidisciplinary environment that fosters communication among imaging groups and other medical disciplines involved in the research, approval, and use of quantitative imaging biomarkers (QIBs)
 
***Educate stakeholders about Profiles
 
***Provide content and administrative support of web sites/ Wikis
 
***Support face-to-face meetings
 
**Coordinate Quantitative Imaging Biomarker Evaluation
 
***Evaluate clinical needs for biomarkers for each therapeutic area.
 
***Develop and maintain public infrastructure for biomarker-specific data and associated metadata.
 
***Oversee inputs and works-in-progress of teams; mantain scorecard.
 
**Influence Regulatory Pathways
 
***Clarify and optimize pathway for imaging biomarkers to become widely available.
 
***Develop process guidance with regulatory agencies inclusive of drug development and patient care.
 
***Plan and hold workshops with FDA.
 
**Explore Self-funded Models to Maintain Forward Progress
 
***Define what size adn scope of offort is sustainable and over what period of time.
 
  
*'''Modality Coordinating Committees''' (Most of the Profile work is delegated to Biomarker Committees)
+
* ''Chairs'' accept motions, seconds, discussion, and then call for a vote
** Coordinate the Biomarker Committees in their modality
+
** At its simplest, the ''Chair'' asks for objections, then asks for abstentions, and "Profile Authoring Group scribe'' notes those names.  The rest of those present with voting privileges can safely be assumed to have voted in favor.
*** Maintain a balance of work and resources .
+
* ''Members'' who have '''[[Voting Privileges]]''' count towards quorum and may vote.
*** Identify synergies where possible in groundwork, authoring and testing.
+
* ''Chairs'' resolve negative votes and large numbers of abstentions per the '''[[Committee Procedures#Consensus Process|consensus process]]'''
*** Prioritize funding proposals submitted to the Steering Committee
+
** details of the resolution discussion in the minutes are desirable
*** Propose established biomarkers that are ready for industrialization to the Steering Committee
+
* ''Profile Authoring Group scribe'' records the motion, the tally of those against/abstaining/in-favor, and the details of negative votes in the minutes.
** Participate in the Process Committee and disseminate to the Biomarker Committees and Task Forces in their modality
+
** If attendance, eligibility and quorum cannot be determined during the meeting, vote results will be ratified after the call and entered into the minutes by the ''Profile Authoring Group scribe''.
*** assign a liaison to the Process Committee; the Scientific Liaison might also fill this role
 
*** help communicate processes and recommendations and monitor adoption
 
**Based on the clinical context and needs, identify and prioritize biomarkers to pursue ("work item selection").
 
***Propose
 
***Evaluate
 
***Approve
 
**For each selected biomarker:
 
***Profile development
 
****Production
 
****UPICT protocol
 
****Provisional goals
 
****Draft and Review text
 
****Collect and Resolve Public Comment
 
***Real world validation ("Field-testing")
 
****Approve
 
****Trial implementation
 
****Collect and Resolve feedback
 
***Publication
 
****Prepare
 
****Approve
 
****Publish
 
**Reference Object(s) and Support Material(s) for Experimentation and Quality Control (QC)
 
***Phantoms traceable to recognized physical standards
 
***Digital Reference Objects (DRO)
 
***Definition of comprehensive QC program, including data analysis and reporting requirements
 
**Identification of Technical Characteristics and Standards
 
***Assess intrinsic scanner variablity, minimum detectable change, and limits of quantification.
 
***Identification and assessment of intra- and inter-reader bias and variance across scanners and centers.
 
**Clinical Performance Groundwork
 
***Develop a process map detailing steps to meet regulatory and payer requirements.
 
***Perform studies necessary if literature does not fully support the process map. These may be retrospective or prospective (e.g.,assessment of intra- and inter-reader sensitivity and specificity for specific clinical utility).
 
**Clinical Efficacy Groundwork
 
***Characterize value in clinical trials
 
***Characterize value in clinical practice
 
***Compare new biomarker and 'accepted-as-standard' method
 
***Develop/ merge databases from trials in support of achieving statistical power
 
**FDA Qualification
 
***Request letter
 
***Briefing document(s)
 
***Full data package
 
**Device Compliance
 
***Determine compliance testing methods
 
****Acquisition
 
****Post-procesing
 
***Device version tracking
 
  
* '''Process Commmittee'''
+
==Email Ballot==
**Determine and Manage Process
+
Substantive decisions, such as whether a Profile is advanced to the next stage, are put to ballot. This allows more deliberation on the subject material than a vote in committee.
***Develop ways of working, organizing, etc. across the various entities.
+
 
***Utilize principles from imaging science to undertand clinical image information content and utility.
+
A committee may initiate an email ballot on a document by approving a motion to do so (i.e. officially deciding the document is ready for ballot).  Alternatively, Chairs may initiate email ballots at their own discretion after assuring appropriate discussion and review by the committee, and if there are multiple chairs then a simple majority of the chairs must approve the action.
***Adopt a statistically rigorous framework for determining and reducing sources of variation.
+
 
***Lay out a process for certification of compliance tot he Profile and how this relates to regulatory pathways.
+
* ''Chairs'' submit the ballot question and length of the ballot period to RSNA Staff
 +
** The ballot period may be specified by the particular procedure that calls for a ballot
 +
** The ballot period is generally not less than 14 days to allow adequate time to review the material and vote
 +
** If reviewing lengthy documents or collecting feedback within member organizations is involved 30 days is suggested for the ballot period
 +
* ''Profile Authoring Group scribe'' emails the ballot to all members with '''[[Voting Privileges]]''' on the committee making the decision
 +
* ''Profile Authoring Group scribe'' emails a notification of ineligibility to the rest of the members of the committee making the decision
 +
** Members who do not have Voting Privileges will thus be aware of the ballot and are still permitted to submit comments
 +
** Members who believe their attendance record is in error can review of their attendance with the Profile Authoring Group scribe or Chairs, and if they are found to be eligible will be sent a ballot
 +
* ''Profile Authoring Group scribe'' compiles the ballot responses and comments for the Chairs
 +
** o At the discretion of the Chairs, comments submitted by non-voting members may be stricken
 +
* ''Chairs'' ratify the resulting tally and comments within a reasonable period of time (preferably in the next committee meeting) per the consensus process
 +
* ''Profile Authoring Group scribe'' records resolution results/rationale in the minutes
 +
 
 +
==Quorum==
 +
For a vote or ballot to be valid, at least 50% of those with voting privileges must have participated (by either voting in favor, objecting, or abstaining).
 +
 
 +
==Consensus Process==
 +
As a group setting standards on behalf of a community, the Profile Authoring Groups actively seek to pursue Consensus.
 +
 
 +
* a vote/ballot passes with a quorum of votes and a majority of votes in favor, but
 +
** a '''negative vote or votes should result in subsequent discussion''' to
 +
*** '''understand the reason''' for such (a) negative vote(s) and '''attempt to find a compromise or resolution'''; associated edits to the document under ballot do not typically require re-balloting
 +
** a '''large number of abstentions''' may also warrant discussion; it may indicate many people have:
 +
*** misgivings
 +
*** not been able to adequately evaluate the question
 +
 
 +
Participants concerned that a reasonable attempt at consensus has not been made should consider raising the issue with the chair(s) of the Profile Authoring Group.
 +
 
 +
==Profile Authoring Group Leadership==
 +
*Profile Authoring Groups are encouraged to have 2 or 3 leaders who are preferably drawn from diverse backgrounds (Researchers, Clinicians, Physicists, Vendors, Regulators, etc.
 +
** If not possible, groups are permitted to have some concentration but should discuss plans to expand the breadth of stakeholder representation at least annually
  
 
==See Also==
 
==See Also==
 
* [[Committees|QIBA Committees]]
 
* [[Committees|QIBA Committees]]

Latest revision as of 17:32, 19 January 2024

NOTICE: These instructions are accessible on the QIBA Wiki as a historical reference only! Independent Profile Authoring Groups are required to oversee the various developmental stages from Draft to Public Comment to Consensus based on the current QUIC endorsement criteria, found HERE: https://qibawiki.rsna.org/images/9/95/QUIC-Review-Criteria-for-New-Profiles-FINAL-v23SEPT2023.pdf.


Meeting Procedures

The goal is group consensus and the input and endorsement of imaging community stakeholders on major decisions.

  • When participation at a given meeting is not open to all committee members, (e.g., it takes place at an “invitation-only” face-to-face event and remote access is not provided for the committee meeting), that meeting will not be considered an official meeting of that committee. No official decisions will be made and attendance will not count toward or against voting privileges.
    • The chair will need to ensure that attendance records are captured and submitted to the Profile Authoring Group members.

A record of committee decisions and rationale is necessary to be effective and learn.

  • Profile Authoring Group scribe records minutes (call summaries) for meetings
  • Chairs are strongly encouraged to support Profile Authoring Group scribes by reviewing/correcting the draft minutes circulated
  • Profile Authoring Group Chairs maintain rosters of the members of each committee and their participation. Those details are used to determine which members currently have Voting Privileges
    • Members who believe their attendance record is in error should contact Profile Authoring Group Chairs.

Voting

Most committee work doesn't need a vote. At the discretion of committee chairs and members, however, decisions can be put to a vote during meetings. This also facilitates recording key decisions in the minutes.

  • Chairs accept motions, seconds, discussion, and then call for a vote
    • At its simplest, the Chair asks for objections, then asks for abstentions, and "Profile Authoring Group scribe notes those names. The rest of those present with voting privileges can safely be assumed to have voted in favor.
  • Members who have Voting Privileges count towards quorum and may vote.
  • Chairs resolve negative votes and large numbers of abstentions per the consensus process
    • details of the resolution discussion in the minutes are desirable
  • Profile Authoring Group scribe records the motion, the tally of those against/abstaining/in-favor, and the details of negative votes in the minutes.
    • If attendance, eligibility and quorum cannot be determined during the meeting, vote results will be ratified after the call and entered into the minutes by the Profile Authoring Group scribe.

Email Ballot

Substantive decisions, such as whether a Profile is advanced to the next stage, are put to ballot. This allows more deliberation on the subject material than a vote in committee.

A committee may initiate an email ballot on a document by approving a motion to do so (i.e. officially deciding the document is ready for ballot). Alternatively, Chairs may initiate email ballots at their own discretion after assuring appropriate discussion and review by the committee, and if there are multiple chairs then a simple majority of the chairs must approve the action.

  • Chairs submit the ballot question and length of the ballot period to RSNA Staff
    • The ballot period may be specified by the particular procedure that calls for a ballot
    • The ballot period is generally not less than 14 days to allow adequate time to review the material and vote
    • If reviewing lengthy documents or collecting feedback within member organizations is involved 30 days is suggested for the ballot period
  • Profile Authoring Group scribe emails the ballot to all members with Voting Privileges on the committee making the decision
  • Profile Authoring Group scribe emails a notification of ineligibility to the rest of the members of the committee making the decision
    • Members who do not have Voting Privileges will thus be aware of the ballot and are still permitted to submit comments
    • Members who believe their attendance record is in error can review of their attendance with the Profile Authoring Group scribe or Chairs, and if they are found to be eligible will be sent a ballot
  • Profile Authoring Group scribe compiles the ballot responses and comments for the Chairs
    • o At the discretion of the Chairs, comments submitted by non-voting members may be stricken
  • Chairs ratify the resulting tally and comments within a reasonable period of time (preferably in the next committee meeting) per the consensus process
  • Profile Authoring Group scribe records resolution results/rationale in the minutes

Quorum

For a vote or ballot to be valid, at least 50% of those with voting privileges must have participated (by either voting in favor, objecting, or abstaining).

Consensus Process

As a group setting standards on behalf of a community, the Profile Authoring Groups actively seek to pursue Consensus.

  • a vote/ballot passes with a quorum of votes and a majority of votes in favor, but
    • a negative vote or votes should result in subsequent discussion to
      • understand the reason for such (a) negative vote(s) and attempt to find a compromise or resolution; associated edits to the document under ballot do not typically require re-balloting
    • a large number of abstentions may also warrant discussion; it may indicate many people have:
      • misgivings
      • not been able to adequately evaluate the question

Participants concerned that a reasonable attempt at consensus has not been made should consider raising the issue with the chair(s) of the Profile Authoring Group.

Profile Authoring Group Leadership

  • Profile Authoring Groups are encouraged to have 2 or 3 leaders who are preferably drawn from diverse backgrounds (Researchers, Clinicians, Physicists, Vendors, Regulators, etc.)
    • If not possible, groups are permitted to have some concentration but should discuss plans to expand the breadth of stakeholder representation at least annually

See Also