Skip to main content

Artificial Intelligence is moving and shaping health and healthcare at lighting speed. The benefits of AI are multifold, but informatics research and practice is needed for the systematic and comprehensive evaluation of AI tools.

AI in health and healthcare must be safely and effectively deployed in healthcare settings. Such evaluation includes studies of technical performance, usability and workflow, and health impact.

Presentations in the AMIA 2022 Artificial Intelligence Evaluation Showcase are presented at all three AMIA meetings

Call for Participation

We are now accepting proposals for Stage 1 - Technical Performance Studies

Submission Deadline: December 1, 2021

Submit a proposal

Informational Webinar

AMIA recently hosted free informational webinar that introduced this new opportunity and chance to answered questions from the participants.

Watch the recording

Submissions

Stage I - Technical Performance Studies

Submission to have a system description, results from a study of algorithm performance, and an outline of the methods of the full evaluation plan.

Presentation at the Informatics Summit (IS): March 21-24, 2022, Chicago, Illinois.

Submission Deadline: December 1, 2021

Stage II - Usability and Workflow Studies

Submission to address usability and workflow aspects of the AI system, including prototype usability or satisfaction, algorithm explainability, implementation lessons, and/or system use in context.

Presentation at the Clinical Informatics Conference (CIC), May 24-26, 2022, Houston, Texas
*acceptance of Stage I submission required.

Submission Deadline: February 1, 2022

Stage III - Health Impact Studies

Submissions to summarize the comprehensive evaluation to include research from prior submissions with new research results that measure the impact of the tool; acceptance of stage II submission required.

Presentation at the AMIA Annual Symposium, November 5-9, 2022, Washington, DC.

Submission Deadline: May 1, 2022

Scientific Program Committee (SPC) 

Gretchen Purcell Jackson, MD, PhD, FACS, FACMI, FAMIA
Chair, AMIA 2022 Scientific Program Committee
IBM Watson Health & Vanderbilt University Medical Center
Laura Wiley, PhD
Chair, 2022 Informatics Summit Scientific Program Committee
University of Colorado Denver
Paul Fu, Jr., MD, MPH, FAMIA, FAAP
Co-Chair, 2022 Clinical Informatics Conference
City of Hope
Rosemary Kennedy, PhD, RN, MBA, FAAN
Co-Chair, 2022 Clinical Informatics Conference
Connect America

Additional members of the SPC to be announced.

How to Participate in AI Evaluation Showcase

Select a Team and Team Leads

Scientific teams must commit to submitting work centered around the same solution to all three conferences and should designate a lead scientist for the team. Given the different nature of each conference and types of expertise needed for each stage, authorship is expected to vary for each submission.

Determine Type of Submission

AMIA offer three ways to participate by submitting paper, podium abstract, and poster proposals for Stage I and Stage II deadlines. We envision the submission of a final proposal providing a summary of the entire evaluation, in manuscript or podium abstract format.

We will make every attempt to give those scientists committing to and completing comprehensive evaluations to present at the various meetings. For all meetings, scientifically rigorous manuscripts and podium abstracts not incorporated into a scientific session will receive a poster presentation opportunity.

Who Can Submit to the AI Showcase

Domestic and international contributions to the from AMIA members, non-members, and students from all sectors of informatics. A separate Scientific Program Committee (SPC) will judge proposals and select presentations for a series of sessions and posters at the Informatics Summit, Clinical Informatics Conference, and Annual Symposium.

Questions?

If you are interested in or have questions about this opportunity, please contact Jeff Williamson, Vice President of Education and Academic Affairs.

A word from the Chair/President-Elect

Gretchen-Purcell-Jackson

Gretchen Purcell Jackson, MD, PhD, FACS, FACMI, FAMIA

I am especially passionate about systematic and comprehensive evaluation of AI tools to ensure they can be safely and effectively deployed in healthcare settings. Such evaluation includes studies of technical performance, usability and workflow, and health impact. The AMIA 2022 Artificial Intelligence Evaluation Showcase is AMIA’s contribution to encourage comprehensive AI evaluation to address this gap.

Fellow 2022 AMIA Scientific Program Committee (SPC) Chairs Laura Wiley (Informatics Summit), Rosemary Kennedy and Paul Fu (Clinical Informatics Conference) and I collaborated to create this first-of-its-kind cross-meeting AMIA program.

The goal is to produce content featuring the individual components of comprehensive AI evaluation through AMIA’s three major conferences.

Informatics is a team sport and this is a great opportunity for scientific teams to showcase their research accomplishments in the exciting world of AI in healthcare.