The 9th Workshop on Clinical Natural Language Processing

At NAACL 2027. San Francisco, California, United States. Tue 01 Jun 2027.

Sponsored by SIGClinical.

Special Interest Group

The Clinical NLP Workshop is sponsored by the new ACL Special Interest Group on Clinically Related Language, SIGClinical! Anyone interested in joining SIGClinical can do so by following the instructions here: https://sigclinical.org/

Contact

For inquiries, please contact: clinical-nlp-workshop-organizers@googlegroups.com.

Important Dates

All deadlines are 11:59PM UTC-12:00 (anywhere on Earth).

Event Date
Paper submission deadline (main and shared task papers) Wed 24 Feb 2027 
Review deadline Fri 26 Mar 2027
Notification of acceptance Thur 01 Apr 2027
Camera-ready paper deadline Fri 16 Apr 2027
Pre-recorded video deadline Fri 14 May 2027
Workshop Jun 2027

Shared Tasks

  • MEDIQA-RADEVAL: Evaluating Metrics for Radiology Report Assessment: This new shared task focuses on developing reliable methods for evaluating radiology report quality. Participants will use a new benchmark of expert-annotated report comparisons capturing clinically meaningful differences across imaging modalities and anatomical regions. The dataset includes fine-grained annotations of relevant quality dimensions and error types for benchmarking automated evaluation metrics. By comparing metrics against expert assessments, the task aims to advance robust, clinically grounded evaluation of radiology report generation systems.

  • MEDIQA-MULTIREFEVAL: Evaluating Metrics for Multimodal Question Answering: The second edition of MEDIQA-EVAL focuses on evaluating open-ended responses in dermatology visual question answering, where generated answers can assist clinicians by providing draft responses to patient questions accompanied by clinical images. Participants will develop metrics for assessing answers against expert judgments. The task will feature a larger multilingual English and Chinese dataset, with four additional gold-reference answers per language and expert ratings for generated and reference answers. These annotations will support evaluation when multiple clinically valid responses exist. Building on the first edition, the task aims to advance clinically grounded metrics capturing factual accuracy, completeness, and overall response quality across languages and dermatology cases.

Workshop Awards

The workshop will recognize outstanding research contributions and top-performing shared task teams with six awards of $1,000 each.

Paper Awards

  • Best Workshop Paper: Outstanding overall contribution.
  • Best Student Paper: Exceptional student-led research.
  • Best Shared Task Paper: Innovative and insightful shared task research.

Shared Task Awards

  • MEDIQA-RADEVAL: Best-performing team.
  • MEDIQA-MULTIREFEVAL (English): Best-performing team.
  • MEDIQA-MULTIREFEVAL (Chinese): Best-performing team.

All winners will be announced during the ClinicalNLP 2027 workshop.

For more info: https://clinical-nlp.github.io/2027/awards.html