The current state-of-the-art on PubMedQA is Meditron-70B (CoT + SC). See a full comparison of 29 papers with code.

The task of PubMedQA is to answer research questions with yes/no/maybe (e.g.: Do preoperative statins reduce atrial fibrillation after coronary artery bypass ...

A dataset for biomedical research question answering. The task of PubMedQA is to answer research questions with yes/no/maybe.

PubMedQA is the first QA dataset where reasoning over biomedical research texts, especially their quantitative contents, is required to answer the questions.

Our results suggest that obese patients who receive a BLT may be at higher risk of 90-day mortality compared with patients of normal weight. Further study is ...

PubMedQA is a novel biomedical question answering (QA) dataset collected from PubMed abstracts. The task of PubMedQA is to answer research questions with yes/no ...

13 сент. 2019 г. · PubMedQA is the first QA dataset where reasoning over biomedical research texts, especially their quantitative contents, is required to answer the questions.

Generally, PubMedQA can serve as a benchmark for testing scientific reason- ing abilities of machine reading comprehension models. 7 Acknowledgement. We are ...

2 авг. 2023 г. · On PubMedQA, Palmyra attained an accuracy of 81.1%, beating a medically-trained human test-taker's score of 78.0%. Palmyra LLMs are designed for ...

This repository contains a comprehensive dataset and benchmark results aimed at evaluating Retrieval-Augmented Generation (RAG) systems for medical question ...