Full Seminar Details

Mr Antonello Meloni

Department of Mathematics and Computer Science, University of Cagliari, IT

Mr Antonello Meloni
Large Language Models for Scientific Question Answering: an Extensive Analysis of the SciQA Benchmark
This event took place on Tuesday 23 July 2024 at 11:30

The SciQA benchmark for scientific question answering presents a challenging task for next-generation question-answering systems, where standard large language models often fall short. In this seminar, we will analyze the performance of language models on this benchmark, exploring both prompting and fine-tuning techniques to enhance their adaptability to the SciQA task. Our findings demonstrate that intelligent few-shot selection in prompting and targeted fine-tuning can lead to excellent results on the SciQA benchmark. We will also discuss valuable insights gained, common error categories encountered, and their implications for optimizing large language models for question answering over knowledge graphs.

Watch the webcast replay >>

View all past events

Maven of the month logo - Photo of Prof. Ricardo Baeza-Yates

Maven of the Month

We are also inviting top experts in AI and Knowledge Technologies to discuss major socio-technological topics with an audience that comprises both members of the Knowledge Media Institute, as well as the wider staff at The Open University. Differently from our seminar series, these events follow a Q&A format.

Past events


Knowledge Media Institute
The Open University
Walton Hall
Milton Keynes
United Kingdom

Tel: +44 (0)1908 653800

Fax: +44 (0)1908 653169

Email: KMi Support


If you have any comments, suggestions or general feedback regarding our website, please email us at the address below.

Email: KMi Development Team