Calibrated Large Language Models for Binary Question Answering

Patrizio Giovannotti; Alex Gammerman

Calibrated Large Language Models for Binary Question Answering

Royal Holloway, University of London

Research output: Contribution to journal › Conference article › peer-review

Original language	English
Pages (from-to)	218-235
Number of pages	18
Journal	Proceedings of Machine Learning Research
Volume	230
Publication status	Published - Oct 2024
Event	13th Symposium on Conformal and Probabilistic Prediction with Applications, COPA 2024 - Milano, Italy Duration: 9 Sept 2024 → 11 Sept 2024

Keywords

binary question answering
calibration
large language models
uncertainty estimation
Venn–Abers predictor

Access to Document

https://proceedings.mlr.press/v230/giovannotti24a.html

Cite this

@article{31a7726f323d4583aee2616475d1dd02,

title = "Calibrated Large Language Models for Binary Question Answering",

keywords = "binary question answering, calibration, large language models, uncertainty estimation, Venn–Abers predictor",

author = "Patrizio Giovannotti and Alex Gammerman",

note = "Publisher Copyright: {\textcopyright} 2024 P. Giovannotti \& A. Gammerman.; 13th Symposium on Conformal and Probabilistic Prediction with Applications, COPA 2024 ; Conference date: 09-09-2024 Through 11-09-2024",

year = "2024",

month = oct,

language = "English",

volume = "230",

pages = "218--235",

journal = "Proceedings of Machine Learning Research",

issn = "2640-3498",

publisher = "ML Research Press",

}

TY - JOUR

T1 - Calibrated Large Language Models for Binary Question Answering

AU - Giovannotti, Patrizio

AU - Gammerman, Alex

PY - 2024/10

Y1 - 2024/10

KW - binary question answering

KW - calibration

KW - large language models

KW - uncertainty estimation

KW - Venn–Abers predictor

UR - https://www.scopus.com/pages/publications/85216664456

M3 - Conference article

AN - SCOPUS:85216664456

SN - 2640-3498

VL - 230

SP - 218

EP - 235

JO - Proceedings of Machine Learning Research

JF - Proceedings of Machine Learning Research

T2 - 13th Symposium on Conformal and Probabilistic Prediction with Applications, COPA 2024

Y2 - 9 September 2024 through 11 September 2024

ER -

Calibrated Large Language Models for Binary Question Answering

Keywords

Access to Document

Other files and links

Cite this