How Can We Know <i>When</i> Language Models Know? On the Calibration of Language Models for Question Answering

AbstractRecent works have shown that language models (LM) capture different types of knowledge regarding facts or common sense. However, because no model is perfect, they still fail to provide appropriate answers in many cases. In this paper, we ask the question, “How can we know whe...

Full description

Bibliographic Details
Main Authors: Zhengbao Jiang, Jun Araki, Haibo Ding, Graham Neubig
Format: Article
Language:English
Published: The MIT Press 2021-01-01
Series:Transactions of the Association for Computational Linguistics
Online Access:https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00407/107277/How-Can-We-Know-When-Language-Models-Know-On-the