nlp

Evaluating LLMs at Detecting Errors in LLM Responses
Ryo Kamoi, Sarkar Snigdha Sarathi Das, Renze Lou, Jihyun Janice Ahn, Yilun Zhao, Xiaoxin Lu, Nan Zhang, Yusen Zhang, Ranran Haoran Zhang, Sujeeth Reddy Vummanthala, Salika Dave, Shaobo Qin, Arman Cohan, Wenpeng Yin, Rui Zhang
PDF Cite Code Dataset
WiCE: Real-World Entailment for Claims in Wikipedia
Models for textual entailment have increasingly been applied to settings like fact-checking, presupposition verification in question …
Ryo Kamoi, Tanya Goyal, Juan Diego Rodriguez, Greg Durrett
PDF Cite Dataset
Shortcomings of Question Answering Based Factuality Frameworks for Error Localization
Despite recent progress in abstractive summarization, models often generate summaries with factual errors. Numerous approaches to …
Ryo Kamoi, Tanya Goyal, Greg Durrett
PDF Cite Dataset Poster