selected | Ryo Kamoi

VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception of Geometric Information

Ryo Kamoi, Yusen Zhang, Sarkar Snigdha Sarathi Das, Ranran Haoran Zhang, Rui Zhang

When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMs

Ryo Kamoi, Yusen Zhang, Nan Zhang, Jiawei Han, Rui Zhang

Evaluating LLMs at Detecting Errors in LLM Responses

Ryo Kamoi, Sarkar Snigdha Sarathi Das, Renze Lou, Jihyun Janice Ahn, Yilun Zhao, Xiaoxin Lu, Nan Zhang, Yusen Zhang, Ranran Haoran Zhang, Sujeeth Reddy Vummanthala, Salika Dave, Shaobo Qin, Arman Cohan, Wenpeng Yin, Rui Zhang

WiCE: Real-World Entailment for Claims in Wikipedia

Models for textual entailment have increasingly been applied to settings like fact-checking, presupposition verification in question …

Ryo Kamoi, Tanya Goyal, Juan Diego Rodriguez, Greg Durrett

Shortcomings of Question Answering Based Factuality Frameworks for Error Localization

Despite recent progress in abstractive summarization, models often generate summaries with factual errors. Numerous approaches to …

Ryo Kamoi, Tanya Goyal, Greg Durrett

Why is the Mahalanobis Distance Effective for Anomaly Detection?

The Mahalanobis distance-based confidence score, a recently proposed anomaly detection method for pre-trained neural classifiers, …

Ryo Kamoi, Kei Kobayashi