Ryo Kamoi

Ryo Kamoi

鴨井 遼 (ja)

Ryo Kamoi is a Ph.D. student in Computer Science at Penn State University advised by Dr. Rui Zhang. He received his master’s degree in CS from UT Austin where he was advised by Dr. Greg Durrett, and received his bachelor’s degree in Statistics from Keio University where he was advised by Dr. Kei Kobayashi. He interned at Amazon with the Alexa team.

He is broadly interested in Natural Language Processing, especially focusing on:

News

Selected publications. For the full list, please see Google Scholar or Semantic Scholar

VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception of Geometric Information PDF Cite Dataset Website
Ryo Kamoi, Yusen Zhang, Sarkar Snigdha Sarathi Das, Ranran Haoran Zhang, Rui Zhang (2024). arXiv preprint arXiv:2412.00947.
When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMs PDF Cite Video Slides Paper List
Ryo Kamoi, Yusen Zhang, Nan Zhang, Jiawei Han, Rui Zhang (2024). TACL 2024. Oral at EMNLP 2024.
Evaluating LLMs at Detecting Errors in LLM Responses PDF Cite Code Dataset Poster
Ryo Kamoi, Sarkar Snigdha Sarathi Das, Renze Lou, Jihyun Janice Ahn, Yilun Zhao, Xiaoxin Lu, Nan Zhang, Yusen Zhang, Ranran Haoran Zhang, Sujeeth Reddy Vummanthala, Salika Dave, Shaobo Qin, Arman Cohan, Wenpeng Yin, Rui Zhang (2024). COLM 2024.
WiCE: Real-World Entailment for Claims in Wikipedia PDF Cite Dataset Slides
Ryo Kamoi, Tanya Goyal, Juan Diego Rodriguez, Greg Durrett (2023). EMNLP 2023. Oral.
Shortcomings of Question Answering Based Factuality Frameworks for Error Localization PDF Cite Dataset Video Poster
Ryo Kamoi, Tanya Goyal, Greg Durrett (2023). EACL 2023.
Why is the Mahalanobis Distance Effective for Anomaly Detection? PDF Cite
Ryo Kamoi, Kei Kobayashi (2020). arXiv preprint arXiv:2003.00402.

Education

Penn State University — Ph.D. Student in Computer Science Aug 2023 – Present State College, PA
PhD Advisor: Rui Zhang
University of Texas at Austin — M.S. in Computer Science Aug 2020 – Dec 2022 Austin, TX
Advisor: Greg Durrett, Mentor: Tanya Goyal
Keio University — B.E. in Statistics Apr 2016 – Mar 2020 Tokyo, Japan
Advisor: Kei Kobayashi, Keio Engineering Foundation Award (Top student in the Department of Mathematics)

Work Experience

Amazon, Alexa Team — Applied Scientist Internship Jul 2021 – Dec 2021 Cambridge, U.K.
Research on the quality evaluation of Alexa

Services

NLP Colloquium JP (NLPコロキウム) — Staff Mar 2024 – Present

Awards

Keio University Global FellowshipAug 2020
Scholarship for alumni of Keio University to pursue degrees at overseas graduate schools
Keio Engineering Foundation AwardMar 2020
Graduation with highest honors - First place in the Department of Mathematics at Keio University

Media Mentions

Self-Correction in Large Language Models — Communications of the ACMFeb 2025
Interview about our survey paper on LLM self-correction.

Invited Talks

Matsuo-Iwasawa Lab at the University of Tokyo (LLM講座, ja)
Lecture about self-correction of LLMs based on our survey paper
Oct 17, 2024 The University of Tokyo (Online)
NLP Colloquium JP (NLPコロキウム, ja)
Talk about our paper “WiCE Real-World Entailment for Claims in Wikipedia”
Nov 29, 2023 Online
Nagoya NLP Seminar at Nagoya University (名古屋NLPセミナー, ja)
Talk about our papers on factuality and entailment
Jul 3, 2023 Nagoya University

How to Pronounce My Name

  • Preferred English Pronunciation:
  • Native Pronunciation: