ABOUT ME
Raito Kiya
I am a second-year master's student at the Graduate School of Information Sciences, Tohoku University, and a member of the Tohoku NLP Group.
Email: raito.kiya@dc.tohoku.ac.jp
GitHub: https://github.com/kiya-raito
Research Interest
- Artificial Intelligence
- Natural Language Processing
- Large Language Models (LLMs)
- Internal Mechanisms
- Attention Sink
- Massive Activations
Publications
Attention SinkおよびMassive Activationの発生機序の分解 🏆 若手奨励賞
木谷 頼斗, 大橋 諭貴, 佐藤 宏亮, 鴨田 豪, 高橋 良允, 山本 悠士, 塩野 大輝, 坂口 慶祐, 小林 悟郎
paper
木谷 頼斗, 大橋 諭貴, 佐藤 宏亮, 鴨田 豪, 高橋 良允, 山本 悠士, 塩野 大輝, 坂口 慶祐, 小林 悟郎
paper
注意機構における Attention Sink のバイアス項的解釈 🏆 若手奨励賞
大橋 諭貴, 木谷 頼斗, 佐藤 宏亮, 高橋 良允, 鴨田 豪, 山本 悠士, 塩野 大輝, 坂口 慶祐, 小林 悟郎
paper
大橋 諭貴, 木谷 頼斗, 佐藤 宏亮, 高橋 良允, 鴨田 豪, 山本 悠士, 塩野 大輝, 坂口 慶祐, 小林 悟郎
paper
説明文生成による予測精度の向上に着目した解釈可能なフェイクニュース検出
木谷 頼斗,張 建偉
木谷 頼斗,張 建偉
Experiences
NLP Engineer (Part-time)
Future Corporation
December 2025 - Present
Future Corporation
December 2025 - Present
Assistant for developing online experimental environments for LLMs in Japanese NLP (Administrative Assistant)
Graduate School of Information Sciences, Tohoku University
July 2025 - Present
Graduate School of Information Sciences, Tohoku University
July 2025 - Present
Data Scientist (Internship)
NTT EAST, Inc.
September 2025
NTT EAST, Inc.
September 2025
Research & Development in NLP (Internship)
Future Corporation
August 2025 - September 2025
Future Corporation
August 2025 - September 2025
Awards / Grants
草刈賞
令和6年度学士論文研究助成金
野崎わかば会
Education
Master of Information Science
Graduate School of Information Sciences, Tohoku University
April 2025 - Present
Graduate School of Information Sciences, Tohoku University
April 2025 - Present
Bachelor of Science and Engineering
Department of Systems Innovation Engineering, Faculty of Science and Engineering, Iwate University
April 2021 - March 2025
Department of Systems Innovation Engineering, Faculty of Science and Engineering, Iwate University
April 2021 - March 2025
Hobbies
Skiing
SAJ (Ski Association of Japan) Ski Proficiency Test Level 1 🎿 1st Grade
SAJ (Ski Association of Japan) Ski Proficiency Test Level 1 🎿 1st Grade
Bouldering
RP: 1Q
OS: 2Q
RP: 1Q
OS: 2Q
Coffee
Drip Coffee, Siphon, Flannel Drip Coffee
Drip Coffee, Siphon, Flannel Drip Coffee
Hot Spring (Onsen)