ABOUT ME
Raito Kiya
I am a second-year master's student at the Graduate School of Information Sciences, Tohoku University, and a member of the Tohoku NLP Group.
Email: raito.kiya@dc.tohoku.ac.jp
GitHub: https://github.com/kiya-raito
Research Interest
- Artificial Intelligence
- Natural Language Processing
- Large Language Models (LLMs)
- Internal Mechanisms
- Attention Sink
- Massive Activations
Publications
Attention SinkおよびMassive Activationの発生機序の分解 🏆 若手奨励賞
木谷 頼斗, 大橋 諭貴, 佐藤 宏亮, 鴨田 豪, 高橋 良允, 山本 悠士, 塩野 大輝, 坂口 慶祐, 小林 悟郎
paper
木谷 頼斗, 大橋 諭貴, 佐藤 宏亮, 鴨田 豪, 高橋 良允, 山本 悠士, 塩野 大輝, 坂口 慶祐, 小林 悟郎
paper
注意機構における Attention Sink のバイアス項的解釈 🏆 若手奨励賞
大橋 諭貴, 木谷 頼斗, 佐藤 宏亮, 高橋 良允, 鴨田 豪, 山本 悠士, 塩野 大輝, 坂口 慶祐, 小林 悟郎
paper
大橋 諭貴, 木谷 頼斗, 佐藤 宏亮, 高橋 良允, 鴨田 豪, 山本 悠士, 塩野 大輝, 坂口 慶祐, 小林 悟郎
paper
説明文生成による予測精度の向上に着目した解釈可能なフェイクニュース検出
木谷 頼斗,張 建偉
木谷 頼斗,張 建偉
Experiences
NLP Engineer (Part-time)
Future Corporation
December 2025 - Present
Future Corporation
December 2025 - Present
Assistant for developing online experimental environments for LLMs in Japanese NLP (Administrative Assistant)
Graduate School of Information Sciences, Tohoku University
July 2025 - Present
Graduate School of Information Sciences, Tohoku University
July 2025 - Present
Data Scientist (Internship)
NTT EAST, Inc.
September 2025
NTT EAST, Inc.
September 2025
Research & Development in NLP (Internship)
Future Corporation
August 2025 - September 2025
Future Corporation
August 2025 - September 2025
Awards / Grants
草刈賞 (Kusakari Award)
令和6年度学士論文研究助成金 (Grant for Bachelor's Thesis Research in Fiscal Year 2026)
野崎わかば会 (Nozaki Wakaba Foundation)
Education
Master of Information Science
Graduate School of Information Sciences, Tohoku University
April 2025 - Present
Graduate School of Information Sciences, Tohoku University
April 2025 - Present
Bachelor of Science and Engineering
Department of Systems Innovation Engineering, Faculty of Science and Engineering, Iwate University
April 2021 - March 2025
Department of Systems Innovation Engineering, Faculty of Science and Engineering, Iwate University
April 2021 - March 2025
Hobbies
Skiing
SAJ (Ski Association of Japan) Ski Proficiency Test Level 1 🎿 1st Grade
SAJ (Ski Association of Japan) Ski Proficiency Test Level 1 🎿 1st Grade
Bouldering
RP: 1Q
OS: 2Q
RP: 1Q
OS: 2Q
Coffee
Drip Coffee, Siphon, Flannel Drip Coffee
Drip Coffee, Siphon, Flannel Drip Coffee
Hot Spring (Onsen)
Photography
Canon EOS 5D Mark III
Canon EOS 5D Mark III
GLAY
Enjoy listening to their music and attending live concerts.
Enjoy listening to their music and attending live concerts.
Manga
SLAM DUNK, Rurouni Kenshin, DEATH NOTE
SLAM DUNK, Rurouni Kenshin, DEATH NOTE