Yui Oka
π§ Email / π Google Scholar / π OpenReview
I am a Researcher at NTT Human Informatics Laboratories, NTT Corporation, , and an Affiliate Assistant Professor at the Natural Language Processing Laboratory, Nara Institute of Science and Technology (NAIST).
I received my Master of Engineering degree from the Nara Institute of Science and Technology (NAIST) in 2021. I was a member of the Augmented Human Communication Laboratory (AHC Lab) and was supervised by Prof. Satoshi Nakamura. I recently received my Ph.D. in Information Science from Tohoku University, where I was supervised by Associate Prof. Itsumi Saito. At NTT, I conduct research in Natural Language Processing, focusing on positional encoding and long-context modeling in large language models (LLMs). I also apply these theoretical insights to the development of context extension techniques for LLMs.
In recent years, I have drawn on signal processing perspectives to investigate the redesign of positional representations grounded in frequency analysis and wavelet theory.
Publications
- Yui Oka, Kyosuke Nishida, Sho Yokoi. βRoPE Is Not a Proper Relative Position Embedding.β NeurIPS 2026 Position Track.
- Yui Oka*, Kentaro Hanafusa*, Taku Hasegawa, Kyosuke Nishida, Kuniko Saito (* Equal contribution). βProbing Rotary Position Embeddings through Frequency Entropy.β ICLR 2026. [Openreview]
- Yui Oka, Itsumi Saito, Kyosuke Nishida, Kuniko Saito. βFrequency Bands in RoPE: Base Frequency and Context Length Shape the InterpolationβExtrapolation Trade-off.β ICLR 2026. [Openreview]
- Yui Oka, Taku Hasegawa, Kyosuke Nishida, Kuniko Saito. βWavelet-based Positional Representation for Long Context.β ICLR 2025. [Openreview][Arxiv][Poster]
- Yui Oka, Tsutomu Hirao. βImplicit Sense-labeled Connective Recognition as Text Generation.β EMNLP Findings 2023. [ACL Anthology]
- Makoto Morishita*, Keito Kudo*, Yui Oka*, Katsuki Chousa*, Shun Kiyono, Sho Takase, Jun Suzuki (* Equal contribution). βNT5 at WMT 2022 General Translation Task.β WMT 2022. [ACL Anthology]
- Ryo Fukuda, Sashi Novitasari, Yui Oka, Yasumasa Kano, Yuki Yano, Yuka Ko, Hirotaka Tokuyama, Kosuke Doi, Tomoya Yanagita, Sakriani Sakti, Katsuhito Sudoh, Satoshi Nakamura. βSimultaneous Speech-to-speech Translation System with Transformer-based Incremental ASR, MT, and TTS.β O-COCOSDA 2021. [Paper] *Best Student Paper Award
- Ryo Fukuda, Yui Oka, Yasumasa Kano, Yuki Yano, Yuka Ko, Hirotaka Tokuyama, Kosuke Doi, Sakriani Sakti, Katsuhito Sudoh, Satoshi Nakamura. βNAIST English-to-Japanese Simultaneous Translation System for IWSLT 2021 Simultaneous Text-to-text Task.β IWSLT 2021. [ACL Anthology]
- Yui Oka, Katsuhito Sudoh, Satoshi Nakamura. βUsing Perturbed Length-aware Positional Encoding for Non-autoregressive Neural Machine Translation.β ACL-IJCNLP SRW 2021. [Arxiv]
- Yui Oka, Katsuki Chousa, Katsuhito Sudoh, Satoshi Nakamura. βIncorporating Noisy Length Constraints into Transformer with Length-aware Positional Encodings.β COLING 2020. [ACL Anthology]
Biography
- Jul 2024 β Present : Researcher, NTT Human Informatics Laboratories, NTT Corporation
- Oct 2024 β Sept 2026 : Ph.D. Student, Graduate School of Information Sciences, Tohoku University
- Apr 2021 β Jun 2024 : Researcher, NTT Communication Science Laboratories, NTT Corporation
- Apr 2019 β Mar 2021 : Master of Engineering, Nara Institute of Science and Technology (NAIST)
Reviewer
ICML2026, ICLR2026, ICLR2025, ACL Rolling Review (2024-present), LREC-COLING2024, EMNLP2023, COLING2022