Paper Accepted at BabyLM Workshop at EMNLP 2026 🍼👶
We explore the impact of structural priors on loss and model’s linguistic capabilities in here.
Started PhD 📚
Good news! I joined HuDS lab at Universität Göttingen, led by Prof. Dr. Lisa Beinborn. I will work on sample-efficient strategies for cognitively plausible multilingual NLP. I am also advised by Prof. Dr. Alexander Ecker (Universität Göttingen) and Prof. Dr. Edoardo Ponti (University of Edinburgh). Yay, let’s do cool research!
Master Thesis Defended! 📜
I have successfully defended my MSc thesis on the topic “Why Better Cross-Lingual Alignment Fails for Better Cross-Lingual Transfer?”, advised by Yihong Liu (LMU Munich) and supervised by Prof. Dr. Vera Demberg (Saarland University) and Prof. Dr. Hinrich Schütze (LMU Munich).
See older news
Paper Accepted at NeurIPS 2025 👏
Our paper investigates how architectural limitations of Transformers manifest after pretraining. Read it here.
Paper Accepted at COLM 2025 ✨
We mechanistically explore the information flow in ICL tasks in Gemma model family. Read more here.
Paper Accepted at LoResLM workshop at COLING 2025 🇰🇿🇺🇿🇰🇬🇹🇲
Our paper is a survey on current state of the art technologies for Turkic Central Asian languages. Read more here.
Paper Accepted at NeurIPS 2024 🎉
We study expressivity of SSMs in comparison to Transformers and RNNs. Read the full paper here.