Previously, I received my B.E. from Xinya College (a liberal arts college) at Tsinghua University. I was also a research intern at Apple ML Research and UCLA.
I'm interested in sparse memory as an alternative scaling axis for language models. In particular, can we scale knowledge capacity without proportionally increasing computation? Towards this goal, my work on LMLM explored separating factual knowledge from model parameters through external knowledge storage.
Outside of research, I'm an unprofessional volleyball player and an amateur photographer. I'm always happy to connect, so feel free to reach out for a chat or collaboration.
Pre-training Limited Memory Language Models with Internal and External Knowledge
Linxi Zhao, Sofian Zalouk, Christian K. Belardi, Justin Lovelace, Jin Peng Zhou, Ryan Thomas Noonan, Dongyoung Go, Kilian Q. Weinberger, Yoav Artzi, Jennifer J. Sun
ICLR 26' (Top 2%)
CCFM @ Neurips 25' Best Paper Runner-up
[Arxiv]
|
[Project Page]
|
[Github]
|
[Talk]
LMLM is pronounced as LamLam 🦙.
Co-Evolving Structured Knowledge and Reasoning in Language Models
Ryan Thomas Noonan*, Linxi Zhao*†, Menghan Xu*, Akanksha Sarkar, Mihir Mishra, Dongyoung Go, Kilian Q. Weinberger, Yoav Artzi, Jennifer J. Sun
COLM 26'
† project lead
Elastic Compression of Interleaved Image–Text Contexts
Kulin Shah*, Linxi Zhao*, Pavan Kumar Anasosalu Vasu, Fartash Faghri, Cem Koc, Oncel Tuzel
[Coming soon]
Work done at Apple ML Research
Gold Reviewer Award, ICML
Gold Medalist, Beijing Intercollegiate Tournament
Tsinghua's Golden Social Practice Award