Senior Researcher / Microsoft Research Asia
I am Baotong Lu. I work at the intersection of AI and systems, building efficient infrastructure for intelligence and exploring how intelligence can improve systems.
Baotong LuResearcher. Systems builder.
I am a Senior Researcher in the Systems and Networking Research Group at Microsoft Research Asia.
I received my PhD from The Chinese University of Hong Kong in 2023 and visited Simon Fraser University in 2019 and 2023. My research spans machine learning systems and database management systems, with a focus on emerging applications and hardware.
I received the 2021 ACM SIGMOD Research Highlight Award. Dash and APEX were also selected among the Most Influential ArXiv (Databases) Papers (top 30 per year).
Make intelligence and its underlying systems work better, together. My current focus is on agentic AI and systems.
Use learning and intelligence to rethink how systems organize data, make decisions, and adapt to workloads.
Build efficient, scalable infrastructure for long-context LLMs and AI agents, from memory and retrieval to inference.
Unifying Sparse Attention with Hierarchical Memory for Scalable Long-Context LLM Serving
Co-designing sparse attention and hierarchical KV memory for scalable serving.
LONG-CONTEXT INFERENCEA Vector-Storage Engine for Scalable Long-Context LLM Inference
Bringing vector storage and retrieval to long-context LLM inference.
SELF-EVOLVING AGENT MEMORYCapability-Driven Self-Evolution of Agent Memory
Refining capability specialists and integrating their gains into a unified memory program.
* Students I advised
Yaoqi Chen, Yuru Feng, Qianxi Zhang, Baotong Lu, Jianan Lu, Zhirui Wang, Shusen Xu, Zewen Jin, Zengzhong Li, Cheng Li, Qi Chen
Yaoqi Chen, Haibin Lai, Yuru Feng, Chuyu Han, Qianxi Zhang, Baotong Lu, Menghao Li, Xinjiang Wang, Zewen Jin, Hao Wu, Cheng Li, Qi Chen
Zihan Zhao*, Baotong Lu, Shengjie Lin*, Yizou Chen, Jing Liu, Yanqi Zhang, Ziming Miao, Ming-Chang Yang, Haiying Shen, Qi Chen, Fan Yang
Shuzhang Zhong*, Baotong Lu, Qi Chen, Chuanjie Liu, Fan Yang, Meng Li
Yaoqi Chen*, Jinkai Zhang*, Baotong Lu, Qianxi Zhang, Chengruidong Zhang, Jingjia Luo*, Di Liu, Huiqiang Jiang, Qi Chen, Jing Liu, Bailu Ding, Xiao Yan, Jiawei Jiang, Chen Chen, Mingxing Zhang, Yuqing Yang, Fan Yang, Mao Yang
Sukjoon Oh*, Minki Kang, Dohyun Kim, Baotong Lu, Jing Liu, Qianxi Zhang, Qi Chen, Youjip Won
Zebin Yang, Tong Xie, Baotong Lu, Shaoshan Liu, Bo Yu, Meng Li
Xiangyu Zhi, Meng Chen*, Xiao Yan, Baotong Lu, Hui Li, Qianxi Zhang, Qi Chen, James Cheng
Mocheng Li, Xiao Yan, Baotong Lu, Yue Zhang, James Cheng, Chenhao Ma
Yongkang Zhang, Haoxuan Yu, Chenxia Han, Cheng Wang, Baotong Lu, Yang Li, Xiaowen Chu, Huaicheng Li
Di Liu*, Meng Chen*, Baotong Lu, Huiqiang Jiang, Zhenhua Han, Qianxi Zhang, Qi Chen, Chengruidong Zhang, Bailu Ding, Kai Zhang, Chen Chen, Fan Yang, Yuqing Yang, LiLi Qiu
NeurIPS 2025 main track · NeurIPS 2024 ENLSP Workshop Best Paper Award
Pengfei Zhang, Eric Lo, Baotong Lu
Hantian Zha, Teng Ma, Baotong Lu, Yuansen Wang, Dongbiao He, Yuanhui Luo, Dafang Zhang, Yunpeng Chai, Yuxing Chen, Anqun Pan
Baotong Lu, Kaisong Huang, Mike Chieh-Jan Liang, Tianzheng Wang, Eric Lo
Chaichon Wongkham, Baotong Lu, Chris Liu, Zhicong Zhong, Eric Lo, Tianzheng Wang
Baotong Lu, Jialin Ding, Eric Lo, Umar Faroop Minhas, Tianzheng Wang
Baotong Lu, Xiangpeng Hao, Tianzheng Wang, Eric Lo
Volume 50, Issue 1 · Technical Perspective from Prof. Ken Ross
Baotong Lu, Xiangpeng Hao, Tianzheng Wang, Eric Lo
Code ↗ · Abstract at NVMW 2021 ↗
2021 ACM SIGMOD Research Highlight Award
DragonflyDB's core hash table structure is based on Dash.
REVIEW / SHARE / BUILD
SoCC 2026
SIGMOD 2027
VLDB 2027 (PVLDB 20), 2026 (PVLDB 19), 2025 (PVLDB 18)
EuroSys 2027, 2026 · SoCC 2026
ICDE 2026 · EDBT 2026 · APSys 2025
ChinaSys 2025, 2024
Reviewer: ICLR 2027
VLDB Journal Reviewer Board, 2025–2026
SIGMOD Availability Committee 2023, 2022
Reviewer: VLDBJ, ACM TOS, IEEE TKDE, IEEE TCAD
SIGMOD 2024, ICDE 2024, SIGMOD 2022, ICDE 2022, VLDB 2021, SIGMOD 2021, ICDE 2021, EDBT 2021, ATC 2020, DASFAA 2019, VLDB 2018 (Demo)