Baotong Lu Get in touch

Research at the intersection of AI and systems

Baotong Lu

AI for Systems. Systems for AI.

Senior Researcher at Microsoft Research Asia

I explore how advances in systems can enable better AI, and how advances in AI can reshape the way we build and operate systems.

Google Scholar GitHub Email
From context to memory to more capable agents A conceptual map of three related research directions. Sparse access selects from a large context; a hierarchy of memory tiers connects storage and computation; capability specialists contribute to an evolving agent memory program. Context, memory, and agents Three related research directions, arranged vertically: sparse attention for long-context inference, hierarchical memory for storage and retrieval, and capability-driven evolution of agent memory. Long-context inference Sparse access Hierarchical memory Storage & retrieval Agent memory Capability-driven evolution
A conceptual view of my research: making context accessible, memory scalable, and agents more capable.

Systems for AI. Designing systems that enable more capable, efficient, and scalable AI.

AI for Systems. Using AI to rethink how systems are designed, built, and operated.

About

Portrait of Baotong Lu

I am a Senior Researcher in the Systems and Networking Research Group at Microsoft Research Asia.

I received my PhD from The Chinese University of Hong Kong in 2023 and visited Simon Fraser University in 2019 and 2023. My research spans machine learning systems and database management systems, with a focus on emerging applications and hardware.

I received the 2021 ACM SIGMOD Research Highlight Award. Dash and APEX were also selected among the Most Influential ArXiv (Databases) Papers (top 30 per year).

  1. 2019 / 2023Simon Fraser UniversityResearch visits
  2. 2023The Chinese University of Hong KongPhD
  3. NowMicrosoft Research AsiaSenior Researcher

Selected publications

Google Scholar

AI Systems

* Students I advised

  1. PREPRINT

    Capability-Driven Self-Evolution of Agent Memory

    Yaoqi Chen, Yuru Feng, Qianxi Zhang, Baotong Lu, Jianan Lu, Zhirui Wang, Shusen Xu, Zewen Jin, Zengzhong Li, Cheng Li, Qi Chen

  2. EMNLP 2026

    Beyond Semantic Organization: Memory as Execution State Management for Long-Horizon Agents

    Yaoqi Chen, Haibin Lai, Yuru Feng, Chuyu Han, Qianxi Zhang, Baotong Lu, Menghao Li, Xinjiang Wang, Zewen Jin, Hao Wu, Cheng Li, Qi Chen

  3. PREPRINT

    Unifying Sparse Attention with Hierarchical Memory for Scalable Long-Context LLM Serving

    Zihan Zhao*, Baotong Lu, Shengjie Lin*, Yizou Chen, Jing Liu, Yanqi Zhang, Ziming Miao, Ming-Chang Yang, Haiying Shen, Qi Chen, Fan Yang

  4. PREPRINT

    DualSpec: Accelerating Deep Research Agents via Dual-Process Action Speculation

    Shuzhang Zhong*, Baotong Lu, Qi Chen, Chuanjie Liu, Fan Yang, Meng Li

  5. VLDB 2026

    RetroInfer: A Vector-Storage Engine for Scalable Long-Context LLM Inference

    Yaoqi Chen*, Jinkai Zhang*, Baotong Lu, Qianxi Zhang, Chengruidong Zhang, Jingjia Luo*, Di Liu, Huiqiang Jiang, Qi Chen, Jing Liu, Bailu Ding, Xiao Yan, Jiawei Jiang, Chen Chen, Mingxing Zhang, Yuqing Yang, Fan Yang, Mao Yang

  6. VLDB 2026

    Aker: Density-Aware Approximate Caching for Vector Search

    Sukjoon Oh*, Minki Kang, Dohyun Kim, Baotong Lu, Jing Liu, Qianxi Zhang, Qi Chen, Youjip Won

  7. SIGMOD 2026

    Towards Efficient and Scalable Distributed Vector Search with RDMA

    Xiangyu Zhi, Meng Chen*, Xiao Yan, Baotong Lu, Hui Li, Qianxi Zhang, Qi Chen, James Cheng

  8. SIGMOD 2026

    Attribute Filtering in Approximate Nearest Neighbor Search: An In-depth Experimental Study

    Mocheng Li, Xiao Yan, Baotong Lu, Yue Zhang, James Cheng, Chenhao Ma

  9. PPoPP 2025

    SGDRC: Software-Defined Dynamic Resource Control for Concurrent DNN Inference on NVIDIA GPUs

    Yongkang Zhang, Haoxuan Yu, Chenxia Han, Cheng Wang, Baotong Lu, Yang Li, Xiaowen Chu, Huaicheng Li

  10. NeurIPS 2025

    RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval

    Di Liu*, Meng Chen*, Baotong Lu, Huiqiang Jiang, Zhenhua Han, Qianxi Zhang, Qi Chen, Chengruidong Zhang, Bailu Ding, Kai Zhang, Chen Chen, Fan Yang, Yuqing Yang, LiLi Qiu

    NeurIPS 2025 main track · NeurIPS 2024 ENLSP Workshop Best Paper Award

  11. AAAI 2020

Database Management Systems

  1. VLDB 2024

    DEX: Scalable Range Indexing on Disaggregated Memory

    Baotong Lu, Kaisong Huang, Mike Chieh-Jan Liang, Tianzheng Wang, Eric Lo

  2. VLDB 2022

    Are Updatable Learned Indexes Ready?

    Chaichon Wongkham, Baotong Lu, Chris Liu, Zhicong Zhong, Eric Lo, Tianzheng Wang

  3. VLDB 2022

    APEX: A High-Performance Learned Index on Persistent Memory

    Baotong Lu, Jialin Ding, Eric Lo, Umar Faroop Minhas, Tianzheng Wang

    Abstract at NVMW 2022 ↗

  4. SIGMOD RECORD 2021

    Scaling Dynamic Hash Tables on Real Persistent Memory

    Baotong Lu, Xiangpeng Hao, Tianzheng Wang, Eric Lo

    Volume 50, Issue 1 · Technical Perspective from Prof. Ken Ross

  5. VLDB 2020

    Dash: Scalable Hashing on Persistent Memory

    Baotong Lu, Xiangpeng Hao, Tianzheng Wang, Eric Lo

    Code ↗ · Abstract at NVMW 2021 ↗

    2021 ACM SIGMOD Research Highlight Award

    DragonflyDB's core hash table structure is based on Dash.

Academic service

Publications Chair

SoCC 2026

Program Committees

SIGMOD 2027
VLDB 2027 (PVLDB 20), 2026 (PVLDB 19), 2025 (PVLDB 18)
EuroSys 2027, 2026 · SoCC 2026
ICDE 2026 · EDBT 2026 · APSys 2025
ChinaSys 2025, 2024

Editorial & Reviewing

Reviewer: ICLR 2027
VLDB Journal Reviewer Board, 2025–2026
SIGMOD Availability Committee 2023, 2022
Reviewer: VLDBJ, ACM TOS, IEEE TKDE, IEEE TCAD

External reviewing

SIGMOD 2024, ICDE 2024, SIGMOD 2022, ICDE 2022, VLDB 2021, SIGMOD 2021, ICDE 2021, EDBT 2021, ATC 2020, DASFAA 2019, VLDB 2018 (Demo)

Selected awards

Best Paper Award, ENLSP Workshop @ NeurIPS
2024
ACM SIGMOD Research Highlight Award
2021
Mitacs Globalink Research Award
2022
China National Scholarship
2015, 2017