Runyu Lu

Biography

• 20 years old now. PhD Student@UMich(Ang Chen&Mosharaf Chowdhury)
• Machine Learning System, mainly on Serving System currently.
• I am very fortunate to be advised by Hao Zhang(UCSD), Lingming Zhang(UIUC) and Zhiyuan Shao(HUST) in my undergrad Research.
• I was involved in the development of ColossalAI@HPCAI-Tech(37k+star), LLVM@SenseTime(not open source), NCNN@Tencent(18k+star).

For any questions, collaborations, or just to connect, don’t hesitate to reach out via email(lry89757@gmail.com)!

Education

---

• B.S. in WuHan, Huazhong University of Science and Technology, the elite program in the Department of Computer Science, with GPA 3.95, 2020.9-2024.6
• PhD Student in Ann Arbor, University of Michigan, Department of Computer Science & Engineering, Advisors: Ang Chen & Mosharaf Chowdhury, 2024.8-present

Publications

WhiteFox: White-box Compiler Fuzzing via Large Language Models

Authors: Chenyuan Yang, Yinlin Deng, Runyu Lu, Jiayi Yao, Jiawei Liu, Reyhaneh Jabbarvand, Lingming Zhang
Object-Oriented Programming, Systems, Languages, and Applications 2024 (in PACM PL)
(OOPSLA 2024), Pasadena, United States, Arxiv available

MuxServe: Flexible Multiplexing for Efficient Multiple LLM Serving

Authors: Jiangfei Duan, Runyu Lu, Haojie Duanmu, Xiuhong Li, Xingcheng Zhang, Dahua Lin, Ion Stoica, Hao Zhang
The 41st International Conference on Machine Learning (system track)
(ICML 2024), Vienna, Austria, Arxiv available

Industrial Experiences

Develop ColossalAI Inference Engine for LLM

@HPCAI-Tech Company                                      Beijing, China; March 2024 - July 2024

• Project: ColossalAI, an open source project with 37k+ stars in Github
• Mentor: Yuanheng Zhao, Shenggui Li and Hongxin Liu

Optimize the LLVM Backend of SenseTime GPU, GPU Compiler

@Sensetime Company                                      Shanghai, China; April 2023 - Augu 2023

• Project: LLVM, the internal version of SenseTime
• Mentor: Wenqiang Yin

Develop High Performance Neural Network Inference Engine

@Tencent Company                                          ShenZhen, China; June 2022 - Nov. 2022

• Project: ncnn, an open source project with 18k+ stars in Github
• Mentor: nihui(with Github 6k followers), and she’s cute :)

Hobbies

• Football, crazy fan of Lionel Messi, FC Barcelona, and Argentina National Team.
• F1, crazy fan of Charles Leclerc(racing in Formula One for Scuderia Ferrari), Guanyu Zhou(a Chinese racing driver who currently competed in Formula One for Stake F1 Team Kick Sauber).
  • fun fact: I have some photos photo1 photo2 with Guanyu :)
• a little dance, like jazz/hiphop