I am a first-year Master’s student at the School of Computer Science, Sun Yat-sen University, under the supervision of Prof. Xianwei Zhang. Previously I completed my Bachelor’s degree at the School of Computer Science and Engineering, South China University of Technology (SCUT).

I am particularly interested in building practical, scalable and efficient systems for machine learning (MLSys) like serving system. Currently, my research focuses on optimizing KV Cache management, developing efficient inference scheduling strategies, and designing multi-agent systems.

🛠️ Skills

• Programming Languages: Python, C++, Shell, CUDA
• Frameworks: PyTorch, VLLM, SGLang
• Tools: Git, Linux, Docker

🚀 Projects

• 2025.01 - now YatCC-AI
  • Deployed Deepseek-R1 model for course students’ use
  • Responsible for the model serving system development and maintenance
• 2024.06 - 2024.08 Large Language Model Inference Framework
  • Built a high-performance inference framework from scratch supporting LLaMA/Qwen models
  • Developed efficient CUDA operators including RMSNorm, GEMV, and multi-head attention
  • Implemented KV Cache mechanism for optimized inference with dynamic batching support
  • Designed unified memory management system for automatic CPU/GPU memory handling
  • Utilized Nsight Compute for performance analysis and operator optimization
• 2022.11 - 2023.02 Single-Machine SQL Database (CMU-15445)
  • Implemented a thread-safe buffer pool with LRU-K replacement algorithm
  • Developed concurrent B+ Tree index with optimistic locking
  • Built query execution engine supporting SELECT, JOIN, and other SQL operations
• 2022.09 - 2022.12 RISC-V Unix-like Operating System (MIT6.S081)
  • Implemented virtual memory management with lazy allocation
  • Developed copy-on-write fork and alarm system calls
  • Enhanced file system performance with multi-threaded block cache

🎖 Honors and Awards

• 2024.09 Second-Class Scholarship, Sun Yat-sen University
• 2023.09 & 2022.09 Second-Class Scholarship, South China University of Technology
• 2021.09 Anjubao Enterprise Scholarship (Ranked 5/73)

📖 Educations

• 2024.09 - present, Master, School of Computer Science, Sun Yat-sen University
• 2020.09 - 2024.06, Undergraduate, School of Computer Science and Engineering, South China University of Technology(12/166)

💻 Internships

• 2023.06 - 2023.08, Algorithm Engineer Intern, Research and Development Center, China Guangfa Bank, Foshan