Xiaoyang Sun

What makes the desert beautiful is that somewhere it hides a well.

Follow me on GitHub

EDUCATION

2019 – Present » Ph.D., University of Leeds (UK),
Large Language Models Acceleration in Resource-Limited Environments.

2015 – 2018 » Master of Engineering, Beihang University,
Efficient Resource Management in Large-Scale Clusters.

2011 – 2015  » Bachelor & Excellent Graduate, Zhengzhou University,
Computer Science and Technology.

PUBLICATIONS

  • QoS-Aware Co-Scheduling for Distributed Long-Running Applications on Shared Clusters.
    [CCF A] IEEE Transactions on Parallel and Distributed Systems (TPDS)
    Zhu, Jianyong ; Yang, Renyu; Sun, Xiaoyang; Wo, Tianyu; Hu, Chunming; Peng, Hao; Xiao, Junqing; Zomaya, Albert; Xu, Jie

  • STRONGHOLD: Fast and Affordable Billion-scale Deep Learning Model Training.
    [CCF A] IEEE/ACM Super Computing (SC2022)
    Xiaoyang Sun, Wei Wang, Shenghao Qiu, Renyu Yang, Songfang Huang, Jie Xu, Zheng Wang

  • AIACC-Training: Optimizing Distributed Deep Learning Training through Multi-streamed and Concurrent Gradient Communications.
    [CCF B] IEEE International Conference on Distributed Computing Systems (ICDCS2022)
    Lixiang Lin, Shenghao Qiu, Ziqi Yu, Liang You, Long Xin, Xiaoyang Sun, Jie Xu, Zheng Wang

  • PRComm: Anti-interference Cross-Technology Communication Based on Pseudo-random Sequence.
    [CCF B] International Conference on Information Processing in Sensor Networks (IPSN2021)
    Wang Wei, He Dingsheng, Gu Tao, Jia Wan, Liu Haiyan, Sun Xiaoyang, Wu Fuping, Chen Xiaojiang

  • Automated Conformance Testing for JavaScript Engines via Deep Compiler Fuzzing.
    [CCF A] 42nd ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI2021)
    Guixin Ye, Zhanyong Tang, Shin Hwei Tan, Dingyi Fang, Xiaoyang Sun, Lizhong Bian, Songfang Huang, Haibo Wang, Zheng Wang

  • Performance-aware Speculative Resource Oversubscription for Large-scale Clusters.
    [CCF A] IEEE Transactions on Parallel and Distributed Systems (TPDS2022)
    Renyu Yang, Chunming Hu, Xiaoyang Sun, Peter Garraghan, Tianyu Wo, Zhenyu Wen, Hao Peng , Jie Xu, and Chao Li

  • ROSE: Efficient Cluster Scheduling through Speculative Resource Overselling.
    [CCF B] 38th IEEE International Conference on Distributed Computing Systems (ICDCS2018)
    Xiaoyang Sun, Chunming Hu, Renyu Yang, Peter Garraghan, Tianyu Wo, Jie Xu, Jianyong Zhu, Chao Li

  • ROSE: Cluster Scheduling through Efficient Resouce OverSElling(Poster).
    [CCF A] 26th ACM Symposium on Operating Systems Principles (SOSP2017)
    Xiaoyang Sun, Chunming Hu, Renyu Yang, Peter Garraghan, Chao Li.

PROJECTS

  • 2022 – 2023 » LLMs Inference Acceleration.
    Research Intern at Alibaba DAMO Academy

  • 2021 – 2022 » Affordable Billion-Scale Pre-trained NLP Models’ Training.
    Research Intern at Alibaba DAMO Academy

  • 2019 – 2021 » QoS Provision at Massive Scale Data Centers.
    Research Assistant at University of Leeds (UK)

  • 2017 – 2018 » Efficient Resource Management (China’s National Key R&D Program).
    Research Intern at Alibaba Cloud

  • 2016 – 2017 » Hybrid Cloud (China’s National 863 Program).
    Research Assistant at Beihang University

  • 2015 summer » Real-time Computing System.
    Development Intern at Alibaba Group

PATENTS

  • An effective node selection method and device based on runtime machine load and task state machine Chunming Hu, Xiaoyang Sun, Renyu Yang et al. [Chinese Patent]. ID: 201710957096.4, Date: 2017.10.16.

  • Cross-realm multiple replica synchronization in distributed file systems Chunming Hu, Lele Du, Jie Sun, Xiaoyang Sun. [Chinese Patent]. ID: 201610425836.5, Date: 2016.06.16.

TOP