×
Junjun Deng

Junjun Deng

Staff Software Engineer | ML Infrastructure & Distributed Systems

China, CN
+8613126496289
Chinese, English

Background


About

About

Staff Software Engineer with 10+ years of experience specializing in ML Infrastructure, distributed systems, and large-scale recommendation systems. Currently leading MLOps initiatives at Tubi, serving 100M+ monthly active users. Expertise in Kubernetes, experimentation platforms, and high-performance backend services.

Work Experience

Work Experience

  • Staff Software EngineerTubi Inc.

    Jan, 2021 - Present

    Serve as a key member of the ML Infrastructure team at Tubi, a leading US AVOD streaming service with 100M+ monthly active users.

    • Architect and maintain critical MLOps services that power Tubi's recommendation system

    • Built online feature store processing 500K+ reads/sec and 1M+ writes/sec

    • Manage personalization orchestrator service coordinating 100+ machine learning models

    • Drive infrastructure improvements directly impacting user engagement and platform scalability

  • Senior Software EngineerAlibaba Group

    Nov, 2018 - Dec, 20202 years 1 month

    Led the design and implementation of multiple mission-critical services for UC News, a service integrated with UC Browser serving 100M+ users.

    • Designed and implemented mission-critical services for UC News platform

    • Served 100M+ users across multiple regions

    • Built high-performance backend services with focus on scalability and reliability

  • Architect & R&D Director, Maiduote Ltd

    Sep, 2017 - Nov, 20181 year 2 months

    Directed R&D department and established AI department from the ground up.

    • Established and led a 5-person AI department from scratch

    • Delivered knowledge graph-based chatbot for healthcare platform

    • Reduced doctor-patient communication time by 60% while maintaining high accuracy

    • Led architectural refactoring of 24haowan.com healthcare platform

  • Cofounder & Technical Lead, Shuyun E-commerce Ltd

    Jul, 2016 - Sep, 20171 year 2 months

    Co-founded and served as Technical Lead for a startup.

    • Conceptualized and built SameMo, a smart photo-sharing application with facial recognition

    • Delivered complete solution: back-end infrastructure, iOS and Android apps in 4 months

    • Led product vision and full-stack development from concept to market launch

    • Pioneered innovative photo collection technology in Chinese market

  • Senior Software EngineerSafetyCulture Inc.

    Jan, 2015 - Jun, 20161 year 5 months

    Developed and maintained Android application for iAuditor, a leading workplace safety inspection platform used by 30K+ organizations worldwide.

    • Built key features for iAuditor Android app used by 30K+ organizations

    • Implemented offline data synchronization and report generation

    • Contributed to mobile application serving global enterprise customers

Projects Experience

Projects Experience

  • Accelerating ML Experimentation with Interleaving - 20x Sensitivity Gain

    Jan, 2025 - Jan, 20251 day

    Led a cross-team initiative to implement interleaving experiments for Tubi's recommendation system, achieving 20x higher sensitivity compared to traditional A/B testing.

    • Achieved 20x higher sensitivity compared to traditional A/B testing

    • Enabled direct comparison of ranking algorithms through interleaved result presentation

    • Reduced experiment duration from weeks to days

    • Accelerated ML model iteration velocity across entire ML organization

  • Automated Resource Optimization for Large-Scale ML Model Serving

    Jan, 2024 - Jan, 20241 day

    Led a cost optimization initiative for Tubi's machine learning infrastructure, managing hundreds of Kubernetes pods serving 100+ models.

    • Managed hundreds of Kubernetes pods serving 100+ models across thousands of CPU cores

    • Implemented intelligent orchestration of HPA and VPA

    • Achieved 24% reduction in infrastructure costs (saving $500K+ annually)

    • Maintained service quality while optimizing resource utilization

  • SameMo - Smart Photo Sharing Platform

    Jan, 2016 - Jan, 20171 year

    Developed an innovative mobile application that leverages facial recognition technology to automatically help users discover and collect their photos taken by others.

    • Leveraged facial recognition for automatic photo collection

    • Pioneered concept in Chinese market

    • Single-handedly designed complete product experience and full-stack implementation

    • Delivered production-ready back-end, iOS, and Android apps in 4 months

  • Android Port of ImageMagick

    Jan, 2014 - Present

    Successfully ported the renowned cross-platform ImageMagick image processing library to Android OS.

    • Enabled advanced image manipulation capabilities for mobile developers

    • Gained 200+ GitHub stars

    • Actively used in production applications requiring professional-grade image processing

  • KubeScript

    Jan, 2022 - Present

    Founded and currently lead the KubeScript open-source project, a DRY infrastructure-as-code solution that simplifies Kubernetes DevOps workflows.

    • Created DRY infrastructure-as-code solution for Kubernetes

    • Reduces configuration complexity for multi-environment management

    • Improves maintainability for teams managing Kubernetes deployments

  • Open Source Contributions

    - Present

    Contributed to various open-source projects.

    • Rust programming language

    • TensorFlow

    • Helidon web server

Skills

Skills

  • ML Infrastructure

    Kubernetes

    Docker

    MLOps

    Model Serving

    Microservices

    HPA/VPA

  • Experimentation

    A/B Testing

    Interleaving Experiments

    Statistical Analysis

  • Programming Languages

    Python

    Java

    Scala

    C/C++

    TypeScript

    Rust

    Haskell

    Go

  • Cloud & DevOps

    AWS

    GCP

    Terraform

    CI/CD

    Infrastructure-as-Code

  • ML & Data

    TensorFlow

    Recommendation Systems

    Distributed Training

  • Backend

    MySQL

    Cassandra

    PostgreSQL

    Redis

    Message Queues

  • Systems

    Linux/Unix

    Distributed Systems

    Monitoring & Observability

  • Web Development

    React

    Flask

    Django

    REST APIs

    gRPC

Education

Education

  • Computing and Mathematics, Master of Science (Honours), University of Western Sydney

    Jan, 2012 - Jan, 2014

    Answer Set Programming

    Artificial Intelligence

  • Network Engineering, Bachelor of Engineering, Sun Yat-sen University

    Jan, 2007 - Jan, 2011

    Distributed Systems

    Algorithms

    Network Architecture

Awards

Awards

  • Qatar National Foundation Postgraduate Research Award , University of Western Sydney

    Awarded on: Jan 01, 2012

    Full scholarship for postgraduate research (2012-2014)

  • National Endeavor Scholarship , Sun Yat-sen University

    Awarded on: Jan 01, 2010

    Merit-based scholarship for academic excellence

Publications

Publications

  • Answer Set Programming with One Incremental Variable (ivASP), Academic Journal

    Published on: Jan 01, 2014

    Proposed ivASP as a novel extension to traditional Answer Set Programming. Developed a complete solver implementation and published peer-reviewed research documenting theoretical foundations and practical applications.