Tong Liu

Cloud GenAI Inference Infra @ Google

About

Empowering Gemini GenAI models on the cloud.

Country

United States

City

Mountain View

Industry

Computer Software

Skill

SOA, Software Engineering, Distributed Systems, Java, Unix, Agile Methodologies, Scalability, Cloud Computing, C++, Algorithms, Software Development, Hadoop, JavaScript, MapReduce, Perl, Python, C, Advertising, Shell Scripting

Experience

Cloud GenAI Inference Infra

Google

2024 - Present · 2 yrs

Mountain View, California, United States

Leading Google Cloud GenAI's Gemini serving infra, provisioned throughput, quota and capacity management, and responsible AI infra for GenAI.

Senior Software Engineering Manager

Facebook

2020 - 2024 · 4 yrs

Menlo Park, California, United States

Leading Facebook's AI Infra's model processing platform to optimize models in post-training for best inference performance. Delivered critical 0->1 initiatives and scaled for company wide adoption. Greatly improved Facebook's model freshness from xx hours to x minutes, landed significant business wins across the company. Managing 4 engineering teams of ~50 engineers and managers. Also led Ads ML Infra's large ML model iteration automation, online A/B testing platform, and offline model quality evaluation infra. Responsible for setting technical vision and direction, hiring key talents, building organizations, and execution.

Senior Software Engineering Manager

Google

2006 - 2020 · 14 yrs

Senior Engineering Manager. Mobile App Display Ads Platform (AdMob). Supported multiple teams. Led the team to completely revamp the entire data foundation, including log processing, stats serving, data API, data warehouse, reporting frontend. Also supported AdMob Front End (www.admob.com) and platform APIs teams. Supported AdMob high revenue growth to multi-billion dollars.