Simon Lui

Served as the highest-ranking technical authority in the multimedia / multimodal domain, steering technology strategy and roadmaps across Huawei’s device ecosystem (smartphones, wearables, tablets, and smart automotive), while leading research teams across multiple global R&D centers. Defined next-generation technical standards and user-experience frameworks, with a focus on taking multimodal and agentic AI from research into production at billion-device scale. Selected outcomes: • HarmonyOS Gallery “Highlights”: Led multimodal AI for automated video summarization and generation; visual–audio understanding deployed across billion-scale smartphones. • Xiaoyi AIGC: Led flagship AIGC from humming to high-quality accompaniment; featured as a keynote innovation at Huawei Developer Conference (HDC) 2025. • Xiaoyi Full-Duplex Dialogue: Pioneered full-duplex AI Agent interaction with real-time interruption and natural turn-taking, rolled out across Huawei smart devices. • Spatial Up-mixing: Built fully automated spatial up-mixing, removing manual production bottlenecks and achieving 99%+ coverage of top-tier streaming content. • Content Search & Recommendation: Directed content-based deep learning to surface long-tail quality content, improving ecosystem health beyond pure popularity ranking. 作為多模態領域最高職級首席專家，引領華為全生態（手機、穿戴、平板、智能車機等）技術策略與路線圖，領導全球多個研究中心團隊，推動多模態與智能體 AI 從研發到十億級設備規模落地，並定義下一代技術標準與體驗規範。

Held the exclusive technical rank of T14 — the sole and highest-ranking technical expert across Tencent Music Entertainment (TME). Owned core technology strategy and implementation for flagship products QQ Music and WeSing, with direct accountability for large-scale AIGC and audiovisual systems serving 100M+ DAU. Selected outcomes: • Hit Content Prediction (PDM): Led multimodal AI system for identifying hit content and rising artists; cited as a core commercial asset in TME’s annual financial reports. • Super-Resolution: Launched the industry’s first commercial deep-learning content restoration system, revitalizing legacy catalog and improving long-term user satisfaction. • Commercial AIGC: Built the first large-scale Transformer-based AI accompaniment system; MIREX 2020 Champion (Pattern Recognition). • Audio Identification: Developed noise-robust fingerprinting supporting hundreds of millions of daily requests; MIREX 2019 Champion (Audio Fingerprint). • Automated Lyric Timestamping: Pioneered industry-first lyrics-to-music synchronization at scale, cutting production cost; China Patent Excellence Award. • National Standards: Lead author of China’s first national industry standard for “5G Ultra-HD Digital Music Quality". TME 全集團首位及唯一 T14 級技術專家，行使最高技術決策權；主導 QQ 音樂與全民 K 歌核心技術策略與落地，推動 AIGC 及音視頻系統在億級 DAU 規模商用。

Served as Principal Investigator (PI) for 10 national-level research grants, securing and managing over HK$20 million in total funding. Research focused on audio-visual processing, Artificial Intelligence, and Human-Computer Interaction (HCI). Acted as Doctoral Advisor ; successfully mentored and graduated three Ph.D. students who currently hold key positions in academia and global technology firms. Served as the Director of the SUTD Game Lab (formerly the Singapore-MIT GAMBIT Game Lab). Led interdisciplinary teams to develop next-generation game media technologies.

Conducted pioneering research in multimodal perception and human-centric sensing at the MIT Computer Science and Artificial Intelligence Laboratory (CSAIL). Designed and instructed the graduate-level Machine Learning curriculum. Developed and synchronized all courseware and materials for global access on edX, serving as a public resource for scholars and developers worldwide.

To design, test and integrate novel, computationally efficient techniques that will present high-quality audio and video in portable devices, in a way to maximise the quality perceived by the user. Conducted research on computationally efficient multimedia processing and perceptual quality optimization for portable devices under the prestigious EU Marie Curie Fellowship.

Professional composer, arranger, and violinist with a legacy of high-profile leadership, including serving as Concertmaster for the 1997 Hong Kong Handover Ceremony. Vocal percussionist (Beatboxer) and violinist with an extensive performance and production portfolio, collaborating with industry icons such as Eason Chan, Andy Lau, Sammi Cheng, and Leo Ku. 專業作曲、編曲及小提琴演奏家； 曾於1997年香港回歸典禮，作為首席小提琴，帶領管弦樂團演奏； 唱片製作及小提琴獨奏，合作歌手有方皓玟、蘇永康、傅珮嘉、王浩信、關楚耀、林海峰等； 作為節奏口技演奏家 (Beatboxer) ，與陳奕迅、劉德華、鄭秀文、古巨基等業界巨星同台演出。