Nosheen S.

Director of Software Engineering - AI Infra (GPU / TPU) @ Google

About

At Google, I lead global engineering teams building planet scale AI infrastructure extracting the best out of AI/ML Accelerators (GPUs and TPUs), optimize, fine tune & scale foundational Frontier and OSS AI Models while helping customers attain best performance of any AI Supercomputer stack (HW & SW) for Training, RL and Inference while providing best in class e2e ML Developer Experiences.

Country

United States

City

Redmond

Industry

Computer Software

Skill

Windows Azure, Product Planning, Cloud Computing, Distributed Systems, Software Project Management, Software Design, Scalability, Agile Methodologies, Software Development, Enterprise Software, Scrum, Agile Project Management, Microsoft SQL Server, SQL Azure, People Development, Managing Managers, Managing Offshore Teams, Change Management, Team Leadership, Team Management

Experience

Director of Software Engineering - AI Infra (GPU / TPU)

Google

2025-3 - Present · 1 yr 7 mos

Greater Seattle Area

- Scaling, Optimizing, Fine Tuning AI infra for Training, RL and Inference across GPUs / TPUs. - “Building Planet Scale AI Infra - AI Super-Computer Cluster as a Service” -Empower customers to leverage the power of GPUs & TPUs

Sr.Partner Director (GM) of Software Engineering- Microsoft CoPilot for Industries

Microsoft

2022-9 - 2025-3 · 2 yrs 7 mos

Redmond, Washington, United States

Engineering Foundational AI Services for Business and Industry CoPilots across Microsoft Cloud for Enterprises in the Gen AI Era

Director - Google Cloud Storage

Google

2021-2 - 2022-9 · 1 yr 8 mos

Greater Seattle Area

Engineering of storage products for Google Cloud Platform - including Google Cloud Storage (object), Filestore (file) and Transfer Appliance (bulk data movement).

GM Engineering - Alexa AI Skills Platform

Amazon

2016-9 - 2021-2 · 4 yrs 6 mos

Seattle, Washington

Built and ran the RunTime and Developer Platform Platform for Alexa Skills. Enabling several millions of developers to access the intelligence of Alexa. Responsible for development, publishing into market place, serving Alexa traffic with industry leading low latency, scaling the platform from 100 - 1M voice apps in marketplace and enabling international traffic to grow 4x. Launched industry first Hosted Skills product enabling better and increased privacy and security. Led large internationally distributed engineering teams along with Product/Program management responsibilities as a GM.

Principal Group Head of Engineering - Azure Data Platform

Microsoft

2013-9 - 2016-9 · 3 yrs 1 mo

Redmond

Owned building and launching of the very first version of SQL Server on a VM (IAAS on Azure), in-memory DB features on cloud and Always-On (HADR) solution on Azure for SQL Databases as well as OSS Databases like PG, MySQL on Azure along with an AI powered personalized diagnostics solution for enterprise workloads called Enterprise Concierge Service. Built the very first Conversational Understanding (Voce Flow) in a Public Cloud (Azure) for Cortana and enabled several million developers to adopt and build Cortana Applications for enterprises. Led large distributed Engineering teams along with Product/Program Management responsibilities

Engineering Leader - SQL Server Data Platform

Microsoft

2006-11 - 2013-9 · 6 yrs 11 mos

Redmond, Washington, United States

Started as an engineer building large scale database systems for Microsoft clients like London Stock Exchange, NASDAQ e.t.c. Went onto build newer versions of ODBC, OLEDB drivers for data access. Worked on building next generation of Database features in SQL Server Versions 2005, 2008, 2008 R2, 2010 and 2012.

Co-Founder

Advanced Technology Labs, India

1998-9 - 2000-6 · 1 yr 10 mos

Chennai, India

Startup providing e-commerce solutions to supply chain management across various manufacturing industries. Specifically helping large inventory management happen automatically and at the finger tips of floor managers at various manufacturing plants.