Abhinav Goyal

Head of Software Development - GenAI Inference @ Amazon Web Services (AWS)

About

Experienced Software Development Manager with a demonstrated history of innovation and delivery in the information technology industry. Skilled in AI Foundation models, AI based NLP technologies, large scale distributed computing, database technologies and performance tuning, storage solutions and Agile Methodologies. Strong engineering professional with a Master of Engineering (M.Eng.) focused in Computer Engineering w/ ELITE certificate from University of Toronto.

Country

United States

City

Seattle

Industry

Information Technology & Services

Skill

Computer Vision, Natural Language Processing (NLP), User Experience (UX), Responsible AI, Management, Agentic , Generative AI Tools, Artificial Intelligence (AI), Large Language Models (LLM), Deep Learning, C++, Software Development, Engineering, DB2, SQL, Database Administration, Mobile Product Development, Cloud Applications, Computer Graphics, Project Management

Experience

Head of Software Development - GenAI Inference

Amazon Web Services (AWS)

2024-3 - Present · 2 yrs 6 mos

Seattle, Washington, United States

My teams are responsible for all the customer facing interfaces - Bedrock playground, APIs and inference data plane for Bedrock. Our north star vision is to make inference cheaper, faster and infinitely scalable.

Senior Software Development Manager

Amazon Web Services (AWS)

2022-8 - 2024-3 · 1 yr 8 mos

Seattle, Washington, United States

I'm one of the engineering co-founders for Bedrock engineering. During this time, I led the engineering teams for Amazon Bedrock, a managed service to build and scale GenerativeAI applications using Foundation Models, from 28 to ~120 builders across inference, model customization, responsible AI and model provider commerce.

Sr. Software Development Manager

Amazon Web Services (AWS)

2019-7 - 2022-7 · 3 yrs 1 mo

Greater Seattle Area

Lead the engineering teams in Amazon Comprehend - a machine-learning based managed cloud service for natural language processing. https://aws.amazon.com/comprehend/

Senior Software Development Manager

Amazon Web Services (AWS)

2018-4 - 2019-7 · 1 yr 4 mos

Greater Seattle Area

Launched S3 Glacier Deep Archive - the cheapest cloud archival storage by AWS. https://aws.amazon.com/blogs/aws/new-amazon-s3-storage-class-glacier-deep-archive/

Software Development Manager

Amazon Web Services (AWS)

2017-4 - 2018-3 · 1 yr

Seattle, Washington

Manager for Amazon Glacier engineering team. Responsible for creating and maintaining APIs along with backend scalable, distributed systems to handle exabyte scale storage

Software Development Manager

IBM Canada

2016-7 - 2017-4 · 10 mos

Markham, Ontario, Canada

Manager for DB2 SQL Query Compiler and Optimizer team

Software Development Manager

IBM Canada

2015-6 - 2016-7 · 1 yr 2 mos

Toronto, Canada Area

Manager for DB2 foundations team including Security, Operating Systems, Deployment, Licensing and Text search tools.

Advisory Software Engineer

IBM Canada

2014-4 - 2015-7 · 1 yr 4 mos

Toronto, Canada Area

Staff Software Developer

IBM Canada Ltd.

2012-4 - 2014-6 · 2 yrs 3 mos

Toronto, Canada Area

Staff Software Developer - DB2 Expertise: SQL Query Compiler and Optimizer

Software Developer

IBM Canada Ltd.

2009-6 - 2012-3 · 2 yrs 10 mos

Toronto, Canada Area

Software Developer - DB2 databases Expertise: SQL Query Compiler and Optimizer Responsible for solving customer problems and optimizing query compilation and performance tuning.

Software Developer Intern

IBM Canada Ltd.

2007-5 - 2009-5 · 2 yrs 1 mo

Toronto, Canada Area

Worked in the query compiler team to optimize decimal arithmetic queries and improve execution time. Also, worked on project to provide users with recommendations to improve query performance using statistical views.