Nikhil Reddy

Azure Data Engineer @ AIG

About

I am a Data Engineer with over 6+ years of experience working with cloud platforms like Azure, AWS, and GCP. I build and manage data pipelines using tools like Python, SQL, Spark, and Kafka. I have worked on both real-time and batch data systems. I enjoy solving problems, working with big data, and helping teams make better decisions using clean and reliable data.

Country

United States

City

The Colony

Industry

Computer Software

Skill

GCP BigQuery, Cloud Storage, AWS (S3, EMR), Maven, Amazon Kinesis, Amazon CloudWatch, Kubernetes, Azure Synapse, PySpark, Oracle Database, Microsoft SQL Server, Azure DevOps, Terraform, RDBMS, Linux, Windows, MongoDB, PostgreSQL, Continuous Integration and Continuous Delivery (CI/CD), Docker

Experience

Azure Data Engineer

AIG

2022-10 - Present · 4 yrs

Chicago, IL

Build and manage data pipelines using Azure Data Factory, Synapse, and Databricks. Work with PySpark, SQL, and Python for data transformation and automation. Integrate data from Oracle, SQL Server, and MongoDB into Azure Data Lake. Implement CI/CD pipelines with Azure DevOps for automated deployments. Optimize performance and ensure data quality for analytics and reporting.

AWS Data Engineer

Domino's

2022-3 - 2022-10 · 8 mos

Ann Arbor, MI

Designed and maintained ETL pipelines using AWS Glue, S3, and Redshift. Worked with Kinesis and Lambda for real-time data processing. Used SQL and Python for data migration and transformation. Built monitoring solutions with CloudWatch to ensure data pipeline performance. Supported data scientists and analysts with scalable data solutions.

GCP Data Engineer

PhonePe

2019-5 - 2021-11 · 2 yrs 7 mos

Hyderabad, Telangana, India

Developed ETL and ELT pipelines using GCP Dataflow, BigQuery, and Dataproc. Migrated on-prem Hadoop systems to Google Cloud Platform. Built PySpark programs for large-scale data processing. Worked with multi-cloud environments (AWS + GCP) to optimize cost and performance. Automated deployments with Jenkins and Maven for CI/CD.