Nandan Kumar K

Senior Data Engineer @ Mastercard

About

I am a Senior Data Engineer with 12+ years of experience designing and building enterprise-grade data platforms across Hadoop ecosystems, Azure cloud environments, and modern Lakehouse architectures. Over the last 7+ years, I have specialized in Azure Data Factory, Azure Databricks, Synapse Analytics, and ADLS Gen2, delivering scalable, reliable, and high-performance data solutions for regulated enterprise environments. My expertise includes: • Designing end-to-end Lakehouse architectures using Medallion (Bronze, Silver, Gold) patterns • Building scalable batch and streaming pipelines using Spark and Delta Lake • Optimizing performance and improving data quality across large-scale data platforms • Implementing governance using Unity Catalog and Azure Purview • Strengthening production reliability through monitoring with Splunk, Dynatrace, Azure Monitor, and AWS CloudWatch • Enabling CI/CD automation using Azure DevOps and Git I have worked across financial services, retail, SaaS, and healthcare domains, supporting mission-critical analytics and enterprise reporting. I am passionate about building scalable cloud data platforms that are secure, governed, and production-ready. Please reach out at nandankumarkyasa28@gmail.com Mob: (859)567-0502

Country

City

United States

Industry

Banking

Skill

Team Leadership, Cross-functional Collaborations, Processing Optimization, IT Cost Optimization, Event-driven, Automated Deployment, Data Catalog, KPI Reporting, Query Optimization, Fact & Dimension Tables, Medallion Architecture, Chatbots, Pipeline Automation, Requirements Analysis, Delta Live Tables, Apache Spark Streaming, Healthcare, Batch Processing, JSON, Kubernetes

Experience

Senior Data Engineer

Mastercard

2025-9 - Present · 1 yr 1 mo

O'Fallon, MO

Implementation- Tech Mahindra Played a key role in the Momentum project within the Foundry R&D department, driving modernization of Lakehouse architecture and enterprise-grade data pipelines. • Enhanced Databricks pipelines across Bronze, Silver, and Gold layers to improve processing stability • Refactored legacy ETL logic and standardized Delta Lake schemas • Implemented reconciliation and validation frameworks to improve downstream data accuracy • Designed monitoring and alerting using Splunk and Dynatrace • Strengthened CI/CD deployment processes using Azure DevOps • Partnered with upstream teams managing Apache NiFi ingestion pipelines • Collaborated with BizOps and product teams to troubleshoot production issues

Azure Data Engineer

Starbucks

2021-10 - 2025-8 · 3 yrs 11 mos

Seattle, WA

Designed and implemented scalable Azure Databricks pipelines to process large volumes of customer and supply chain data. • Built Snowflake data warehouse solutions integrating multiple enterprise data sources, supporting analytics and reporting. • Developed Delta Live Tables and Medallion Architecture pipelines for structured, curated, and gold-level datasets. • Automated ETL workflows using Azure Data Factory (ADF) for batch and real-time data processing. • Implemented DBT (Data Build Tool) transformations to standardize and optimize data models. • Created Power BI and Tableau dashboards for business stakeholders to monitor KPIs and supply chain performance. • Ensured data governance, lineage, and quality using Azure Purview and metadata management best practices. • Optimized PySpark jobs for high performance and reduced processing costs across Azure environments. • Collaborated with cross-functional teams to define enterprise data strategy and analytics solutions.

Azure Data Engineer

LogMeIn

2017-6 - 2021-9 · 4 yrs 4 mos

Boston, MA

Designed and deployed cloud-based ETL pipelines for SaaS user analytics using Azure Databricks and ADF. • Processed and integrated structured and semi-structured data (JSON, APIs) for reporting and analytics. • Implemented real-time data streaming solutions for event-driven architecture using Azure Event Hub. • Built Snowflake data warehouse to centralize enterprise analytics. • Developed Apache Airflow workflows to orchestrate complex data pipelines. • Collaborated with BI teams to create Power BI dashboards for user engagement and product analytics. • Ensured data security, compliance, and governance for SaaS application data.

Big Data Engineer

American Express

2014-9 - 2016-4 · 1 yr 8 mos

Mumbai

Designed and optimized large-scale Hadoop-based data processing platforms supporting financial analytics and regulatory reporting. • Built ELT/ETL pipelines integrating Salesforce, IBM DataStage, and Redshift with Hadoop • Optimized MapReduce, Hive, and Pig workflows reducing query runtime by 35% • Migrated legacy Hive jobs to Spark achieving 40% performance improvement • Implemented Kafka-based ingestion pipelines and managed distributed coordination using Zookeeper • Supported production data platforms and implemented SCD Type 2 historical tracking

Data Warehouse Developer

Optum

2012-11 - 2014-8 · 1 yr 10 mos

Hyderabad

Developed enterprise data warehouse solutions supporting healthcare and actuarial analytics. • Translated business requirements into ETL workflows and reporting logic • Built ETL pipelines using Informatica PowerCenter and SSIS • Designed star and snowflake dimensional models • Optimized T-SQL stored procedures and implemented access controls • Supported data quality and master data initiatives