Fahim Ahmed

Fahim Ahmed

Senior Data Engineer @ eHealth Queensland

About

Senior Data Engineer and Cloud Architect with 20+ years architecting enterprise data platforms and ETL/ELT solutions. Specialized in processing 10TB+ daily across Azure ecosystem, with proven expertise in Kafka, Spark, and scalable data architectures serving healthcare, financial services, and government sectors. Data Engineering Excellence: - Processing 15TB+ daily from 200+ clinical systems using Azure Data Factory, Databricks, and Kafka - Built metadata-driven automation frameworks integrating dbt, Dagster, and real-time streaming pipelines - Delivered $12M+ data modernization projects with 99.5% data accuracy across enterprise systems Financial Services Expertise: - Architected data platform for $280B+ superannuation fund processing 2.4M+ member accounts - Implemented APRA and CPS234 (SOC 2 equivilant) compliant ETL pipelines handling sensitive financial data with zero data loss - Developed 40+ ADF pipelines processing 2TB+ daily with 99.9% reliability Technical Leadership: - Led enterprise data lakehouse implementations using Delta Lake, Data Vault 2.0, and real-time analytics - Reduced data processing costs by 40% through automation and intelligent resource optimization - Achieved HIPAA and regulatory compliance across multiple data platforms Core Technologies: Azure Data Factory, Databricks, Apache Kafka, Python, Spark/PySpark, SQL, dbt, Terraform, DataOps

Country

Canada

City

Toronto

Industry

Information Technology & Services

Skill

Apache Spark, Delta Lake, Apache Kafka, Dagster, Data Cleaning, Software Engineering Practices, Software Development, Software Development Life Cycle (SDLC), Data Mining, Data Structures, Object-Oriented Programming (OOP), Data Architecture, Data Engineering, Data Architects, Big Data, Data Privacy, Data Classification, Automation, Scala, PySpark

Experience

eHealth Queensland

Senior Data Engineer

eHealth Queensland

LinkedIn
2023-5 - Present · 3 yrs 5 mos

Greater Brisbane Area - Remote

As a Senior Data Engineer, I play a key role in the Clinical Business Intelligence team, designing and developing CBI Gen3 cloud solution and data platform for statewide eHealth system serving 15,000+ healthcare professionals. Platform Engineering: Developed CBI Gen3 infrastructure using Terraform IaC, automating cloud resource creation across Dev/Test/UAT/PAT/Production environments Automated Kubernetes container orchestration with AKS clusters, enhancing operational efficiency for microservices architecture Built comprehensive CI/CD pipeline orchestration for consistent infrastructure and application deployments Data Engineering Excellence: Designed and developed cloud-native data platform processing 5TB+ daily healthcare data with 99.8% uptime Implemented metadata-driven automation framework integrating Databricks, Azure Data Factory, dbt, Kafka, and Dagster Implemented DataOps practices with automated data quality verification achieving 99.5% accuracy across 150+ sources Security & Governance: Designed RBAC architecture ensuring HIPAA compliance while enabling self-service analytics for 500+ business users Reduced infrastructure costs by 35% through Terraform-based resource optimization and automated scaling Key Technologies: Terraform, Kubernetes (AKS), Databricks, Azure Data Factory, Docker, Kafka, Dagster, dbt, Python.

Australian Retirement Trust

Azure Cloud Engineer

Australian Retirement Trust

LinkedIn
2022-11 - 2023-5 · 7 mos

Brisbane, Queensland, Australia

As Azure Cloud Engieer, I led the design, implementation, and security of Azure-based infrastructure and data solutions for Insurance Analytics and BI at Australian Retirement Trust. - Led comprehensive cloud infrastructure design for $280B+ superannuation fund operations - Developed 40+ ADF pipelines processing 2TB+ daily member data with 99.9% reliability - Built MLOps framework on Azure ML enabling predictive analytics for 2.4M+ member accounts - Achieved SOC 2 compliance through comprehensive Security Threat Model implementation - Created and supported Azure subscriptions for the Insurance Analytics and BI platform - Developed Infrastructure as Code using Terraform and deployed releases through Azure DevOps pipelines - Managed Azure Infrastructure components, including Azure Data Lake Storage, Azure SQL Server, Azure Data Factory, Azure Analysis Services, Azure Synapse, SQL databases, Power BI Gateways, and Azure Active Directory - Designed and managed Azure Data Factory (ADF) pipelines for data acquisition and transformation - Performed vulnerability management, focusing on system hardening and addressing low-score resources

Department of State Development, Infrastructure and Planning

Database Specialist

Department of State Development, Infrastructure and Planning

LinkedIn
2022-10 - 2022-11 · 2 mos

Brisbane, Queensland, Australia

- Architected and supported Azure DevOps development practices for continuous integration and deployment - Migrated on-prem databases to Azure SQL environment - Created deployment plan for database and data migration from on-prem to Azure cloud - Supported department Azure Infrastructure - Documented procedures and guidelines for database and migration activities - Performed Azure capacity and resource management, scaling up/down resources.

eHealth Queensland

Azure Data Architect / Engineer

eHealth Queensland

LinkedIn
2019-1 - 2022-6 · 3 yrs 6 mos

Brisbane, Australia

• Architected cloud solution and security architecture for RBAC for eHealth BI program • Contributed to all development efforts in building a new Data Warehouse and BI solution in the cloud using Azure Data Lake v2, Data Factory, Databricks, and SQL DB (Hyperscale) in alignment with the BI strategy of the CBI program • Designed ETL/ELT architecture from source system ingestions to data warehouse build orchestration • Designed quality assurance automation architecture to support CI/CD with automated data quality verification, data warehouse validation etc. to comply with Data Governance principles and policies • Designed and implemented a metadata-driven automation framework for data acquisition (SSIS, ADF, Databricks), and source validation with dashboard-enabled logging, monitoring, and reporting • Designed logical and physical data models for Smart Referrals and Clinical Business Intelligence systems • Developed BI development standards and guidelines whilst adhering to the larger architecture standards from the Enterprise Architecture • Created and supported Data Lake, Data Vault, Infomart, and Analysis Service Tabular model databases in Dev, Test, UAT, PAT, and Production environments • Created and supported Azure Infrastructure components using ARM templates and Terraform code • Extensively used PowerShell scripts to create and manage routine tasks and management of resources • Managed Azure resources including SQL Managed Instances, Azure Synapse, SQL database, SQL DW, Azure Analysis Services, Power BI Gateways, Power BI Premium Capacity, and Azure Active Directory • Performed Azure capacity and resource management, scale up/down resources, and managed the costs • Deployed release artifacts to different environments • Provided technical help and guidance to developers, testers, management, and other HHS teams.

Queensland Department of Education

Senior Technology Specialist

Queensland Department of Education

LinkedIn
2017-1 - 2019-1 · 2 yrs 1 mo

Brisbane, Australia

I have worked as Senior Technical Specialist at Department of Education and Training in Queensland Government responsible for: • Looking after application and database servers of OneSchool application – the flagship state-wide application with 12-node HA DB cluster, 64-node SSRS farm, 120-server web farm with multi tera bytes of data • Applying regular changes to application and databases through release management • Responsible for day to day application and database administration maintenance and support activities, including installation and configuration of SQL Server, setup and maintenance of database replication and mirroring, performance tuning, backup and recovery activities, writing maintenance plans and jobs and writing and running ad-hoc queries. Platform/Tools used: SQL Server 2008R2/2012/2014. Windows Server 2008 R2, 2012, SSIS, SQL Management Studio, Visual Studio, PowerShell, Profiler, SSRS, SSIS, ftp, Telnet, HPRM, Service-Now, SentryOne, F5, ASG Remote Desktop, DynaTrace, IPCheck.

Kaiser Permanente

Senior DBA / Technical Lead

Kaiser Permanente

LinkedIn
2016-5 - 2017-1 · 9 mos

Oakland, California

Worked as Technical Lead DBA in TPMG team at Kaiser Permanente, responsible for: • Database Architecture design for setting direction and road maps for company’s database infrastructure • Looking after company’s database infrastructure consisting of 70+ instances and over 400 databases • Managing DBA team, task allocation, weekly report to director and liaison with infrastructure, development and QA team leads and planning for the changes • Documenting and implementing best practices standards for database related processes and procedures • Key day-to-day database responsibilities including setting up and configuring SQL Server Always On database cluster, designing backup and DR strategy, performance tuning, data migration, upgrades and patching activities, setting up and managing mirroring, security configuration and SSL enabled database connections, and troubleshooting system and application issues • Incident Review and Root Cause Analysis of issues • Implementing IDERA product suite for monitoring and analyzing system health and performance. Platform/Tools used: SQL Server 2008R2/2012/2016. Windows Server 20082R/2012, SSIS, SQL Management Studio, Trello, QuickBase, ServiceNow, HP 3PAR Recovery Manager, IDERA product suite, RedGate SQL monitor, Visual Studio, PowerShell, Extended Events, SSRS, SSIS, Telnet, .Net Framework, F5, VisionApp, SQL Server HADR AlwaysOn

Queensland Department of Education

Senior SQL DBA consultant

Queensland Department of Education

LinkedIn
2010-4 - 2016-4 · 6 yrs 1 mo

I have worked as senior DBA consultant at Department of Education and Training. I have been engaged in a number of projects: - Worked on Training Management System data migration from legacy databases in Oracle, Sybase and Ingress to Amazon cloud based application. Responsible for designing the migration strategy and implementing the migration process using SSIS packages and MapForce. - I was responsible for deployment and management of applications on Windows Azure cloud using Octopus deploy. - Configured Azure databases for multiple applications and setup On-premises to Azure backups and migrations. - Accomplished three major upgrades and releases of departments’ electronic Record Management System HP-TRIM. - Installed and configured Department’s Budget System management and analysis system using INFOR BI OLAP suite. - Database and Platform Upgrades: Completed database upgrades from SQL Server 2000 to SQL Server 2008 and to SQL server 2012 for a number of systems. Also upgraded application and framework for a number of applications from Windows 2000 and .Net framework 1.1 to Windows 2008R2 and .Net Framework 4 and above. - I was responsible for day to day database administration, maintenance and support activities, including installation and configuration of SQL Server in High-Availability clustered environment, performance tuning, backup and recovery activities, writing maintenance plans and jobs and writing and running ad-hoc queries. During my job, I had: • Installed and configured over 200 SQL Server instances including over 20 SQL 2012/2014 High Availability Always-On clusters • Deployed hundreds of application patches and resolved database issues • Upgraded over 35 instances from SQL Server 2000/2005 to SQL Server 2008 and from SQL Server 2008 to SQL Server 2012 • Applied security patches and upgrades to all instances.

Queensland Police Service

Senior SQL Server DBA

Queensland Police Service

LinkedIn
2006-11 - 2010-4 · 3 yrs 6 mos

Worked in Data Quality team within Data and Database Support Team, and • Responsible for day to day database administration and maintenance activities, including installation and configuration of SQL Server instances, performance tuning, backup and recovery, writing maintenance plans, creating SQL jobs and writing and running ad-hoc queries • Responsible for data quality analysis, data cleansing and administration activities • Designed and developed Person Matching routines using SSIS and SSA-NAMES3 • Designed and developed Address Cleansing and Matching routines using SSIS. Worked in QPRIME data conversion and cleansing team in Queensland Police Services, and • Responsible for translation, cleansing and migration of legacy data from different applications e.g. CRIME management, Vehicle of Interest, Person of Interest, Domestic Violence, Traffic Incidents etc. to a new system called Niche RMS • Responsible for data migration requirement analysis, writing business and functional requirements and writing code for implementing these requirements • Involved in writing conversion scripts and packages to convert the legacy systems’ data to the new system • Involved in 3 major releases of data conversion; one being the largest data conversion in Queensland Government. Platform/Tools used: SQL Server 2005/2008. Windows Server 2003, ErWin, SSIS, SQL Management Studio, RedGate LiteSpeed, VSS, ftp, Telnet, StarTeam, InfraActive, Niche RMS and SSA-NAMES3

Queensland Health

Senior Database Developer DBA

Queensland Health

LinkedIn
2005-5 - 2006-11 · 1 yr 7 mos

At QLD Health I worked as senior Database Developer/DBA in INET team, • Responsible for reviewing the database design, suggesting improvements during the database design and implementation activities and performing a full Quality Assurance of databases and scripts before deploying it to production • Responsible for day to day database management task, including installation and configuration of database instances and service packs, backup and recovery activities, performance tuning, creating and running DTS packages, creating and monitoring Maintenance Plans etc. Platform/Tools used: SQL Server 2000 SP4, Windows Server 2003, SQL Enterprise Manager, VSS, ftp, SQL Delta, InfraActive, SQL Sentry and RedGate database tools

Accenture

Technical Operation Analyst

Accenture

LinkedIn
2004-8 - 2005-3 · 8 mos

I have worked as Technical Operations Analyst in 24*7 environment, • Responsible for day to day tasks including analysing and solving any problem arising in daily operations for billing system of Southern Gas Company USA • Responsible for backing up of databases, automating and managing background jobs, running scripts etc. • Responsible for managing internal SQL Server databases running Time Sheet Management system for employees. Platform/Tools used: SQL Server 2000, Windows 2000 Advanced server, Oracle 9i, Sun Solaris, Banner Scheduling tool, TOAD, MS Office tools, MS Project, PVCS etc.

Education

Seneca Polytechnic

Seneca Polytechnic

LinkedIn

Cloud Architecutre and Administration

2022-1 - 2022-8 · 8 mos

The Cloud Architecture & Administration graduate certificate provided me with: - the knowledge and skills to effectively and securely integrate IT infrastructure, including cloud services in Azure and AWS, internet of things devices and traditional on-premises equipment; - understanding of potential issues with privacy and the law and how to mitigate those risks; - essential leadership and management skills, providing opportunities to advance in my career; - an opportunity to expand my learning and apply skills to real-life work settings; - to work on a capstone project that integrates knowledge and skills obtained throughout the program.

Seneca Polytechnic

Seneca Polytechnic

LinkedIn

Cybersecurity

2023-8 - Present · 3 yrs 2 mos
University of the Punjab

University of the Punjab

LinkedIn

Computer Science - Specialization in Data Mining

University of the Punjab

University of the Punjab

LinkedIn

Computer Science

University of the Punjab

University of the Punjab

LinkedIn

Mathematics and Statistics

Fahim Ahmed's Contact Information

Email

******@***.com

Phone

(**) *** ****

Find the Right Leads
Find Verified Contact Data

Try with: Jensen Huang @ nvidia.com Click to autofill
LeadContact awards, five-star ratings, and GDPR compliance badges

What LeadContact does well

Find verified emails, phone numbers, and decision-makers with 98% accuracy.

Find Leads

Find Leads

Find the right people by company, role, industry, location, and more.

925M+ professional profiles

Find Leads
Find Emails

Find Emails

Access verified email addresses for your target contacts.

657M+ emails

Find Emails
Find Phone Numbers

Find Phone Numbers

Get cross-validated phone data from multiple top sources.

239M+ phone numbers

Find Phone Numbers

More Accurate. Lower Cost.

Find contact data in 1 tool with 98% accuracy

LeadContact integrates leading enrichment tools to deliver more accurate contact data—without paying for each one.

LeadContact Logo
Competitor Tools

All these = $289 per month

Great conversations start with the right contact.

It’s time to find yours.