Swagata Datta
Data Engineer @ Project X Ltd.
About
Data Engineering Team Lead with 11 years of work-experience in Data Warehousing projects. Successfully executed many Data Integrations and Migration projects using on-premise as well as cloud(AWS) based solutions. Technical Expertise in AWS services(Redshift,Glue,Lambda,S3,Datashare, Athena, SNS, Cloudwatch etc.), Informatica Powercenter(ETL), Informatica DIH, Matillion,SQL,Python. Team player,mentor,leader,supervisor with experience in leading and managing Development Teams. Specialities: Data Warehousing, Data Integration, Data Migration, ETL Developer, Team Management, Agile, Waterfall, Collaboration and Coordination with key stakeholders, Process improvement, Team Building, Leadership.
Canada
Toronto
Information Technology & Services
Azure Data Lake, Matillion Data Productivity Cloud, Apache Airflow, Snowflake, Matillion, AWS Glue, AWS Lambda, Amazon Simple Notification Service (SNS), AWS Data share, Continuous Integration and Continuous Delivery (CI/CD), Git, Bitbucket, Jenkins, Team Management, SQL, Amazon Web Services (AWS), Amazon Redshift, Python (Programming Language), Extract, Transform, Load (ETL), Informatica PowerCenter
Experience

Data Eng. Mgmt & Governance Specialist | Data Engineering Team Lead
Kolkata, West Bengal, India
• Spearheaded development of cloud-native ETL pipelines using AWS services like Glue, Lambda and Matillion ETL tool integrating data from 50+ external systems into AWS S3 Datalake and Redshift, enhancing data availability by 80%. • Utilized AWS Glue Crawlers and leveraged Glue Data Catalog to automatically infer schema and review sample data stored in S3 buckets as part of initial data analysis, saving significant time in manual schema definition and initial data inspection. • Implemented business transformation logic for big data sets using python & PySpark scripts embedded in AWS lambda and Glue jobs. • Designed and implemented 100+ SQL-based transformation views combining data from multiple subject areas into common area and access point schemas for business users and downstream consumption. • Enabled cross-account data sharing using AWS Data Share, streamlining collaboration between multiple business units. • Automated execution of Data Ingestion and ETL processes using Python scripts, Autosys Jobs and Apache Airflow E2E DAGs reducing manual intervention by 70%. • Created and maintained CI/CD pipelines using GitHub Actions and Jenkins for production stability. • Implemented data governance practices to maintain data quality and security. • Led development team, collaborated with Scrum Master in sprint planning & effort estimations, coordinated with product owners and analysts for successful agile execution. • Experience in driving communications with business and other stakeholders at client side, worked with Technical Analysts and business in capturing and refining requirements. • Actively led design discussions, design & code review sessions with Technical Architects, conducted sprint demos with business showcasing the work accomplished in each Sprint. • Provided technical leadership to junior developers and managed a 10+ member team, ensuring project delivery aligned with scope, quality, and time constraints.

Application Development Senior Analyst | Data Engineer
Kolkata, West Bengal
Senior ETL Developer, worked as the overall integration lead for the program responsible for all the data migrations between the Product Master Hub and the contributing and consuming systems using solution and capabilities of Informatica PowerCenter ETL Tool. • Interacted with both business and IT clients and helped them to capture and refine requirements. • Created designs for each interface working with system lead from the contributing/consuming solution and the Solution Architect. • Worked in Informatica’s Data Integration Hub application and applied its solution and capabilities to integrate different upstream and downstream applications. • Worked in Informatica Data Quality tool to build custom data quality rules used for data. • Worked in all phases of SDLC – requirement analysis/clarification, build, deployment activities in SIT/UAT and production and post deployment support during warranty period. • Mentored team members, helped them with their onboarding to a very complex solution. Also supervised them for smooth execution of the project.

Associate | Data Engineer
Kolkata, West Bengal, India
• Senior Informatica PowerCenter Developer involved in requirement gathering and analysis – analysing business requirements in granular level to offer the best solutions. • Worked as a Module Lead, involved in design and building of Informatica PowerCenter mappings/workflows for implementation of required business logic. • Worked on various transformations like source qualifier, expression, joiner, router, filter, aggregator, lookups, update strategy, sequence generator etc. to build mappings. Also, worked on reusable transformations and mapplets. • Involved in implementation of change data capture mechanism to capture the delta data in real time via informatica mappings for databases like Oracle and DB2 using Informatica CDC PowerExchange by reading the DB logs through PWX listener. • Worked in Enterprise Data Accelaration project which involved mass data movement for multiple business applications into hadoop file system via Informatica PC to be loaded into Data hub(consisting of Hbase tables) for consumption by various downstream application systems. • Worked in Informatica B2B MFT (Managed File Transfer) for configuring host/mailboxes for secure transfer of data files from one server to another using FTP/SFTP protocol. • Managed and worked in other project related operational activities, estimations, guiding and mentoring entry level trainees.

Programming Analyst
Kolkata, West Bengal, India
• Worked as a ETL Developer in data migration project involved in creation of source-target column mappings using client in-built ETL tool - Datalake. • Developed complex dynamic SQL scripts required for source data validation and correction before migration to new platform. • Analysed E-Code (Rule repository for business rule validation) to identify the transformation rules to be used/applied during migration. • Involved in data analysis and triaging of data issues, SIT/UAT defect fixing, deployment. • Worked in data integration project as an Informatica PowerCenter developer, involved in requirement analysis, creating mappings/workflows, unit testing, documentation, SIT/UAT defect fixing, and production deployment activities.

Programmer Analyst Trainee
Chennai, Tamil Nadu, India
• Worked in Production support & Enhancement Project, involved in monitoring of production jobs (Autosys Jobs + Informatica PowerCenter Workflows), raising tickets/incidents in case of production failures, doing RCA and providing resolution of production defects which may include enhancement activities in Oracle and Informatica PowerCenter workflows. • Maintained Run book for Workflows/Jobs. • Worked on DIET (Defects Incidents and Enhancement Tracking) and CPR (Code promotion Request) to promote the changes from Development to QA and Production.
Swagata Datta's Contact Information
Phone
Find the Right Leads
Find Verified Contact Data
What LeadContact does well
Find verified emails, phone numbers, and decision-makers with 98% accuracy.
Find Leads
Find the right people by company, role, industry, location, and more.
925M+ professional profiles

Find Emails
Access verified email addresses for your target contacts.
657M+ emails

Find Phone Numbers
Get cross-validated phone data from multiple top sources.
239M+ phone numbers

More Accurate. Lower Cost.
Find contact data in 1 tool with 98% accuracy
LeadContact integrates leading enrichment tools to deliver more accurate contact data—without paying for each one.
Great conversations start with the right contact.
It’s time to find yours.


