Ishan Khobare

Azure Data Factory is used to construct ETL processes that are scalable and maintainable for the Salesforce migration project to Financial Cloud Services. · Implement an error handling process to store the rejected records in ADLS Gen2 and capture the aggregated metadata in SQL. · Provide monitoring, performance tuning, and update the data transformation logic as needed for existing integrations by capturing unit testing and regression testing to optimize the parameterization update to the batch size of data intake. · Document architecture, data flows, and transformation logic, often maintained in a version control system for collaboration and compliance.

Azure Synapse used to Integrate and support systems by ingesting data into Azure Data Lake Gen 2 and load data into Azure SQL Database. The goal was achieved with data moving into the 3 zones of Azure Data Lake Gen 2 of Raw Zone, Processed Zone and Curated Zone. Each zone had its own characteristic before finally loading the data into Azure SQL Database. Optimization techniques were implemented especially in the final stages of loading from Data Lake into Azure SQL Database as it was heavy processing hence, we had to use the approach of Incremental loading technique with heavy lifting done on the ADLS Gen 2 as much as possible which led to fast processing and successful batch loading implementation of multiple dates in a batch run. Raw Zone: • Data ingested in the original format from different sources (ex : flat files, csv, JSON, pdf…). In case of SQL database as source consider exporting the data as a compressed file format (ex: parquet) • It keeps every version of the raw data indefinitely and can support audit and recovery • Partitioned by source system and organized by data entity and date • Generally accessible by data engineers only Processed Zone: • Data comes from the Raw zone and is cleansed, enriched (validation, standardization, harmonization) • Parquet file format • Schema and data type definition (remove unnecessary columns) Curated Zone: • Data comes from the Processed zone and is aggregated and modeled for specific business needs • Parquet file format • Consumption layer optimized for analytics • Common dimensions, aggregations, and metrics calculations • Partitioned by business function or data subject and organized by data entity • Used by business analysts and data scientists Develop and maintain Power BI dashboards involving building measures, and aggregated solutions using DAX formulas and reports. Create Data Management and monitoring processes to be updated with the day-to-day updates. Optimize Cost Effective Data Storage and compute.

My Role & Responsibilities - The scope of requirement from the get-go from me was to create a one-stop data solution. Leading to the accessibility of information from raw data by creating ETL processes for Azure, Dynamics, and Bizapps by creating data mart solutions specific to their respective data subject. This would lead to feasibility for the Business Stakeholders to make informed decisions in the most accurate and timely manner based on sales and events organized for the Canadian subsidiary (Microsoft Tech Summit. Microsoft Ignite, Microsoft Future Now) Steps Implemented : Created Automated Datapipeline solutions to fetch data from multiple source systems to our local database. Monitored on a daily basis to optimize the processes. Cleanse the data and impose Standard Data loading and database nomenclature processes to make sure the data integrity is intact for the whole team. Create fall-safe solutions to catch any issues with the discrepancy of data to make sure downstream data load process and reports are acted upon immediately maintaining the sanity of data. Design and create Extract Load Transformation (ETL) processes and implement best practices. Create Power BI reporting dashboard to measure the KPI metrics and provide an in-depth analysis of how the progress is updated with respect to historical data at a click of a button implementing Data Models and DAX formulas. Weekly meetings with the team to help subordinates grow technically and document all the processes to create minimal dependency and grow the team as a whole. Azure Databricks used to load the data in staging zone and sanitize the data and aggregate solutions designed to get the final data to be reported on Power BI for Business stakeholders.

Technology: Microsoft SQL Server Integration Service (SSIS), Statistical Analysis System (SAS), SQL Server 2014 and Microsoft Excel Pivots. Roles Played: • Co-ordinating with multiple data source teams making sure the data is updated to formulate results of required metrics to generate weekly and monthly reports and KPI's to better understand the growth of the business. • Communicate with stakeholders/clients’ business requirement and translate to technical aspects. • Analyzing the scope, the pros and cons of the development to various downstream process and acknowledge the concerned teams to understand the changes required to generate variety of reports based on hierarchy. • Participate in the scope of the project and implement the development task according to the assigned priorities. • Directly responsible for data validation, integration testing and deployment process to all the environments. • Assist the mobile integration team by providing the required data sets from the back-end database for a precise and better user experience. • Analyze and debug issues pertaining to the existing system in place and report to the clients' queries to help them understand the metrics and the technicalities associated in deriving it.

• Create SSIS packages for migration projects involving loading data from different source systems (Old CRM Systems/ Salesforce) to Microsoft Dynamics 365. • Prepare reports on the sequence of running SSIS Packages to link all the entities (accounts, contacts, leads, opportunity etc.) and implement best practice to enhancing the performance. • Built Integration projects from various source systems to load data into Microsoft Dynamics 365. • Create Microsoft SSIS packages for migration projects involving loading data from different source systems (Old CRM Systems/ Salesforce) to Microsoft Dynamics 365. • Prepare reports on the sequence of running SSIS Packages to link all the entities (accounts, contacts, leads, opportunity etc.) and implement best practice to enhancing the performance. • Built Integration projects from various source systems to load data into Microsoft Dynamics 365. • Enhance data lineage process in place by reducing temporary data storage and increasing the efficient performance.

Technology: Red Point Data Management, SQL SERVER 2014 Roles Played: Analyze the requirement and design in the most optimized manner • Presently, developing various workflows and automations as per the business requirements for client Nissan. Implementing business transformation to client’s data in order to model and store their data in as optimized as possible manner and eventually generates BI reports for analyses. • Develop complex ETL jobs/automations/macros using various transformations in Red Point Data Management tool according to technical specifications and BRD’s. • Developed interface which would accept data from various third party sources, analyze the data by creating data validation process to mark the good vs bad data and loading in the respective tables in database. Prepare the business validation process flow design as to how the incoming data should comply with the business rules in an optimized manner. • Create the documentation and perform unit testing results before passing it over to the testing team. Assist QA team and improvise the shortcomings in the code and deploy to production.

Worked on a contract job, during the 7 months period in Production Support team dealing with testing modules creating Unit Test Cases, Integration Testing and databases ORACLE. Created Unix Shell Scripting to perform various module tests and integration test on the ETL Jobs.

The major goal of our project is to implement the Integration logic in a layer which is separate from the core business logic in the new system, using the Business Intelligence - ETL tool INFORMATICA POWERCENTER v9.1, ORACLE 10G, TERADATA AND UNIX. • The initial step of REQUIREMENT GATHERING was the preparation of LOW LEVEL DESIGN DOCUMENTS (LLD). • Write PL-SQL queries in order to create TABLES (LOOKUP, SOURCE and TARGET), VIEWS, TRIGGERS, STORED PROCEDURES, INDEXES, LOOKUP conditions (to retrieve data from other tables based on conditional checks) and User Defined Functions. • Prepared a Mapping Document and consequently implementing the required transformational logic in ETL Development using Informatica PowerCenter 9.1 as a key tool for making Mappings and run workflows. • Create the Source and Target tables in the database and clean the extracted data in the Staging area and implement the transformational logic in Power Center Mapping Designer on the consistent data. Then, validate the mapping and run in sequential or concurrent manner by creating sessions in the Power Center Workflow Designer and run the session based on the timeline requirement and check the results in Power Center Workflow Monitor. • Based on good experience working with the tool Informatica Powercenter tune the mapping in an optimized manner to improve the performance in order to fast load in the data warehouse. • Build 2 modules of Informatica mappings and tested with the Sample input and output provided by the client and consequently triggered the mappings via UNIX shell scripting. Understood the Unix Scripts which especially required testing of workflows.

Masters of Engineering(Computers & Electrical) which involved ->Internal chip design of Operational Amplifier(designing internal layout and testing the actual working of the chip after being manufactured). ->E-commerce & Computer Networking were the main highlights which involves day to day card payments method and techniques of secret key sharing and algorithms..

During my 4 years of bachelors of Engineering I gained a lot of technical knowledge solving various circuit analysis and communication subjects. I was more than privileged to have such inspiring teachers backing me to excel in my studies and other curricular activities like Robotics which I was really interest in. I made a line following Robot during a workshop/competition. I was staying away form my home for these 4 years and I learnt a lot, so it was overall a very good experience.