Senior Data/ETL/DWH Engineer

freiberufler Senior Data/ETL/DWH Engineer auf freelance.de
Verfügbarkeit einsehen
National
de  |  en
auf Anfrage
60489 Rödelheim
25.03.2020

Kurzvorstellung

Senior Data/ETL/DWH Engineer with 11+ years of experience in Informatica PowerCenter, Pentaho, Talend, ETL Design & Development, SQL, PLSQL, ORACLE, Big Data, Bash Scripting, DWH, Data Vault, Data Analysis, Python

Ich biete

IT, Entwicklung
  • Informatica
  • ETL
  • PL/SQL
  • SQL
  • Pentaho Open-Source-BI-Suite

Fokus
  • Informatica Powercenter
  • Talend Open Studio

Projekt‐ & Berufserfahrung

ETL Entwickler
Deutsche Boerse, Frankfurt Am Main
8/2019 – 12/2019 (5 Monate)
Finanzdienstleister
Tätigkeitszeitraum

8/2019 – 12/2019

Tätigkeitsbeschreibung

Deutsche Boerse, Frankfurt am Main through Marlin Green Ltd
Vertragsart: Freiberuflich
Role: ETL Entwickler
Project: Regulatory Reporting Hub (RRH)
MIFIR/EMIR Transaction Regulatory Reporting to NCAs e.g. BaFin, AMF, etc.
Project Technology Stack
Source System: XML Files, Flat Files, Oracle
Target System: Oracle, XML, CSV
ETL Tool: Informatica Powercenter 10.2
Other programming languages: Oracle SQL & PLSQL, Unix Shell Scripting
Scheduling Tool: Control-M

Responsibilities
- Design, Develop and Maintain Informatica ETL/Data pipelines
- Performance tuning of ETL pipelines for faster loading in various environments
- Bug Fixing, Deployment, Production Support, Data Analysis
- Read data from XML & Flat files to load into staging, core layer and further to Delivery Area in Oracle database.
- Perform various cleansing and data completeness checks
- Enrich data from various reference/lookup tables and load into core layer
- Used various transformation like XML Source Qualifier, XML Parser, XML Generator, Transaction Control, Normalizer, lookup, update strategy, etc.
- Performance optimization of informatica mappings and sessions for faster loads
- Developed SCD Type1 and 2 mappings to load history data into data mart.

Eingesetzte Qualifikationen

ETL, Informatica


ETL Entwickler
Commerzbank, Frankfurt Am Main
10/2017 – 7/2019 (1 Jahr, 10 Monate)
Banken
Tätigkeitszeitraum

10/2017 – 7/2019

Tätigkeitsbeschreibung

Commerzbank, Frankfurt am Main through JOB AG Source One GmbH
Vertragsart: Freiberuflich
Role: ETL Entwickler
Project
Compliance (CMC & CAF) - AML Reporting - Frankfurt & Singapore
This was a data Integration project which includes providing data from various banking applications like Murex Cash, Murex Equity, Murex Currency, etc. for compliance reporting.
Project Technology Stack
Source System: Flat Files, MS SQL Server
Target System: Oracle, Flat Files, Hadoop HDFS
ETL Tool: Informatica Powercenter 10.1, Informatica BDM
Other programming languages: Oracle SQL & PLSQL, Unix Shell Scripting, UC4 Scripting
Scheduling Tool: Automic UC4

Responsibilities:

- Design ETL Pipelines and ETL Architecture.
- Design Informatica ETL jobs as per the quality and software development standards.
- Source to target data mapping analysis and design.
- Analyze, design, develop, test and document Informatica ETL programs from detailed and high-level specifications, and assist in troubleshooting.
- Creation of project-related documents like HLD, LLD, etc.
- Created reusable transformations and mapplets
- Developed data ETL pipelines for Change Data Capture (CDC)
- Creation of data pipelines to load into Hadoop HDFS.
- Complex Informatica Powercenter ETL development and Quality Assurance.
- Design and develop various slowly changing dimension load e.g. Type 1, Type 2.
- Responsible for finding various bottlenecks and performance tuning at various levels like mapping level, session level, and database level.
- Extensive use of various active and passive transformations like Filter, Router, Expression, Source Qualifier, Joiner, and Look up, Update Strategy, Sequence Generator, Rank, and Aggregator.
- Debugging and troubleshooting Sessions using the Informatica Debugger and Workflow Monitor.
- Implement various loads like Daily Loads, Weekly Loads, and Quarterly Loads.
- Conduct Unit tests, Integration tests, performance tests, etc.
- Contact point for problems in the Production environment and Defects Tracking with business. (3rd-Level-Support)
- Supported deployment team in various environment's deployments
- Developed database objects including tables, Indexes, views, sequences, packages, triggers and procedures to troubleshoot any database problems

Eingesetzte Qualifikationen

ETL, Informatica, Oracle (allg.)


ETL Tech Lead
Aldi Sued, Muelhiem an der Ruhr
6/2015 – 9/2017 (2 Jahre, 4 Monate)
Konsumgüterindustrie
Tätigkeitszeitraum

6/2015 – 9/2017

Tätigkeitsbeschreibung

Aldi Sued, Muelhiem an der Ruhr through Templeton & Partners Ltd
Vertragsart: Freiberuflich
Role: ETL Tech Lead
Project: Retail Enterprise Data Warehouse
Project Technology Stack
Source System: MS SQL Server, Flat Files, Oracle
Target System: Oracle Exadata
ETL Tool: Informatica Powercenter 10.1
Other programming languages: Oracle SQL & PLSQL, Unix Shell Scripting
Scheduling Tool: Informatica Scheduler
Project Methodology: Scrum/Agile

Responsibilities
- Participate in scoping, data quality analysis, source system data analysis, target system requirements, volume analysis and migration window determination.
- Implement various loads like Daily Loads, Weekly Loads, and Quarterly Loads.
- Perform data cleansing tasks.
- Perform test using sample test data in accordance with the client data migration/integration needs.
- Contact point for problems in the Production environment and Defects Tracking with business. (3rd-Level-Support)
- Helped Business Analyst in refining mapping specification documents.
- Developed Informatica Powercenter mappings to move data from stage to target tables
- Developed PL/SQL Packages, Procedures and Functions accordance with Business Requirements.
- Documented various input databases and data sources.
- Debugging and troubleshooting Sessions using the Informatica Debugger and Workflow Monitor.
- Responsible for finding various bottlenecks and performance tuning at various levels like database, ETL, etc.
- Created Materialized Views and partitioning tables for performance reasons.
- Worked on various back end Procedures and Functions using PL/SQL.
- Developed UNIX shell scripts to perform various user requirements.
- Designing Tables, Constraints, Views, and Indexes etc.
- Developed database objects including tables, Indexes, views, sequences, packages, triggers and procedures to troubleshoot any database problems
- Tuned complex Stored Procedures for faster execution
- Responsible for Analyzing and Implementing the Change Requests.
- Involved in handling the changes in compiling jobs and scripts according to the database changes.

Eingesetzte Qualifikationen

ETL, Informatica


Senior ETL Consultant
HRS, Koeln
1/2015 – 5/2015 (5 Monate)
Dienstleistungsbranche
Tätigkeitszeitraum

1/2015 – 5/2015

Tätigkeitsbeschreibung

HRS, Köln through Informationsfabrik GmbH

Vertragsart: Freiberuflich
Role: Senior ETL Consultant
Project: Hotel Enterprise Data Warehouse
Project Technology Stack
Source System: MS SQL Server, Flat Files, Oracle, XML
Target System: Sybase IQ
ETL Tool: Informatica Powercenter
Other programming languages: Oracle SQL & PLSQL, T-SQL, Unix Shell Scripting
Scheduling Tool: Control-M
Project Methodology: Waterfall
Data Modeling: Dan Linstedt Data Vault Modelling

Responsibilities
- Use of Data Vault as Data Modeling approach for the Hotel Enterprise Data Warehouse.
- Define the ETL Architecture to load the Data Vault model and data mart.
- Analyzed sourced data to identify candidates for Hub, Satellite and link tables
- Developed Informatica Powercenter mappings, sessions and workflows to load Hub, Link & Satellite tables.
- Added Hub, Link & Satellite tables including business keys, Surrogate keys, descriptive satellite information to Data Vault Model.
- Implement various loads like Daily Loads, Weekly Loads, and Quarterly Loads.
- Perform data cleansing tasks.
- Perform test using sample test data in accordance with the client data migration/integration needs.
- Contact point for problems in the Production environment and Defects Tracking with business. (3rd-Level-Support)
- Developed Informatica Powercenter mappings to move data from stage to core and data mart layer.
- Documented various input databases and data sources.
- Debugging and troubleshooting Sessions using the Informatica Debugger and Workflow Monitor.
- Developed UNIX shell scripts to perform various user requirements.

Eingesetzte Qualifikationen

Datawarehouse / DWH, ETL, Informatica


Senior ETL Consultant
KARSTADT, Essen
1/2014 – 9/2014 (9 Monate)
Konsumgüterindustrie
Tätigkeitszeitraum

1/2014 – 9/2014

Tätigkeitsbeschreibung

Karstadt, Essen through Questax AG

Vertragsart: Freiberuflich
Role: Senior ETL Consultant

Project:
Karstadt information systems for measures and analytics (KARISMA)

The goal of this project was to create centralized Analytical and Reporting system for Karstadt Warehouse GmbH. The major part of the project was to replace existing SAP BW Reporting system and create new enterprise data warehouse with Informatica PowerCenter 9.5.1 for ETL and Cognos 10 for Reporting. Informatica PowerExchange 9.5.1 with BCI (Business Content Integration) & Data Integration using ABAP methods were used to connect to Karstadt SAP Retail system and read data from SAP Standard and Customized Data Sources. IBM Netezza 7 was used as Target system with Informatica PowerExchange for Netezza.
Project Technology Stack
Source System: SAP, IDOC, Flat Files, XML
Target System: IBM Netezza
ETL Tool: Informatica Powercenter 9.5, Informatica Powerexchange 9.5
Other programming languages: Oracle SQL & PLSQL, Unix Shell Scripting
Scheduling Tool: Informatica Scheduler
Project Methodology: Waterfall

Eingesetzte Qualifikationen

Datawarehouse / DWH, ETL, Informatica


Senior ETL Consultant
Deutsche Bank, Frankfurt Am Main
7/2011 – 12/2013 (2 Jahre, 6 Monate)
Banken
Tätigkeitszeitraum

7/2011 – 12/2013

Tätigkeitsbeschreibung

Deutsche Bank, Frankfurt through Datamatics Global Solutions GmbH & Hays AG
Job Type: Employee & Vertragsart: Freiberuflich

Role: Senior ETL Consultant

Informatica Powercenter ETL Tool Development & Support
for Data Migration and Data Integration Projects.

Projects:
#1 Retail Banking - Postbank Savings Deposit Accounts Migration

This project involves migration of savings account
deposits data from Mainframe IBM Z/OS systems to SAP
Deposit Management application using PowerCenter 9.1 HF
1 and Power exchange 9.1. This involves reading data
from flat files, mainframe data sets, oracle and
writing data into flat files which will be then
uploaded into SAP Deposit Management application. Power
exchange 9.1 was used for the connecting to mainframe
and reading of Mainframe data sets. ETL Informatica
PowerCenter 9.1 was used for the extraction,
transformation, and loading of data into the target
systems. The project had only single load i.e. one time
migration. This project involves data extract,
transformation and loads of 250 to 500 million records.

#2 Retail Banking - Postbank Savings Deposit Accounts Integration
This project involves integration of savings deposit
account data from SAP, Mainframe systems in to the
Oracle enterprise data warehouse.
ETL activities includes loading of this data into
Oracle enterprise data warehouse used for Retail
banking reporting in Deutsche Bank, Germany. ETL
Informatica PowerCenter 9.1 HF 1 was used for the
extraction, transformation, and loading of data into
the target systems. The project had several loads like
Daily Loads, Weekly Loads, Monthly Loads, Quarterly
Loads, and YTD Loads. These loads were implemented
using Incremental Loading (Change Data Capture), and
Slowly Changing Dimension Mappings. This project
involves data extract, transformation and loads of 30
to 50 million records.

#3 Retail Banking - Auto Deployment
Deutsche Bank started this project to save huge time
for deployment of all ETL components e.g. informatica
powercenter workflows, informatica powerexchange data
maps, parameter files, shell scripts,etc. This project
helped Deutsche Bank to save time spend by deployers in
deploying multiple environments, error free deployments
and hence reduce cost.

#4 Retail Banking - LDAP Integration

Eingesetzte Qualifikationen

Datawarehouse / DWH, ETL, Informatica


Senior ETL Consultant
American Home Mortgage Servicing Inc, Pune
11/2010 – 6/2011 (8 Monate)
Finanzdienstleister
Tätigkeitszeitraum

11/2010 – 6/2011

Tätigkeitsbeschreibung

American Home Mortgage Servicing Inc, Texas through Hitachi Consulting Pvt Ltd, Pune

Job Type: Employee
Role: Senior ETL Consultant

Project :
Home Mortgage Enterprise Data Warehouse

Eingesetzte Qualifikationen

Datawarehouse / DWH, ETL, Informatica


Software Engineer
Sigma Systems, Pune
10/2008 – 6/2010 (1 Jahr, 9 Monate)
Telekommunikation
Tätigkeitszeitraum

10/2008 – 6/2010

Tätigkeitsbeschreibung

Sigma Systems, Pune
Job Type: Employee
Role: Software Engineer
Oracle, Unix, Java Development & Support

Eingesetzte Qualifikationen

Oracle (allg.), UNIX, Java (allg.)


Zertifikate

International Knowledge Measurement - Informatica Powercenter
Juli 2017

TOGAF 9.1 (Enterprise Architecture Framework) Certified Professional
Mai 2015

Informatica Powercenter 9 Developer
April 2014

Ausbildung

Bachelor of Engineering
(Computer science)
Jahr: 2007
Ort: Pune India

Qualifikationen

ETL Tools
Informatica PowerCenter, Informatica Big Data Management,
Informatica Power Exchange, Talend

Databases
Oracle 12c, Oracle Exadata 12c, Microsoft SQL Server 2016, Hadoop HDFS, XML

Big Data Technologies/Ecosystem
Cloudera, HDFS, YARN, MapReduce, Hive, Pig, HBase, Oozie, Flume and Sqoop

Modeling
Star & Snowflake Schema, 3-NF, Data Modeling, Dimensional Modeling, Data Vault

Modeling Tools
PowerDesinger, Informatica Mapping Architect for Visio

Software Development Methods
Agile, SCRUM, Waterfall

Programming Languages
Core JAVA, SQL, T-SQL, PL/SQL, UNIX/Bash Shell scripting

Scheduler
BMC Control-M, Automic UC4, Informatica Scheduler

Version Control
Informatica Version Control, Subversion, Tortoise SVN, GitHub

Other Tools - Atlassian Jira, Atlassian Confluence, GitHub, Hue, Eclipse, Toad, PL/SQL-Developer, FTP, sFTP, WinSCP, FileZilla, Putty, HP Quality Center, Aginity Workbench for IBM Netezza

Über mich

- Having 10+ years of IT Consulting experience with emphasis on business requirements
analysis, ETL development, implementations, testing and production support of Data Lake, Data Migration, Data Warehousing and Business Intelligence projects.
- Expert in development and designing of ETL methodology for supporting data
transformations using Informatica Power Center 10.2/10.1.1/9.6, Power Exchange 9.5.1, Talend.
- Experience in creating Proof of Concepts
- Have experience in agile ETL Development using SCRUM method.
- Have experience in ETL design, ETL architecture using Informatica PowerCenter.
- Have experience in Informatica Mapping Architect for Visio for creating mapping templates for each Data Layer in DW.
- Have experience in Dimensional modeling, data modeling and data vault modeling
- Highly Skilled in ETL & Database Performance Optimizations.
- Experienced in analyzing business requirements and translating functional requirements into technical design specifications like LLDs, JHBs.
- Experience in reading and writing data into Mainframe systems using Informatica Power Exchange
- Experience in Informatica Powercenter administration tasks like installation, code
migration, connection setup, user access, etc.
- Worked with different data sources like Oracle, MS SQL Server, SAP BW, Mainframe Data sets, Flat Files, XML files, JMS Queues and MQ queues.
- Hands on experience in creating UC4 Jobs for Informatica workflows, shell scripts, etc.
- Hands on experience in writing, testing and implementation of the views, triggers,
stored procedures, functions, packages at database level using SQL, PL/SQL.
- Experience in relational database development using Oracle PL/SQL and SQL.
- Extensively worked on UNIX environments and Shell Script development.
- Hands on experience in handling large volumes of data in production environments.
- Worked on Unit Testing, Integration testing and Regression testing to verify load
order, time window and lookup with full load.

Persönliche Daten

Sprache
  • Deutsch (Grundkenntnisse)
  • Englisch (Muttersprache)
Reisebereitschaft
National
Arbeitserlaubnis
  • Europäische Union
Profilaufrufe
4635
Alter
37
Berufserfahrung
12 Jahre und 10 Monate (seit 05/2007)

Kontaktdaten

Nur registrierte PREMIUM-Mitglieder von freelance.de können Kontaktdaten einsehen.

Jetzt Mitglied werden »