Senior Data Engineer
- Verfügbarkeit einsehen
- 0 Referenzen
- 120€/Stunde
- 22089 Hamburg
- auf Anfrage
- de | en
- 22.04.2023
Kurzvorstellung
• development: Test-Driven und CI / CD
• several years of professional experience in data migration, integration, and processing
Qualifikationen
Projekt‐ & Berufserfahrung
5/2021 – 11/2021
Tätigkeitsbeschreibung
• conception and development of a data lake and of the data warehouse based on Google Cloud Platform
• conception and implementation of CI/CD pipelines
• implementation of data pipelines with SQL und Python
• orchestration of all pipelines using Apache Airflow
ETL, Google Cloud, Python, SQL
2/2020 – 4/2021
Tätigkeitsbeschreibung
• implementation of data pipelines with Apache AVRO, Apache Beam, Google PubSub, Google Cloud Dataflow and Python
• orchestration of all pipelines using Apache Airflow
• data analysis and reporting using BigQuery and Tableau
• development of a deep-learning model for house price prediction with Tensorflow
• implementation of a sales date prediction using BQML
ETL, Google Cloud, Python, SQL
7/2019 – 12/2019
Tätigkeitsbeschreibung
• refactoring and further development of the existing data warehouse
• conception and development of a data lake
• development of a test framework
• optimization of existing ETL pipelines
Amazon Web Services (AWS), ETL, SQL
7/2018 – 6/2019
Tätigkeitsbeschreibung
• design and implementation of a test framework
• project work for the migration of the DBMS from Teradata to Exasol
• project work for the introduction of a data lake based on MapR
Apache Hadoop, Exasol, Lua
4/2016 – 6/2018
Tätigkeitsbeschreibung
• design of the database architecture of the data lake based on Hadoop, Hive and Pivotal HDB
• development of predictive models based on statistical methods for fraud analysis using Madlib
• development of data transformation processes (ETL) using Talend
• conception and development of a system for real-time scoring of user logins
• conception and implementation of a test system from comparison with the productive system to data integrity in the DWH
• operational management of the data lake
• development of sophisticated and standardized reporting and dashboard solutions, as well as ad hoc analyses using Tableau and Splunk
• data analyses and data interpretation
Apache Hadoop, Data Vault, Datawarehouse / DWH
Ausbildung
Berlin
Berlin
Über mich
• development: Test-Driven und CI / CD
• several years of professional experience in data migration, integration, and processing
• core competences in analysis, abstraction and optimization
Weitere Kenntnisse
Persönliche Daten
- Deutsch (Muttersprache)
- Englisch (Gut)
Kontaktdaten
Nur registrierte PREMIUM-Mitglieder von freelance.de können Kontaktdaten einsehen.
Jetzt Mitglied werden