Data Engineer & Data Infrastructure Engineer (Azure)
- Verfügbarkeit einsehen
- 0 Referenzen
- 100€/Stunde
- Hamburg
- auf Anfrage
- de | en
- 23.03.2024
Kurzvorstellung
My portfolio ranges from Cloud Infrastructure (Azure, Terraform) to CI/CD Pipelines and Orchestration to Data Lakehouse (Databricks, Synapse, Python, SQL).
Qualifikationen
Projekt‐ & Berufserfahrung
7/2023 – offen
Tätigkeitsbeschreibung
Conception and realization of Data Lakehouse with Azure Databricks and Power BI
- Configuration of Databricks workspace
- Setup of CI/CD pipelines for Databricks
- Realization of ETL processes with SCD2
- Setup Auto Loader for event based triggering
- Data exploration to design and validate the data model
- Conception and realization of Delta Live Tables
- Realization of Power BI datasets and reports
ETL, SQL, Python
5/2023 – 12/2023
Tätigkeitsbeschreibung
Conception and realization of Data Lakehouse with Azure Databricks and Power BI
- Business requirements engineering to validate the scope and define the KPIs
- Data exploration to design and validate the data model
- Support for offsite development team
SQL, Python
2/2023 – 9/2023
Tätigkeitsbeschreibung
Realization of Data Lakehouse with Azure Synapse and Power BI
- Setup an Azure Synapse landscape as Data Lakehouse
- Setup CI/CD pipelines for Azure Synapse (develop and production)
- Realization of ETL processes with SCD2
- Conception and realization of SQL views
- Realization of Power BI datasets and reports
ETL, SQL, Azure Synapse Analytics
7/2022 – 12/2022
Tätigkeitsbeschreibung
Proof of concept and realization for Data Lakehouse with Delta Lake and Azure Synapse
- Data wrangling with Data Flow & Python notebook
- Serverless SQL pool as source for Power BI datasets
- Delta load processes with Delta tables
Azure Synapse Analytics, ETL, SQL
1/2020 – 12/2022
Tätigkeitsbeschreibung
Conception and realization of ETL processes with Azure Data Factory and Synapse
- Data wrangling with Data Flow & Python notebook
- Self-hosted integration runtime on Windows VMs
- Serverless SQL pool as source for Power BI datasets
Azure Synapse Analytics, ETL, SQL
3/2019 – 5/2023
Tätigkeitsbeschreibung
Set-up and operation of a multi-client and multi-stage advanced analytics platform on Azure
- Azure Databricks & Azure ML
- Azure App Services
- Azure Data Factory & Azure Synapse
- Azure Application Gateway
- Azure SQL Database & Azure Storage Account
Set-up and operation of CI/CD pipelines for DevOps and ML Ops on Azure DevOps
- Code security with bandit, safety and SonarCube within build pipeline
- CI/CD flow for Azure Data Factory & Azure Synapse
Infrastructure as Code with Terraform
Kontinuierliche Integration (CI), Microsoft Azure, PaaS (Platform as a Service)
Zertifikate
Ausbildung
Landshut University of Applied Sciences – Faculty
Weitere Kenntnisse
Persönliche Daten
- Deutsch (Muttersprache)
- Englisch (Fließend)
- Europäische Union
Kontaktdaten
Nur registrierte PREMIUM-Mitglieder von freelance.de können Kontaktdaten einsehen.
Jetzt Mitglied werden