freiberufler Data Architect auf freelance.de

Data Architect

offline
  • auf Anfrage
  • 76135 Karlsruhe
  • auf Anfrage
  • fa  |  en  |  de
  • 09.08.2023

Kurzvorstellung

Mo is an experienced Senior Consultant. He has +10 years of experience in Cloud Computing, Software Development, and Data Engineering. He has a Ph.D. in Computer Science. He helps customers achieve their goals with advising on best practices.

Qualifikationen

  • Apache Spark
  • Azure Databricks
  • Big Data
  • Cloud Computing
  • Forschung & Entwicklung (allg.)
  • Maschinelles Lernen
  • Microsoft Azure
  • Python
  • Solution Architektur
  • Technische Beratung

Projekt‐ & Berufserfahrung

Senior Data Engineer
Henkel, Düsseldorf
10/2021 – 5/2023 (1 Jahr, 8 Monate)
Chemieindustrie
Tätigkeitszeitraum

10/2021 – 5/2023

Tätigkeitsbeschreibung

Consulting on data lake architecture and data infrastructure.
Development and operation of cloud data lake engineering processes on Azure Databricks.
Development of data pipelines using Databricks Spark and Azure Data Lake.
Setting up of CI/CD Pipelines on Azure DevOps.
Design and set up continuous integration and deployment processes
Consult on custom solutions for data integration.
Maintain legacy data pipelines with Data Factory.
Set up automatic data integration processes for data ingestion and data export to different external systems using interfaces such as REST, FTP, etc.
Prepare ingested data from various formats such as XML, JSON, CSV in a united Parquet data structures for processing by the data lake pipelines.
Prepare data lake datasets for export in various formats such as XML, JSON, CSV to be sent to external systems.
Design and implemented POCs for a low-latency data integration solution using Postgresql as a backend to enable interactive use of some data lake datasets by users in SAP C4C.
Skills: Azure DevOps, Azure DataFactory, Azure DataBricks, Azure App Services, Azure Container
Instances, Azure Function, CI/CD, Scrum, Python, Pyspark

Eingesetzte Qualifikationen

Apache Spark, Azure Databricks, Big Data, DevOps, Microsoft Azure, Python, Solution Architektur

Software Development
Argodis GmbH, Karlsruhe
1/2021 – 10/2021 (10 Monate)
IT & Entwicklung
Tätigkeitszeitraum

1/2021 – 10/2021

Tätigkeitsbeschreibung

Development of a data pipeline orchestration tool.

Eingesetzte Qualifikationen

Cloud (allg.), DevOps, Kubernetes, Python, TypeScript

Senior Data Engineer
Henkel, Duesseldorf
3/2020 – 12/2020 (10 Monate)
Chemieindustrie
Tätigkeitszeitraum

3/2020 – 12/2020

Tätigkeitsbeschreibung

Build up a comprehensive service for business and IT people by combining different Microsoft Azure
Services and other tools to provide a data lake with data processing capabilities for huge datasets from
different platforms
• Establish robust and performant pipelines within the Azure environment (DataBricks, DataFactory,
LogAnalytics, Azure DevOps, etc.)
• Implement quality checks on incoming data and perform quality assurance tests on the datasets and
code
• Analyze business requirement in terms of data transformation in a qualitatively diverse data environment
• Consult business on best practices and technical effort in relation to product development and project
achievements

Eingesetzte Qualifikationen

Apache Spark, DevOps, Kanban (Softwareentwicklung), Microsoft Azure, Python, SCRUM

DevOps Architect
Merck, Dramstadt
11/2019 – 8/2020 (10 Monate)
Chemieindustrie
Tätigkeitszeitraum

11/2019 – 8/2020

Tätigkeitsbeschreibung

Setup DevOps Pipelines for a cutting-edge laboratory informatics environment
• Configuring and operating the continuous integration and deployment (CI/CD) pipeline for solutions
based on a scalable micro-services architecture
• Responsible for maintaining, monitoring, and reporting systems both for the CI/CD pipeline and
product Dev/QA/Prod deployments

Eingesetzte Qualifikationen

Amazon Web Services (AWS), Ansible, DevOps, Jenkins, Kubernetes

Teamleiter Cloud (Festanstellung)
Universität Heidelberg, Heidelberg
6/2019 – 12/2019 (7 Monate)
Öffentliche Verwaltung
Tätigkeitszeitraum

6/2019 – 12/2019

Tätigkeitsbeschreibung

leading the cloud team, organizational tasks, participating in CAB,

Eingesetzte Qualifikationen

Projektleitung / Teamleitung (IT), SCRUM

DevOps (Festanstellung)
Universität Heidelberg, Heidelberg
10/2016 – 6/2019 (2 Jahre, 9 Monate)
Öffentliche Verwaltung
Tätigkeitszeitraum

10/2016 – 6/2019

Tätigkeitsbeschreibung

Design, develop and administrate IaaS private cloud platform based on RED HAT OpenStack Platform for academical customers.
Provide appropriate cloud solutions for client requests
POC: object storage from different vendors
Logging, monitoring, and troubleshooting the cloud with different tools and frameworks such as ELK stack, Grafana, FluentD, and Sensu
Successful design and implementation of an OpenStack test cluster for testing cloud activities such as upgrade
Troubleshooting software-defined networking

Eingesetzte Qualifikationen

ITIL, Red Hat Enterprise Linux (RHEL), Apache HTTP Server, NginX, Docker, Git, Jira, IaaS (Infrastructure as a Service)

Software Entwickler (Festanstellung)
Universität Heidelberg, Heidelberg
10/2015 – 9/2016 (1 Jahr)
Öffentliche Verwaltung
Tätigkeitszeitraum

10/2015 – 9/2016

Tätigkeitsbeschreibung

Develop and configure a web application for handling
the administrative processes of Ph.D. students.
Full-Stack Developer: develop backend (Node.js), frontend (AngularJS), and REST API.
Develop features requested by clients for heiDOCS processes.
Fixing bugs reported by clients.
Cooperation with a third-party company for further development of the project.

Eingesetzte Qualifikationen

MongoDB, Serveradministration (allg.), Git, Node.js, AngularJS, JavaScript

Zertifikate

ITIL Foundation Certificate in IT Service Management
2019

Ausbildung

Informatik
Promotion
2019
Heidelberg

Über mich

I have more than +10 years of working experiences in the field of Data Engineering, Cloud Computing, Software Engineering, and DevOps.

Weitere Kenntnisse

Programming and scripting Languages: Python, Bash

Frameworks/Libraries: PySpark, Fast API, Databricks, Langchain, Spacy, Dask, Prefect, Pandas, Numpy, Matplotlib, Seaborn, Django, Django Rest Framework

Operating system: Unix/Linux (CentOS, Ubuntu, REHL), Windows

Cloud computing: AWS, Azure, Docker, Kubernetes

Database (SQL and NoSQL): MySQL, MariaDB, PostgreSQL, MongoDB

Automation and orchestration: Ansible, Jenkins, GitLab, GitHub, Azure DevOps

Logging and monitoring: ELK, Prometheus, Grafana

Web server: Apache, Nginx

IT methods: ITIL Foundation

Personal Skills: Excellent Oral and Written Communication Skills, self-motivated, problem-solving skills, willingness to take responsibilities, ability to work within a team environment and leading agile teams

Persönliche Daten

Sprache
  • Persisch (Muttersprache)
  • Englisch (Fließend)
  • Deutsch (Gut)
Reisebereitschaft
auf Anfrage
Arbeitserlaubnis
  • Europäische Union
Home-Office
bevorzugt
Profilaufrufe
3707
Alter
39
Berufserfahrung
16 Jahre und 1 Monat (seit 02/2008)
Projektleitung
1 Jahr

Kontaktdaten

Nur registrierte PREMIUM-Mitglieder von freelance.de können Kontaktdaten einsehen.

Jetzt Mitglied werden