Big Data/Data Science/DevOps

10/2021 – 4/2023

Design and implementation of data driven microservices for search en- gine(Google) optimization using AWS services. Services have mainly ETL patterns. A typical service gets data from a source(REST API, SQS, Dy- namoDB,etc), transforms it(e.g. calculates changes in a list with respect to previous days) and uploads results to a backend(S3, database).

Amazon Web Services (AWS), Python

6/2018 – 9/2021

- Betrieb, Weiterentwicklung, Integration von Big Data Plattformen auf Basis von MapR
- Troubleshooting von technischen Problemen
- Entwicklung von ETL Jobs
- Konzipierung und Implementierung der Cluster(Spark, MapR, Snowflake, etc) auf Google Cloud Plattform
- Onboarding der neuen Kunden

Active Directory, Ansible, Apache Spark, Cloud Computing, Continuous Delivery (CDE), DB2, ETL, Firewalls, Jenkins, Kafka, Load Balancing / Lastverteilung, Pandas DataFrame, Python, SSL / TLS, Teradata, VPN (Virtual Private Network)

9/2016 – 6/2018

- Management of large-scale, multi-tenant and secure, highly-available Ha- doop infrastructure supporting rapid data growth for a wide spectrum of innovative internal customers
- Onboarding of new customers
- Providing architectural guidance, planning, estimating cluster capacity, and creating roadmaps for Hadoop cluster deployments
- Design, implemention and maintainance of enterprise-level security Ha- doop environments(Kerberos, LDAP/AD, Sentry, encryption-in-motion, encryption-at-rest)
- Install Hadoop distributions, updates, patches, version upgrades
- Creating run books for troubleshooting, cluster recovery and routine clu- ster maintenance
- Troubleshooting Hadoop-related applications, components and infrastruc- ture issues at large scale
- 3rd-Level-Support (DevOps) for business-critical applications and use ca- ses
- Evaluation and proposals of new tools and technologies to meet the needs of the global organization (Allianz Group)
- Work closely with infrastructure, network, database, application, business intelligence and data science units
- Developer in Fraud Detection projects including machine learning
- Developer in Supply Chain Analytics projects
- Transformation of team’s internal processes according to Agile/SCRUM framework

MicroStrategy, R (Programmiersprache), Predictive analytics, Maschinelles Lernen, Apache Hadoop, Big Data, Datawarehouse / DWH, Data Mining, Business Intelligence (BI), RapidMiner (YALE), PostgreSQL, Oracle Database, ETL, mySQL, Microsoft SQL-Server (MS SQL), Datenbankentwicklung, Datenbankadministration, JDBC (Java Database Connectivity), Incident Management, Service Management, Firewalls, Red Hat Enterprise Linux (RHEL), Active Directory, Git, , Cisco Switch