Senior Data Engineer

1/2024 – offen

…

Big Data, Data Warehousing, Databricks, Generative KI, MLOps

7/2019 – 12/2023

- As the lead data engineer, successfully led the engineering of data processing pipelines in multiple high-profile projects, utilizing cutting-edge technologies like Apache Spark to efficiently process structured and semi-structured data. These pipelines improved processing times, scalability, and data quality for the organization.
- Collaborated with Data Scientists to develop data-driven solutions that achieved seven-digit cost savings and revenue increase for the organization. Through close collaboration and a deep understanding of the business requirements, we identified critical areas for improvement and designed innovative solutions that delivered substantial value. Additionally, established MLOps approach with AWS Sagemaker for streamlined development and deployment of machine learning models.
- Successfully led a project on implementing dynamic pricing for automotive insurance, which enabled the business to access near-real-time data for pricing optimizations. Managed the end-to-end project lifecycle, including requirements gathering, project planning, team coordination, and stakeholder management. Delivered the project within the allocated budget and timeline, resulting in increased revenue and improved customer satisfaction.

Amazon Web Services (AWS), Apache Spark, Datenmodelierung, ETL, Projektmanagement (IT), Python, Requirement Analyse

4/2019 – 6/2019

• Successfully migrated complex vert.x based microservices to Self-Containing Services using Spring Boot, Spring Cloud, and
Apache Camel. Overcame numerous challenges during the migration process, resulting in a more maintainable system.
• Led the effort to perform comprehensive performance testing of existing infrastructure using jMeter and implemented
integration tests to ensure system reliability and scalability. As a result of these efforts, we were able to identify and resolve
critical performance bottlenecks, resulting in a more efficient and robust system.

Java (allg.), Spring Framework, Apache Camel