Data Architect | Lead Developer | IT Project Management

4/2021 – offen

design and optimization of data storage and processing
components of a bespoke data analytics platform in a large-scale project (100+
developers)

Platform Analysis and Optimization
- Evaluation of the existing software stack against requirements
- Identification of risks and performance bottlenecks, proposing and demonstrating
innovative solutions
- Design and integration of improvements into the platform architecture
- Results: improved metadata search speed by 250x, increased data processing
speed by 4x, and maximized developer productivity

Collaboration and knowledge sharing
- Technical support and knowledge transfer to development teams
- Conducting Spark training sessions and promoted best practices for efficient
data processing
- Documenting best practices to enhance onboarding and developer experience

Technical expertise
- Storage layout optimization for Spark based low latency workloads
- Error analysis in distributed systems: concurrency effects and their mitigation

Apache Spark, Big Data, Datenbankentwicklung, Distributed Computing, Java (allg.), Postgresql, Projektmanagement (IT)

10/2016 – 3/2021

Leading software development within European-wide data-centric IT-projects
in the energy- and finance-sector

Lead Developer of a Hadoop based data platform (~12 developers) at an
European Transmission System Operator (TSO)
- Solution designs for optimal stack usage (Hadoop, Spark, Kafka and
container orchestration platform)
- Workshops and know-how transfer to the client
- Design and automation of software development process using Jenkins
- Support to apply and improve (scaled) agile software development methods

Technical project lead of a team with 6 developers implementing object
detection and recognition using Deep Neural Network
- Design of a data storage concept for input data management (tailored
export of train-/test-dataset for model training and evaluation)
- Process design for on-premises and cloud deployments
- Preparation and conduct of workshops for know-how transfer to the client

Data Scientist at German TSO
- Data pre-processing in Hadoop Big Data environment using Spark
- Implementation of automated data processing- and sanitization pipeline
- Benchmark and performance optimizations of existing software infrastructure

Apache Hadoop, Big Data, Data Engineer, Data Science, Data Warehousing, Projektmanagement (IT), Python