freiberufler Senior Data Engineer/Cloud Data Architect auf

Senior Data Engineer/Cloud Data Architect

zuletzt online vor 2 Tagen
  • auf Anfrage
  • 89073 Ulm
  • Europa
  • en  |  hi
  • 19.03.2023


Data engineer with 8+ years of professional experience in data industry. I offer consultancy/development for data architectures, data modeling, NoSQL/SQL database designs, streaming/batch ETL, Databricks Spark, kafka, , Devops , Azure, python.


  • Apache Spark
  • Azure Databricks
  • Big Data
  • Cloud Computing
  • Datawarehouse / DWH
  • Datenbankentwicklung
  • ETL
  • Kafka
  • Kubernetes
  • Microsoft Azure
  • Python
  • Software Architektur / Modellierung
  • SQL

Projekt‐ & Berufserfahrung

Senior Data Engineer
Liebherr Group, Ulm
1/2022 – offen (1 Jahr, 3 Monate)
IT & Entwicklung

1/2022 – offen


* Key contributor for data and analytics platform at Leibherr.
* Mentored a team of 5 data engineers, and collaborated with product manager and product
owners to shape the correct scope, requirements & priorities.
* Designed and developed data management framework and strategies for data quality, metadata
management, data modeling, and data architectures.
* Designed and implemented batch and streaming data pipelines using Databricks Spark(PySpark
and Spark-SQL).
* Implemented performance tuning of distributed data processing and data load optimizations.
* Developed modern data warehouse solutions using Azure Stack (Azure Data Lake, Azure
Databricks, Delta Lake house).
* Developed data quality rules and validations using Spark/ Python to ensure that data is error-free.
* Implemented access control, cluster management, jobs orchestration in Azure Databricks.
* Documented and presented data architectures and designs to project leaders and stakeholders.

Eingesetzte Qualifikationen

Apache Spark, Azure Databricks, Big Data, Cloud Computing, Datawarehouse / DWH, ETL

AI Data Engineer
Schwarz Group (Lidl and Kaufland), Heilbronn
5/2017 – 12/2021 (4 Jahre, 8 Monate)

5/2017 – 12/2021


* Worked in artificial intelligence team with data scientists and data engineers, with the key
responsibilities of designing and building data driven applications.
* Own the delivery of the project from the requirements gathering step to eventual production
deployment and stakeholder management.
* Developed distributed applications and data pipelines using technologies like Azure, Python,
Spark, Kafka etc.
* Implemented data preparation and business transformations using Spark SQL and Pandas.
* Implemented Hive, Data Lake and NoSQL based storages.
* Implemented loading, processing and storage of data with Delta lake and Pyspark in Azure Databricks platform.
* Implemented software and data engineering best practices (CI/CD, testing, data quality, etc)
* Worked in Agile environment, and used Jira tool to maintain the user stories and tasks

Eingesetzte Qualifikationen

Apache Hadoop, Apache Spark, Azure Databricks, Big Data, Python, SQL

Software Engineer
Cisco, Bangalore
8/2011 – 7/2014 (3 Jahre)
IT & Entwicklung

8/2011 – 7/2014


* Key contributor for the Cisco Intellectual Management Platform.
* Designed and Developed a Rule Based Intellectual Capital (RBIC) : A web based application
using Java tech stack which helps to capture, share and re-use of expert knowledge (IC).
* Designed and developed web components and backend using Java/JavaScript technologies and RESTful web services.
* Developed web api's using Spring MVC and ORM in hibernate.
* Implemented software engineering best practices- unit testing, integration testing, code reviews.
* Followed agile methodologies (Scrum) and built production quality software.

Eingesetzte Qualifikationen

Agile Entwicklung, Java (allg.), JavaScript, Software Architektur / Modellierung, Software Design, Software engineering / -technik, Spring


Microsoft Certified: Azure Solutions Architect Expert
Januar 2023
Microsoft Certified: Azure Data Engineer Associate
November 2022
Microsoft Certified: Azure Administrator Associate
August 2022


Distributed Software Systems

Jahr: 2017
Ort: Technische Universität Darmstadt
Computer Science

Jahr: 2012
Ort: Baddi, India

Über mich

Microsoft Certified Azure Data Engineer and Solutions Architect.
Designing and development of distributed applications/data pipelines/ETL.
Building modern data warehouses with Databricks, Spark, Azure.
Solid understanding on Data Management, Data Architectures, Data Science, and Cloud.
Expertise in Spark and Databricks.
Development of operational execelence monitoring, security and scalability.
Experienced in Agile Software Development and Delivery.

Weitere Kenntnisse

Coding: Python, Java, HTML/JS, SQL
Data Storages: HDFS, S3, Blob Storage, Delta Lakehouse, Azure Data Lake, NoSQL Databases
Data Solutions: Date migration, Date integration, ETL, ELT, Data Warehouse, Data Modeling, Data Architectures
Distributed Platforms: PySpark, Spark Streaming, Batch Jobs, Kafka
Compute: Azure Kubernetes, Docker, Azure Databricks, AWS, Google
Operating Systems: Linux, Unix, Windows
Devops: GIT, Jenkins, Terraform

Persönliche Daten

  • Englisch (Fließend)
  • Hindi (Muttersprache)
  • Europäische Union
11 Jahre und 7 Monate (seit 08/2011)
3 Jahre


Nur registrierte PREMIUM-Mitglieder von können Kontaktdaten einsehen.

Jetzt Mitglied werden