Archiviertes Projekt - EADP Data Engineering (m/f/d) - Ref. 104607

Our client is looking for an EADP Data Engineering (f/m/d) on a freelance basis.

# Key data
Start: 01.04.2024
End: 30.06.2024 (with option to extend)
Location: Remote (1-2 days per month in Frankfurt)
Workload: Full-time
Languages: English English
Contracting/Freelancing


# Project Background
Data Access Layer should become a state-of-the-art advanced solution for data availability and data consumption. The key objective is to design and build out a global, stable and up-to-date data warehouse functionality that can fulfill the needs of portfolio managers, data scientists and analysts. Therefore, this platform requires setup and integration of multiple internal and external data sources, building a data catalog and ensuring that data ownership and data completeness are in place.


# Overall Project Scope

* Build and ongoing review of functional and solution design of a data lake as well as other parts of Data Access Layer.
* Develop Databricks notebooks for data delivery and data modelling as well as SQL scripts
* Translate functional requirements into technical specs supported by a business analyst.
* Technical design and build of interfaces and data feeds using Informatica
and/or Azure technologies.
* Create and maintain appropriate documentation using existing tools such as Jira/Confluence and applying Company's standards.
* Ensure collection of meaningful data and feedback across the whole organization, while engaging stakeholders into the importance of a Data Access Layer
* Ensure alignment with Enterprise architecture and Enterprise Data Office for all interface solutions.
* Analyze and understand business processes and requirements, design IT solutions based on the analysis, assist business and IT-department during the
implementation phase.
* Design test planning as well as automated and manual management and execution. Document and execute functional test plans. Work with the end-user community to support the documentation and execution of UAT test cases.
* Apply agile project and design methodologies.


#Task

* Onboard new datasets onto the central platform using Microsoft Azure stack (Azure Data factory, Azure Databricks)
* Implement dimensional modelling based on the design provided using Azure stack
* Conduct data demand analysis to ensure that all standards are fulfilled
* Document the pipelines in Wiki
* Data model and related data base structure.
* Delivery of data migration activities, data onboarding and design required
* plans (e.g. migration, testing, data collection)
* Review test cases and test execution and provide feedback for improvement.
* Defect analysis and resolution based on provided information, infrastructure and tools.
* Knowledge transfer and handover to Run teams named by the Company's Project Manager: Provide any documentation and training required to the Client.
* Completion of the assigned JIRA tasks in accordance with AGI
* Ensure compliance with various standards and best practices


# Must-have requirements

* Track record of project including Python and SQL
* Previous experience or good understanding/capabilities of Cloud services (i.e. Microsoft Azure (Data Factory, Databricks, Data Lake))
* Knowledge and experience of Asset Management industry is a plus


If you are interested in this project, I'd be happy to receive your current CV with information about your availability and your hourly or daily rate for remote and on-site work.

If you have any questions, please don't hesitate to contact me!