Data Engineer and Analyst

Experienced data engineer proficient in Azure, SQL, and Talend. Expertise in data integration, transformations, and bidirectional synchronization. Strong track record in project leadership and implementation.

• Business Intelligence (BI)
• Cloud Computing
• Data Science
• Datawarehouse / DWH
• dbt
• DevOps
• Microsoft Azure
• Python
• PyTorch
• snowflake

Experienced Data Engineer with a Track Record of Successful Implementations

As a seasoned Data Engineer, I bring a wealth of experience in architecting and implementing robust data solutions that drive business insights and efficiencies. With a keen focus on leveraging cutting-edge technologies, I have spearheaded numerous projects across diverse domains, delivering tangible results and exceeding client expectations.

Key Competencies:

Data Integration and Architecture: Proficient in designing and implementing large-scale data integration solutions, I have orchestrated seamless data flows across various platforms and sources, ensuring data consistency and integrity. My expertise extends to leveraging Azure services such as Integration Runtimes to establish connections with offline sources and Azure SQL Databases, optimizing performance and scalability.

OpenmetaData Implementation: As a lead developer, I have led the successful implementation of OpenmetaData data catalog, enhancing data discoverability and accessibility within organizations. Leveraging custom connectors developed using the Airflow ingestion framework and Docker Compose for deployment, I have streamlined the metadata management process, empowering teams to make informed decisions based on reliable data.

Data Transformation and Pipelines: Proficient in implementing data transformations using tools like dbt, I have orchestrated efficient pipelines for data loading, historization, and transformation, driving operational excellence and agility in decision-making processes. My hands-on experience encompasses managing data complexity and ensuring seamless data synchronization across disparate systems.

Bidirectional Data Synchronization: As the lead data engineer and point of contact for bidirectional data synchronization initiatives, I have successfully bridged the gap between ERP and Salesforce systems. Through the development of robust pipelines and leveraging tools like Talend Open Studio, I have enabled seamless data exchange, driving synchronization and consistency across critical business processes.

SQL Expertise: With a strong foundation in SQL, I have undertaken diverse SQL projects ranging from database migrations to cross-database operations and linked services implementation. My proficiency extends to database complexity estimations and optimization strategies, ensuring optimal performance and reliability.

Conclusion:

With a proven track record in data engineering, I am adept at translating complex business requirements into scalable data solutions that drive actionable insights and business growth. My commitment to excellence, coupled with a passion for innovation, positions me as a valuable asset in delivering transformative data initiatives.

Experienced in leveraging data analysis and machine learning techniques to drive strategic insights and optimize performance. Proficient in developing predictive models, creating intuitive dashboards, and conducting social network analyses. Skilled in utilizing tools like Power BI and Pytorch for robust data analysis and storytelling.

Key Competencies:

Data Analysis & Visualization: Proficient in creating impactful dashboards in Power BI, focusing on performance optimization and effective storytelling to communicate insights effectively to stakeholders.

Predictive Modeling: Developed predictive models for various applications including housing prices and system failures, employing techniques such as machine learning algorithms to anticipate future trends and mitigate risks.

Social Network Analysis: Applied correspondence analysis to detect associations between users and interest groups, enabling targeted marketing strategies and community engagement efforts.

Machine Learning Development: Led the development and training of LLM using Pytorch for semi-supervised sentiment analysis, enhancing understanding of customer sentiment and feedback.