Data Engineer | AWS | Azure | Data Integration | Data Warehousing | ETL | Business Intelligence

2/2024 – 2/2025

1. Led the design and development of a global scorecard automation system, eliminating manual data collection and processing for over 400 analysts worldwide. Improved compliance and data security with row-level access and streamlined reporting and distribution using AWS S3, Redshift, Qualtrics, and QuickSight.

2. Eliminated manual schedule maintenance efforts by 120+ hours/month by automating the Shift Schedule dashboard for over 50,000 customer service agents globally. Built end-to-end data pipelines, executed complex data extraction and transformation using Datanet and SQL, and refreshed data every 4 hours, enabling timely and consistent data for workforce management teams for decision-making.

3. Collaborated with product owners, 4 business stakeholders, and end users to gather requirements, iterate on designs, and incorporate feedback, resulting in global adoption and strong stakeholder alignment for multiple BI initiatives.

4. Conducted Root Cause Analysis (RCA) and applied data quality checks, resulting in a 30% reduction in pipeline failure resolution time.

5. Implemented Infrastructure as Code (IaC) solutions using AWS CloudFormation, enabling consistent and repeatable infrastructure deployment across data projects.

6. Mentored 2 interns and junior engineers, documented onboarding processes, and conducted structured knowledge-sharing sessions to accelerate team productivity.

7. Took initiative to join the AWS OpenSearch and Redshift support team short-term, assisting customers with performance tuning, RCA, feature requests, and bug replications, demonstrating versatility and eagerness to learn beyond the core data stack.

Data Warehousing, Databricks, ETL, Power Bi, SQL

9/2021 – 1/2024

1.Developed 30+ ETL pipelines across Informatica PowerCenter, IICS, and Databricks to ingest transactional and analytical data from relational databases, RESTful APIs, and flat files into Snowflake, processing over 500GB of daily data.

2. Migrated over 1.5 TB+ of data from legacy data systems to an optimized database structure, reducing data retrieval latency by 15%.

3. Orchestrated data workflows using Apache Airflow, automating cross-platform jobs that eliminated manual steps and increased process automation by 75%.

4. Owned a submodule of the migration end-to-end. Implemented SCD Type 1 & 2 logic, tracked and maintained DDL changes, and collaborated with QA and stakeholders to ensure defect-free deployment across UAT and production.

5. Engineered file ingestion pipelines for Customer Data Platform (CDP) using MoveIt + IDMC + Autosys, with triggers, pre/post commands, and data validation routines to support error-free delivery of customer data to downstream MDM.

6. Identified platform limitations (e.g., lack of native filename support in Snowflake) and invented custom workarounds. Escalated feature requests to Snowflake, contributing to long-term platform enhancements.

7. Resolved critical production incidents and followed recovery mechanisms, ensuring data integrity and pipeline uptime.

8. Worked in a collaborative agile environment with 8 other data engineers and database administrators. Performed peer review to enhance coding standards.

Data Warehousing, Databricks, ETL, Informatik, Snowflake, SQL