The role
Job description
Design, develop, and maintain robust ETL/ELT pipelines using Azure Data Factory (ADF).
Build scalable data processing solutions using Azure Databricks and PySpark.
Develop and optimize complex SQL queries, stored procedures, views, and data models.
Ingest data from multiple sources including APIs, databases, flat files, and cloud storage.
Implement data transformation, cleansing, and enrichment processes.
Monitor and troubleshoot data pipelines to ensure reliability and performance.
Collaborate with Data Architects, BI Developers, and Business Stakeholders to understand data requirements.