All fields marked * are required
Job Description – Azure Data Engineering with Production Support
Experience: 9+ Years
Work Mode: Hybrid
Employment Type: Full-Time
We are looking for an experienced Azure Data Engineering Tech Lead with strong expertise in Azure Databricks, PySpark, Azure Data Factory (ADF), Data Warehousing and Data Lakes. The candidate will be responsible for designing and implementing scalable, high-performance data solutions and leading technical discussions with clients and internal teams.
The ideal candidate should have strong hands-on technical skills along with experience in production support, performance optimization, solution design and client-facing communication.
Design and implement data ingestion and Data Lake-based solutions using Azure Big Data technologies.
Develop scalable and cost-efficient data pipelines using Azure Databricks, PySpark and ADF.
Integrate data from multiple sources and transform it for analytics, reporting and data science requirements.
Design and develop data environments to support analytics and reporting teams.
Implement data integration, data manipulation and ETL/ELT processes.
Monitor data pipelines and troubleshoot production issues.
Perform performance tuning and optimize Spark jobs, queries and data pipelines.
Identify opportunities to improve infrastructure, processing performance and cloud costs.
Work with different data ingestion techniques, frameworks and APIs.
Analyze data patterns and implement efficient data ingestion strategies.
Provide technical guidance to development teams and participate in solution design.
Interact with clients to understand requirements, discuss solutions and provide technical updates.
Ensure data solutions are reliable, scalable, secure and maintainable.
Azure Databricks (ADB)
PySpark
Azure Data Factory (ADF)
Data Lake / Data Warehouse
Python and SQL
Data ingestion and data integration
Data pipeline development
Production support and troubleshooting
Performance optimization
Cloud data engineering
Experience with Delta Lake
Knowledge of Medallion Architecture
Experience with Azure storage technologies
Knowledge of Spark optimization techniques
Experience with REST APIs / multiple data sources
Experience working with Agile development teams
Strong analytical and problem-solving skills
Strong hands-on experience in Azure Data Engineering.
Ability to independently design and implement end-to-end data solutions.
Strong understanding of Big Data technologies and data engineering concepts.
Experience handling production-critical data pipelines.
Good understanding of performance and cost optimization.
Excellent communication and client-facing skills.
Ability to work as a technical lead and guide development teams.
Required
All fields marked * are required
Job Description – Azure Data Engineering with Production Support
Experience: 9+ Years
Work Mode: Hybrid
Employment Type: Full-Time
We are looking for an experienced Azure Data Engineering Tech Lead with strong expertise in Azure Databricks, PySpark, Azure Data Factory (ADF), Data Warehousing and Data Lakes. The candidate will be responsible for designing and implementing scalable, high-performance data solutions and leading technical discussions with clients and internal teams.
The ideal candidate should have strong hands-on technical skills along with experience in production support, performance optimization, solution design and client-facing communication.
Design and implement data ingestion and Data Lake-based solutions using Azure Big Data technologies.
Develop scalable and cost-efficient data pipelines using Azure Databricks, PySpark and ADF.
Integrate data from multiple sources and transform it for analytics, reporting and data science requirements.
Design and develop data environments to support analytics and reporting teams.
Implement data integration, data manipulation and ETL/ELT processes.
Monitor data pipelines and troubleshoot production issues.
Perform performance tuning and optimize Spark jobs, queries and data pipelines.
Identify opportunities to improve infrastructure, processing performance and cloud costs.
Work with different data ingestion techniques, frameworks and APIs.
Analyze data patterns and implement efficient data ingestion strategies.
Provide technical guidance to development teams and participate in solution design.
Interact with clients to understand requirements, discuss solutions and provide technical updates.
Ensure data solutions are reliable, scalable, secure and maintainable.
Azure Databricks (ADB)
PySpark
Azure Data Factory (ADF)
Data Lake / Data Warehouse
Python and SQL
Data ingestion and data integration
Data pipeline development
Production support and troubleshooting
Performance optimization
Cloud data engineering
Experience with Delta Lake
Knowledge of Medallion Architecture
Experience with Azure storage technologies
Knowledge of Spark optimization techniques
Experience with REST APIs / multiple data sources
Experience working with Agile development teams
Strong analytical and problem-solving skills
Strong hands-on experience in Azure Data Engineering.
Ability to independently design and implement end-to-end data solutions.
Strong understanding of Big Data technologies and data engineering concepts.
Experience handling production-critical data pipelines.
Good understanding of performance and cost optimization.
Excellent communication and client-facing skills.
Ability to work as a technical lead and guide development teams.
Required