Job description

Role Overview

We are seeking an experienced Azure Data Platform Engineer with a strong focus on Azure Administration, Platform Engineering, Infrastructure Automation, Monitoring, and Operations. The ideal candidate will have hands-on experience managing enterprise-scale Azure data platforms, ensuring their stability, security, performance, and availability across Development, Test, Pre-Production, and Production environments.

This role requires expertise in Azure data services administration, infrastructure provisioning, automation, monitoring, troubleshooting, disaster recovery, and CI/CD implementation.

Core Azure Services AdministrationData Platform Services

• Azure Data Factory (ADF) Administration

• Azure Synapse Analytics Administration

• Azure Databricks Administration

• Azure Cosmos DB Administration

• Azure Data Lake Storage Gen2 (ADLS)

• Azure Event Hub

• Azure Key Vault

Application & Integration Services

• Azure Function Apps

• Azure Logic Apps

• Azure App Services

• Azure API Management (APIM)

Infrastructure & Networking

• Azure Kubernetes Service (AKS)

• Azure Virtual Networks (VNet)

• Subnet Management

• Service Endpoints

• Private Endpoints

• Capacity Planning and Resource Optimization

Monitoring & Observability

• Azure Monitor

• Log Analytics

• Application Insights

• Alerting and Incident Management

DevOps & Automation

• Azure DevOps

• CI/CD Pipeline Design and Management

• Terraform

• ARM Templates

• Docker

• Jenkins

• Python Scripting

• Shell Scripting

Nice-to-Have Skills

• Tableau Administration

• Power BI Administration

Key ResponsibilitiesAzure Platform Administration

• Administer and maintain Azure Data Platform services including Databricks, Synapse, Data Factory, Cosmos DB, ADLS, Event Hub, Function Apps, Logic Apps, and App Services.

• Provision, configure, and optimize Azure resources to ensure scalability, security, and cost efficiency.

• Manage Azure networking components including VNets, subnets, service endpoints, and private endpoints.

• Perform capacity planning and resource utilization analysis.

Infrastructure Automation & IaC

• Design, implement, and maintain Infrastructure as Code (IaC) solutions using:

• Terraform

• Azure Resource Manager (ARM) Templates

• Automate infrastructure provisioning, deployment, scaling, and maintenance activities.

• Ensure consistency across environments through automation and standardized deployment practices.

Kubernetes & Container Management

• Manage containerized workloads using Docker.

• Deploy and administer Azure Kubernetes Service (AKS).

• Monitor cluster health and optimize resource utilization.

• Support application deployment and scaling strategies within AKS environments.

Monitoring, Alerting & Incident Management

• Implement monitoring and observability solutions using:

• Azure Monitor

• Log Analytics

• Application Insights

• Configure proactive alerting and notification mechanisms.

• Monitor platform performance, availability, and reliability.

• Conduct root cause analysis (RCA) and implement corrective actions for incidents.

Data Platform Operations

• Define, schedule, and monitor job workflows across Azure Data Factory and Databricks.

• Troubleshoot failed pipelines, workflows, and jobs.

• Review logs and diagnose system/application issues.

• Optimize performance and reliability of data processing workloads.

DevOps & CI/CD

• Design and maintain Azure DevOps CI/CD pipelines.

• Automate build, test, deployment, and release processes.

• Support version control, branching strategies, and deployment governance.

• Integrate infrastructure deployments into CI/CD workflows.

Disaster Recovery & Business Continuity

• Design and implement backup and disaster recovery (DR) solutions.

• Establish failover mechanisms for critical workloads.

• Perform DR testing and recovery validation.

• Ensure high availability and business continuity across environments.

Performance & Reliability Engineering

• Monitor and troubleshoot:

• CPU utilization

• Memory consumption

• Storage performance

• Network performance

• Operating System health

• Provide recommendations to development teams for application and workflow optimization.

• Ensure platform reliability and operational excellence.

Required Skills & ExperienceAzure Data Engineering & Platform Services

• Azure Data Factory (ADF)

• Azure Databricks

• Azure Synapse Analytics

• Azure Data Lake Storage Gen2 (ADLS)

• Azure Cosmos DB

• Azure Event Hub

• Azure API Management (APIM)

• Azure Function Apps

• Azure Logic Apps

• Azure App Services

Infrastructure & Cloud Engineering

• Azure Resource Management

• Azure Networking

• VNet, Subnets, Service Endpoints, Private Endpoints

• Azure Kubernetes Service (AKS)

• Docker

Infrastructure as Code (IaC)

• Terraform

• ARM Templates

Monitoring & Operations

• Azure Monitor

• Log Analytics

• Application Insights

• Incident Management

• Root Cause Analysis (RCA)

Automation & Scripting

• Python

• Shell Scripting

• Process Automation

DevOps

• Azure DevOps

• Jenkins

• CI/CD Pipeline Development

• Git-based workflows

Additional Competencies

• Distributed Systems Architecture

• High Availability & Scalability

• Disaster Recovery Planning

• Agile Methodologies

• Cloud Security Best Practices

• Performance Optimization

Preferred Qualifications

• Experience supporting enterprise-scale Azure environments.

• Strong troubleshooting and operational support background.

• Experience working with streaming and event-driven architectures.

• Exposure to Tableau and/or Power BI administration.

• Excellent communication and stakeholder management skills.

• Ability to work independently in a fast-paced, cloud-first environment.

Ideal Candidate Profile

The ideal candidate is a hands-on Azure Platform Engineer who combines strong administration skills with automation, DevOps, monitoring, and cloud infrastructure expertise. They should be comfortable managing mission-critical Azure data platforms, driving operational excellence, and building secure, scalable, and highly available cloud solutions.