Custom Software Engineer - SQL Server & Databricks

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Microsoft SQL Server Good to have skills : Databricks Unified Data Analytics Platform Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Senior Data Engineer – SQL Server, Databricks & Power BI - 6+ Years in SQL Server Development, Data Engineering, ETL, Production Support, and Analytics along with Databricks Job Summary We are seeking an experienced Data Engineer with strong expertise in SQL Server, Databricks, ETL development, data validation, reporting, and production support. The ideal candidate will be responsible for designing and optimizing data solutions, managing large-scale data integration processes, ensuring data quality, supporting business reporting needs, and driving automation initiatives across enterprise data platforms. Key Responsibilities SQL Server Development & Database Management (6+ Years) Design, develop, and maintain complex SQL queries, stored procedures, views, functions, and database objects. Create and manage database structures including tables, indexes, constraints, and partitions while ensuring data integrity and security. Optimize database performance through query tuning, indexing strategies, and execution plan analysis. Automate recurring database tasks using SQL Agent Jobs, scripts, and scheduling frameworks. Collaborate with business and technical teams to translate requirements into scalable data solutions. Databricks & Data Engineering (2+ Years) Develop and maintain data pipelines using Databricks and cloud-based data engineering technologies. Build and optimize ETL/ELT workflows for processing structured and semi-structured datasets. Work with large-scale datasets leveraging Spark and Databricks for data transformation and analytics. Support data migration, modernization, and cloud adoption initiatives. Monitor, troubleshoot, and improve data pipeline performance and reliability. Data Integration & ETL Processing Design and maintain end-to-end data ingestion and integration workflows across multiple source and target systems. Develop scalable ETL pipelines for processing data from diverse enterprise applications and databases. Manage data extracts, imports, synchronization processes, and downstream integrations. Ensure accurate source-to-target data movement through reconciliation and validation processes. Support multi-region data processing and reporting requirements. Production Support & Operations (6+ Years) Provide Level 2/Level 3 production support for data platforms, SQL databases, and ETL processes. Monitor critical jobs and ensure compliance with operational SLAs. Troubleshoot and resolve data, application, and system issues with minimal business impact. Perform root cause analysis and implement preventive measures for recurring issues. Support cross-functional teams and critical business processes as a backup resource. Data Validation & Quality Assurance Perform comprehensive data quality checks and validation activities including: Record count reconciliation Duplicate and exception analysis Aggregate and trend validation Null and completeness assessments Conduct periodic and ad-hoc validations prior to data publication. Identify data anomalies and partner with stakeholders to resolve quality issues. Maintain data quality standards and governance practices. Reporting, Analytics & Visualization (3+ Years) Develop and maintain Power BI dashboards, reports, and KPI scorecards. Generate analytical reports to identify trends, anomalies, and business insights. Support business users with self-service reporting and data analysis requirements. Perform variance analysis and reconciliation reporting across multiple datasets. Automation & Process Improvement (6+ Years) Develop reusable automation frameworks for validation, reconciliation, monitoring, and reporting processes. Build workflow automations using Power Automate and Power Platform solutions. Drive continuous improvement initiatives focused on operational efficiency and data quality. Explore and implement AI-enabled automation opportunities to reduce manual effort. Required Skills & Technologies Mandatory SQL Server SQL Server Management Studio (SSMS) Databricks Power BI ETL/Data Engineering Power Automate Power Apps Advanced Microsoft Excel Stored Procedures, Views, Functions, Performance Tuning Data Validation & Reconciliation Good to Have Azure Data Factory (ADF) Azure Data Lake PySpark Cloud Data Platforms (Azure/AWS) GenAI and Data Automation Tools Additional Requirements Ability to support Shift-B operations with availability until 11:00 AM PST. Strong analytical, troubleshooting, and problem-solving skills. Excellent communication and stakeholder management capabilities. Willingness to work from office as per organizational policy. Return to Office (RTO) Mandatory 5-day Work from Office from one of the strategic locations: Bengaluru Hyderabad Chennai Coimbatore

15 years full time education