Back to all jobs
EXL
Data Engineer
Noida, Pune, Bangalorehybrid4.0 - Any years
Skills
Required
pythonsqlgcpawsazure
Preferred
gitdocker
Job Description
Key Responsibilities
- Design and build robust data pipelines and feature stores that powers our AI products.
- Analyse data requirements, understand complex data sources, and partner with architects to determine the best methods to extract, transform, and load data into data platform.
- Lead conversations with business or functional teams to translate user requirements into reusable and cost-efficient data acquisition methodologies.
- Be the key anchor for data extraction, preparation and hosting processes. Data expert for engineering datasets used by data scientists and BI developers working on various use cases.
- Perform functional and stress testing on data models and extraction jobs to ensure that design is optimized for performance, scale, and reusability.
- Manage foundational data administration tasks such as scheduling jobs, troubleshooting job errors, identifying issues with job windows, assisting with database backups and performance tuning.
- Ensure data quality throughout entire development process, including audits and feedback loops to sources of truth.
- Create or update technical documentation for transition to support teams.
Required Skills & Qualifications
- Bachelors in Engineering, preferably Computer Science Engineering.
- 4+ years of experience building robust and production-grade data pipelines and data models.
- Strong understanding of data modelling for AI products.
- Hands-on experience working with large volumes of structured and unstructured data.
- Strong proficiency in Python and SQL.
- Experience working in a cloud environment, like GCP, AWS, Azure.
- Proficiency with modern software development methodologies such as Agile, source control, CI/CD, etc.
- Strong problem-solving capabilities. Results oriented. Relies on fact-based logic for decision-making.
- Ability to work with multiple projects and work streams at one time. Must be able to deliver results based upon project deadlines.
- Willing to flex daily work schedule to allow for time-zone differences for global team communications.
Apply for this position
Upload your resume and fill in the details below.