Design and build robust data pipelines and feature stores that powers our AI products.
Analyse data requirements, understand complex data sources, and partner with architects to determine the best methods to extract, transform, and load data into data platform.
Lead conversations with business or functional teams to translate user requirements into reusable and cost-efficient data acquisition methodologies.
Be the key anchor for data extraction, preparation and hosting processes. Data expert for engineering datasets used by data scientists and BI developers working on various use cases.
Perform functional and stress testing on data models and extraction jobs to ensure that design is optimized for performance, scale, and reusability.
Manage foundational data administration tasks such as scheduling jobs, troubleshooting job errors, identifying issues with job windows, assisting with database backups and performance tuning.
Ensure data quality throughout entire development process, including audits and feedback loops to sources of truth.
Create or update technical documentation for transition to support teams.
Required Skills & Qualifications
Bachelors in Engineering, preferably Computer Science Engineering.
4+ years of experience building robust and production-grade data pipelines and data models.
Strong understanding of data modelling for AI products.
Hands-on experience working with large volumes of structured and unstructured data.
Strong proficiency in Python and SQL.
Experience working in a cloud environment, like GCP, AWS, Azure.
Proficiency with modern software development methodologies such as Agile, source control, CI/CD, etc.
Strong problem-solving capabilities. Results oriented. Relies on fact-based logic for decision-making.
Ability to work with multiple projects and work streams at one time. Must be able to deliver results based upon project deadlines.
Willing to flex daily work schedule to allow for time-zone differences for global team communications.
Design and build robust data pipelines and feature stores that powers our AI products.
Analyse data requirements, understand complex data sources, and partner with architects to determine the best methods to extract, transform, and load data into data platform.
Lead conversations with business or functional teams to translate user requirements into reusable and cost-efficient data acquisition methodologies.
Be the key anchor for data extraction, preparation and hosting processes. Data expert for engineering datasets used by data scientists and BI developers working on various use cases.
Perform functional and stress testing on data models and extraction jobs to ensure that design is optimized for performance, scale, and reusability.
Manage foundational data administration tasks such as scheduling jobs, troubleshooting job errors, identifying issues with job windows, assisting with database backups and performance tuning.
Ensure data quality throughout entire development process, including audits and feedback loops to sources of truth.
Create or update technical documentation for transition to support teams.
Required Skills & Qualifications
Bachelors in Engineering, preferably Computer Science Engineering.
4+ years of experience building robust and production-grade data pipelines and data models.
Strong understanding of data modelling for AI products.
Hands-on experience working with large volumes of structured and unstructured data.
Strong proficiency in Python and SQL.
Experience working in a cloud environment, like GCP, AWS, Azure.
Proficiency with modern software development methodologies such as Agile, source control, CI/CD, etc.
Strong problem-solving capabilities. Results oriented. Relies on fact-based logic for decision-making.
Ability to work with multiple projects and work streams at one time. Must be able to deliver results based upon project deadlines.
Willing to flex daily work schedule to allow for time-zone differences for global team communications.