Data Engineer
Required
Preferred
Key Responsibilities: • Design and build robust data pipelines and feature stores that powers our AI products. • Analyse data requirements, understand complex data sources, and partner with architects to determine the best methods to extract, transform, and load data into data platform. • Lead conversations with business or functional teams to translate user requirements into reusable and cost-efficient data acquisition methodologies. • Be the key anchor for data extraction, preparation and hosting processes. Data expert for engineering datasets used by data scientists and BI developers working on various use cases. • Perform functional and stress testing on data models and extraction jobs to ensure that design is optimized for performance, scale, and reusability. • Manage foundational data administration tasks such as scheduling jobs, troubleshooting job errors, identifying issues with job windows, assisting with database backups and performance tuning. • Ensure data quality throughout entire development process, including audits and feedback loops to sources of truth. • Create or update technical documentation for transition to support teams.
Required Skills & Qualifications: • Bachelors in Engineering, preferably Computer Science Engineering. • 4+ years of experience building robust and production-grade data pipelines and data models. • Strong understanding of data modelling for AI products. • Hands-on experience working with large volumes of structured and unstructured data. • Strong proficiency in Python and SQL. • Experience working in a cloud environment, like GCP, AWS, Azure. • Proficiency with modern software development methodologies such as Agile, source control, CI/CD, etc. • Strong problem-solving capabilities. Results oriented. Relies on fact-based logic for decision-making. • Ability to work with multiple projects and work streams at one time. Must be able to deliver results based upon project deadlines. • Willing to flex daily work schedule to allow for time-zone differences for global team communications.
Upload your resume and fill in the details below.