The role
Job description
Job Description โ Data Engineer
Opportunity Type: Freelance / Contractual (Moonlighting)
Engagement: Part-Time / Flexible Engagement
Experience: 4+ Years
Location: Remote
About the Opportunity
We are looking for an experienced Data Engineer for a remote freelance engagement. The ideal candidate should have strong hands-on experience in data engineering, ETL/ELT development, data pipelines, cloud platforms, and data warehouse solutions.
This opportunity is suitable for professionals currently working full-time who can independently manage additional project responsibilities alongside their existing commitments, based on mutually agreed working hours and deliverables.
Key Responsibilities
Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
Extract, transform, and load data from multiple sources into data warehouses.
Develop and optimize data processing solutions using Python and SQL.
Work with cloud-based data engineering platforms and services.
Build and maintain data lakes, data warehouses, and data integration solutions.
Perform data cleansing, transformation, validation, and quality checks.
Optimize SQL queries and improve data pipeline performance.
Implement automated workflows for data processing and scheduling.
Work with large datasets and ensure data accuracy, consistency, and reliability.
Collaborate with analytics, BI, and business teams to understand data requirements.
Troubleshoot pipeline failures and resolve data-related issues.
Maintain technical documentation and follow data engineering best practices.
Required Technical Skills
Strong hands-on experience in Data Engineering.
Proficiency in Python and SQL.
Experience with ETL/ELT processes and data pipeline development.
Knowledge of data warehousing and data modeling concepts.
Experience with cloud platforms such as Microsoft Azure, AWS, or GCP.
Experience with Apache Spark / PySpark.
Knowledge of relational and non-relational databases.
Experience with workflow orchestration tools such as Apache Airflow.
Understanding of data lakes, lakehouses, and distributed data processing.
Experience with Git, CI/CD, and data pipeline monitoring.
Preferred Cloud & Data Technologies
Microsoft Azure:
Azure Data Factory (ADF)
Azure Databricks
Azure Synapse Analytics
Azure Data Lake Storage (ADLS)
AWS:
AWS Glue
Amazon S3
Amazon Redshift
AWS Lambda
GCP:
BigQuery
Dataflow
Cloud Storage
Experience in at least one major cloud ecosystem is preferred.
Mandatory Skills
Python
Advanced SQL
ETL / ELT
Data Pipeline Development
Cloud Data Engineering (Azure / AWS / GCP)
Data Warehousing
PySpark / Apache Spark
Engagement Expectations
Must be comfortable with a remote freelance / moonlighting engagement.
Should be capable of managing additional project responsibilities alongside existing employment.
Must commit to mutually agreed working hours and project deliverables.
Should have a reliable internet connection and a suitable remote-working setup.
Must maintain confidentiality and professional communication throughout the engagement.
Preferred Candidate Profile
Professionals with strong hands-on Data Engineering experience who can independently design, develop, optimize, and maintain data pipelines and cloud-based data solutions.