The role
Job description
Role: Databricks Consultant Engagement Type: Remote (Moonlighting / Part-time Opportunity) Key Responsibilities:
- Design, develop, and optimize robust data pipelines using Databricks and Apache Spark.
- Build scalable ETL/ELT architecture to process large-scale structured and unstructured data.
- Collaborate with data engineering and analytics teams to support business intelligence and data science requirements.
- Perform performance tuning, monitoring, and troubleshooting of Databricks clusters and jobs.
- Ensure data security, governance, and compliance standards across all data solutions. Key Requirements:
- Strong hands-on experience with the Databricks platform, PySpark, Spark SQL, and Delta Lake.
- Expertise in cloud data platforms (AWS, Azure, or GCP).
- Solid background in SQL, Python, and data warehouse modeling.
- Proven ability to work independently in a remote setting and manage deliverables effectively.