The role
Job description
Job Summary:
We are looking for a highly skilled Senior Data Engineer with strong expertise in Google Cloud
Platform (GCP), Apache Beam/Dataflow, Java, and BigQuery. The ideal candidate will be
responsible for designing, building, and optimizing scalable data pipelines and cloud-based data
processing solutions for enterprise applications.
Key Responsibilities:
โ Design and develop scalable ETL/ELT pipelines using GCP services.
โ Build and maintain real-time and batch data processing pipelines using Dataflow and
Apache Beam.
โ Develop robust backend processing solutions using Java.
โ Work extensively with BigQuery for data warehousing, analytics, and performance
optimization.
โ Integrate data from multiple sources including APIs, databases, and streaming platforms.
โ Optimize pipeline performance, cost, scalability, and reliability on GCP.
โ Collaborate with cross-functional teams including Architects, Analysts, DevOps, and
Business stakeholders.
โ Ensure data quality, governance, monitoring, and security best practices.
โ Troubleshoot production issues and provide long-term scalable solutions.
Required Skills & Qualifications
โ Strong hands-on experience with GCP services.
โ Expertise in Google Dataflow / Apache Beam.
โ Strong programming skills in Java.
โ Hands-on experience with BigQuery.
โ Experience in building batch and streaming data pipelines.
โ Good knowledge of SQL and data modeling concepts.
โ Experience with CI/CD, Git, and Agile methodologies.
โ Strong problem-solving and debugging skills.
Good to Have:
โ Experience with Pub/Sub, Cloud Composer, Cloud Storage, Dataproc, or Kafka.
โ Exposure to Python or Spark.
โ Experience in handling large-scale enterprise data platforms.
Preferred Qualifications:
โ Bachelorโs/Masterโs degree in Computer Science, Engineering, or related field.
โ GCP certifications are an added advantage