Back to Browse Jobs
Zorba AI
Create a free account
One signup unlocks everything for this job:
- See your personalized profile match score
- See the skills this role is missing for you
- Apply to this job and track your application
- Generate an AI cover letter for this role
Noida · On-site · 6-9 Yrs · Oct 30
4 views
13 open roles0 posted in 7d13 in 30d
Hiring: Engineering
Job description
Overview
We are looking for an experienced Data Engineer with 6+ years of experience in designing, developing, deploying, monitoring, and optimizing scalable batch and streaming data pipelines .
Responsibilities
- Design, develop, deploy, monitor, and optimize ETL/ELT workflows for both batch and real-time/streaming data processing.
- Develop scalable data processing solutions using Scala and Apache Spark.
- Build and manage streaming pipelines using Kafka, including handling high-volume data and back-pressure scenarios.
- Develop and maintain Airflow DAGs for complex data orchestration, dependency management, scheduling, retries, and idempotent execution.
- Work extensively with Google Cloud Platform (GCP) services including BigQuery and Dataproc.
- Implement Medallion Architecture (Bronze, Silver, Gold) with appropriate data quality validations, transformations, aggregations, and summarization. Perform performance tuning and optimization of Spark jobs, Kafka pipelines, BigQuery queries, and ETL workflows.
- Implement monitoring and observability mechanisms to identify and troubleshoot pipeline failures, performance issues, and data-quality problems.
- Create and maintain runbooks and operational documentation for production support and continuous optimization. Troubleshoot runtime data issues independently and ensure timely resolution of production incidents. Follow best practices for data governance, security, access control, and information security.
Qualifications
- Good to Have
- Exposure to data governance and information security. Experience with GCP data services beyond BigQuery and Dataproc. Experience implementing automated data quality checks and reconciliation. Knowledge of CI/CD and infrastructure-as-code practices. Experience creating production runbooks and operational standards.
- Ideal Candidate
- A strong candidate should be capable of owning end-to-end data pipelines , from development and deployment through production monitoring, troubleshooting, performance optimization, and continuous improvement, across both batch and real-time data environments .
- Skills: kafka,gcp,scala,spark .
Verify Engineering for this role
Free PRACTICE for Engineering adds a verified skill signal that can boost how roles like this rank for you — optional, not required to browse or apply.
Sign up — verify Engineering free →Want match scores and deeper insight? Create a free candidate profile
Job application FAQ
Last updated 5 November 2026
- How do I apply for Data Engineer Scala | Kafka | Spark | GCP at Zorba AI?
- Open this job on Feedback AI and sign up free (or sign in). You can apply from the job detail page; match scores and skill gaps appear when your profile is complete. Zorba AI may attach structured assessments to interview rounds after you apply.
- Does Feedback AI show a match score for this Data Engineer Scala | Kafka | Spark | GCP role?
- Yes after you add a resume or skills. Match score ranks this role against your profile — skills met, gaps, level, and location — so you prioritise applications where fit is strongest.
- Is Data Engineer Scala | Kafka | Spark | GCP remote or on-site in Noida, Uttar Pradesh?
- This listing is marked on_site with location Noida, Uttar Pradesh. Confirm details on the job description before applying.
- What skills matter for this Data Engineer Scala | Kafka | Spark | GCP role at Zorba AI?
- This is a mid-level Data Engineer Scala | Kafka | Spark | GCP role. Key skills include skills listed in the job description. Feedback AI highlights matched vs missing skills on your profile after signup.