Create a free account
One signup unlocks everything for this job:
- Apply to this job and track your application
- See your personalized profile match score
- Generate an AI cover letter for this role
Thiruvananthapuram · On-site · ₹1 LPA · 8-11 Yrs · Aug 15
Information Technology Support Services · 10000+ Employees · Aliso Viejo, US
What we do: Digital Solutions, Platforms, Engineering, R&D, and Products UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30K+ employees in 30+ countries, UST builds for boundless impact—touching billions of lives in the process.
Hiring: Engineering
What employees say
+ Great work life balance, hybrid work culture, easy to find projects and opportunities, trainings and certifications
− Career growth, employee career development, salary
More reviews on the company profile.
Interview experience · Senior MS SQL DB Administrator
the interview process was very good and we organized. The interviewer was professional and asked relevant question's related to the role. I have good opinion on this company as of now.
Very_difficult difficulty · Chennai · 1,929 reports
More interview insightsJob description
Overview
5 - 7 Years 1 Opening
Responsibilities
- Data Engineer – Spark & Streaming (GCP)
- Job Summary
- The Data Engineer – Spark & Streaming is responsible for designing, developing, and maintaining scalable batch and real-time data pipelines using Apache Spark, Kafka, and Google Cloud Platform (GCP). The role focuses on building high-performance data platforms, optimizing data processing, and delivering reliable data solutions for analytics, reporting, and machine learning workloads.
- Design, develop, and maintain ETL/ELT pipelines for batch and real-time data processing.
- Build scalable data pipelines using Apache Spark (PySpark/Scala) and streaming technologies such as Kafka and Flink.
- Develop and optimize cloud-native data architectures on Google Cloud Platform (GCP).
- Build and manage data lakes, data warehouses (BigQuery), and streaming platforms.
- Optimize Spark jobs, SQL queries, and data processing workflows for performance and cost efficiency.
- Implement data quality checks, monitoring, validation, and error-handling mechanisms.
- Integrate data from multiple sources including databases, APIs, messaging systems, and cloud storage.
- Collaborate with data architects, data scientists, and business stakeholders to deliver scalable data solutions.
- Support CI/CD, deployment automation, and production troubleshooting.
- Ensure data security, governance, and compliance with enterprise standards.
Qualifications
- Minimum 8 years of IT experience.
- Minimum 4+ years of recent hands-on experience with Google Cloud Platform (GCP).
- Strong programming skills in Python and SQL.
- Strong expertise in Apache Spark (Spark SQL, DataFrames, PySpark, Spark Streaming).
- Hands-on experience with Apache Kafka, Google Pub/Sub, or other streaming technologies.
- Strong knowledge of BigQuery and GCP data services.
- Strong performance tuning skills for Spark jobs and SQL queries.
- Excellent analytical, troubleshooting, and problem-solving skills.
- Knowledge of Snowflake, Amazon Redshift, or other cloud data warehouses.
- Hands-on experience with Apache Airflow for workflow orchestration.
- Knowledge of Docker and Kubernetes.
- Familiarity with machine learning data pipelines and feature engineering.
- Google Cloud Professional Data Engineer certification is an added advantage.
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or equivalent experience.
Verify Python for this role
Free PRACTICE for Python adds a verified skill signal that can boost how roles like this rank for you — optional, not required to browse or apply.
Sign up — verify Python free →Want match scores and deeper insight? Create a free candidate profile