Browse Jobs
Explore open roles across India.Explore active software roles. Sign up to apply and get AI match scores.
Top MatchesTop Job Matches
Loading jobs…
Back to Browse Jobs
Zorba AI
PySpark Data Engineer
Zorba AI
New Delhi•On-site•Salary•1-3 Yrs•Jun 29
Job description
Overview
Role: PySpark Data Engineer
Responsibilities
- Design, develop, and optimize scalable data pipelines using PySparkProcess and analyze large-scale structured and unstructured datasets
- Develop ETL/ELT workflows on Big Data platforms
- Work on Spark performance tuning and debugging
- Integrate AWS cloud services within data engineering solutions
- Collaborate with cross-functional teams for data integration and analytics initiatives
- Ensure data quality, reliability, and performance across pipelines
- Design, develop, and optimize scalable data pipelines using PySparkProcess and analyze large-scale structured and unstructured datasets
- Develop ETL/ELT workflows on Big Data platforms
- Work on Spark performance tuning and debugging
- Integrate AWS cloud services within data engineering solutions
- Collaborate with cross-functional teams for data integration and analytics initiatives
- Ensure data quality, reliability, and performance across pipelines
Qualifications
- Locations: Chennai, Bangalore, Hyderabad, Delhi, Pune
- Open Positions: 10
- Required Technical Skills
- Strong experience in Python and PySparkHands-on experience with Big Data technologiesExpertise in Hadoop ecosystem components such as Hive and ImpalaStrong SQL knowledge including Joins, Subqueries, and CTEsExperience with Spark optimization, debugging, and Spark UI analysisGood Python scripting and automation skillsExposure to database technologiesHands-on AWS cloud experience with:EMRS3IAMLambdaSNSSQSRedshift
- PySparkPythonBig Data/Hadoop ecosystemHive / ImpalaSQLAWS EMR & S3
- Good-to-Have Skills
- ScalaSpark UI optimization techniquesAWS Lambda, SNS, SQS, IAMRedshiftStrong debugging and scripting skills
- Skills: aws,pyspark,big data Role: PySpark Data Engineer
- Locations: Chennai, Bangalore, Hyderabad, Delhi, Pune
- Open Positions: 10
- Required Technical Skills
- Strong experience in Python and PySparkHands-on experience with Big Data technologiesExpertise in Hadoop ecosystem components such as Hive and ImpalaStrong SQL knowledge including Joins, Subqueries, and CTEsExperience with Spark optimization, debugging, and Spark UI analysisGood Python scripting and automation skillsExposure to database technologiesHands-on AWS cloud experience with:EMRS3IAMLambdaSNSSQSRedshift
- PySparkPythonBig Data/Hadoop ecosystemHive / ImpalaSQLAWS EMR & S3
- Good-to-Have Skills
- ScalaSpark UI optimization techniquesAWS Lambda, SNS, SQS, IAMRedshiftStrong debugging and scripting skills
- Skills: aws,pyspark,big data