DATAECONOMY
Create a free account
One signup unlocks everything for this job:
- Apply to this job and track your application
- See your personalized profile match score
- Generate an AI cover letter for this role
Hyderabad · Hybrid · ₹7 LPA · 9-12 Yrs · Just now
Information Technology Support Services · 201 to 500 Employees · Dublin, US
Hiring: Engineering
What employees say
+ Positive work culture , flexible hours, work life balance, best company to start career
− Didn't find any cons uptil now
More reviews on the company profile.
Interview experience · Software Engineer Trainee
test, technical round 1, technical round 2, hr round , results take 3-7 days , single day process for most of the part in-office. 2yrs service bond was there, it will be on site work for most of the part hybrid for emer
Average difficulty · Pune · 16 reports
More interview insightsJob description
Overview
Job Title: Lead AWS PySpark Engineer
Responsibilities
- Design, build, and maintain scalable data pipelines using PySpark on AWS.
- Lead the development of ETL/ELT workflows for processing large volumes of structured and unstructured data.
- Architect and optimize data solutions using AWS services such as S3, Glue, Athena.
- Collaborate with data scientists, analysts, and product teams to deliver high-quality data solutions.
- Implement data quality checks, monitoring, and performance optimization for big data pipelines.
- Lead code reviews, enforce best practices, and mentor junior engineers.
- Work closely with DevOps teams to implement CI/CD pipelines and automated deployments.
- Ensure compliance with data governance, security, and best practices.
Qualifications
- Job Overview
- We are seeking a highly skilled Lead AWS PySpark Engineer to design, develop, and optimize large-scale data processing pipelines on AWS. The ideal candidate will have strong experience in PySpark, distributed data processing, and AWS data services, along with the ability to lead technical initiatives and mentor data engineers.
- 9+ years of experience in Data Engineering / Big Data Development.
- Strong expertise in PySpark and Apache Spark.
- Hands-on experience with AWS ecosystem (S3, Glue, EMR, Lambda, Redshift, Athena).
- Proficiency in Python and SQL.
- Strong knowledge of distributed computing and big data processing.
- Familiarity with CI/CD tools, Git, and Agile development practices.
Benefits
- Comprehensive Medical Coverage:
- Robust Protection Plans:
- Retirement Benefits:
- Flexible Work Options:
- Generous Leave Policy:
- Employee Well-being Spaces:
Verify Python for this role
Free PRACTICE for Python adds a verified skill signal that can boost how roles like this rank for you — optional, not required to browse or apply.
Sign up — verify Python free →Want match scores and deeper insight? Create a free candidate profile
Job application FAQ
Last updated 21 September 2026
- How do I apply for Lead AWS Pyspark Data Engineer at DATAECONOMY?
- Open this job on Feedback AI and sign up free (or sign in). You can apply from the job detail page; match scores and skill gaps appear when your profile is complete. DATAECONOMY may attach structured assessments to interview rounds after you apply.
- Does Feedback AI show a match score for this Lead AWS Pyspark Data Engineer role?
- Yes after you add a resume or skills. Match score ranks this role against your profile — skills met, gaps, level, and location — so you prioritise applications where fit is strongest.
- Is Lead AWS Pyspark Data Engineer remote or on-site in Hyderabad, Telangana?
- This listing is marked hybrid with location Hyderabad, Telangana. Confirm details on the job description before applying.
- What skills matter for this Lead AWS Pyspark Data Engineer role at DATAECONOMY?
- This is a lead Lead AWS Pyspark Data Engineer role. Key skills include Hybrid. Feedback AI highlights matched vs missing skills on your profile after signup.