Back to Browse Jobs
Vergil Remnant
Create a free account
One signup unlocks everything for this job:
- See your personalized profile match score
- See the skills this role is missing for you
- Apply to this job and track your application
- Generate an AI cover letter for this role
Chennai · On-site · 4-7 Yrs · Oct 21
1 open role1 posted in 7d1 in 30d
Hiring: Engineering
Job description
Overview
Vergil Remnant is actively seeking an experienced, high‑caliber, and technical Python PySpark Data Engineer with 4 to 6 years of progressive professional experience in big data engineering, ETL pipeline development, and cloud analytics to join our client engineering team on a full‑time permanent on‑site basis in Chennai, India.
Responsibilities
- Design, develop, test, optimize, and maintain scalable data pipelines and automated ETL/ELT integration workflows.
- Author robust, high‑performance data processing scripts utilizing Python, PySpark, Pandas, and NumX.
- Build, maintain, and optimize distributed big data analytics clusters and data pipelines utilizing Azure Databricks.
- Administer, secure, and optimize cloud storage, data lakes, and compute resources across Azure Data Lake Storage and Azure cloud services.
- Implement DevOps practices, version control workflows, and automated deployment pipelines for data applications.
- Conduct rigorous data analysis, debugging, performance optimization, and query tuning across large‑scale distributed datasets.
- Collaborate seamlessly with cross‑functional software engineering, data science, and business analytics squads.
- Maintain accurate, comprehensive technical documentation of data schemas, pipeline architectures, and operational runbooks.
Qualifications
- Bachelor’s or Master’s degree in Computer Science, Information Technology, Software Engineering, or a related technical discipline.
- Minimum of 4 to 6 years of progressive professional experience in software engineering, data engineering, and big data analytics.
- Strong, demonstrable hands‑on professional expertise in Python programming and data structure manipulation.
- Comprehensive working knowledge and practical proficiency in PySpark, Pandas, NumX, and distributed computing frameworks.
- Deep practical experience in SQL querying, relational database design, and end‑to‑end ETL pipeline development.
- Solid practical experience provisioning, configuring, and managing Azure Databricks and Azure Data Lake Storage (ADLS).
- Exceptional analytical, troubleshooting, debugging, and problem‑solving capabilities under high‑pressure conditions.
- Mandatory legal work eligibility, immediate joining availability, and physical availability for a mandatory face‑to‑face interview in Chennai.
- Professional certifications such as Microsoft Certified: Azure Data Engineer Associate (DP‑203) or Databricks Certified Data Engineer.
- Prior professional working experience in top‑tier technology consulting firms, multinational corporations, or enterprise data organizations.
- Hands‑on familiarity with modern data stack orchestration tools (Apache Airflow, dbt, Azure Data Factory) and containerization (Docker, Kubernetes).
- Experience integrating enterprise data warehouses (Snowflake, Azure Synapse, BigQuery) into centralized analytics platforms.
- Exposure to streaming data architectures (Kafka, Event Hubs) and machine learning feature engineering pipelines.
Verify Python for this role
Free PRACTICE for Python adds a verified skill signal that can boost how roles like this rank for you — optional, not required to browse or apply.
Sign up — verify Python free →Want match scores and deeper insight? Create a free candidate profile
Job application FAQ
Last updated 27 October 2026
- How do I apply for Python PySpark Data Engineer | Vergil Remnant | Chennai at Vergil Remnant?
- Open this job on Feedback AI and sign up free (or sign in). You can apply from the job detail page; match scores and skill gaps appear when your profile is complete. Vergil Remnant may attach structured assessments to interview rounds after you apply.
- Does Feedback AI show a match score for this Python PySpark Data Engineer | Vergil Remnant | Chennai role?
- Yes after you add a resume or skills. Match score ranks this role against your profile — skills met, gaps, level, and location — so you prioritise applications where fit is strongest.
- Is Python PySpark Data Engineer | Vergil Remnant | Chennai remote or on-site in Chennai, Tamil Nadu?
- This listing is marked on_site with location Chennai, Tamil Nadu. Confirm details on the job description before applying.
- What skills matter for this Python PySpark Data Engineer | Vergil Remnant | Chennai role at Vergil Remnant?
- This is a mid-level Python PySpark Data Engineer | Vergil Remnant | Chennai role. Key skills include skills listed in the job description. Feedback AI highlights matched vs missing skills on your profile after signup.