Create a free account
One signup unlocks everything for this job:
- See your personalized profile match score
- See the skills this role is missing for you
- Apply to this job and track your application
- Generate an AI cover letter for this role
Gurugram · On-site · 8-11 Yrs · Oct 8
1 views
12 open roles1 posted in 7d12 in 30d
Hiring: Engineering
Job description
Overview
We are looking for an accomplished Lead Data Engineer to drive the architectural design, development, and optimization of our enterprise-scale data ecosystem.
Responsibilities
- Lead the design and implementation of scalable data architectures on Azure, leveraging Databricks, Delta Lake, and related Azure data services.
- Build and optimize high‑volume ETL/ELT pipelines using PySpark, SQL, Databricks Workflows, and Delta Live Tables.
- Define and enforce best practices for data engineering across notebooks, jobs, CI/CD, Unity Catalog, security, and workspace governance.
- Integrate and orchestrate data pipelines using Azure Data Factory, Azure Synapse pipelines, or Azure Databricks Workflows.
- Drive performance tuning for Spark jobs, cluster configurations, and data storage layers to balance speed and cost efficiency.
- Implement robust data quality and validation frameworks using tools like Great Expectations, DLT expectations, or custom PySpark checks.
- Ensure compliance, governance, and lineage tracking through Unity Catalog, Purview integration, and RBAC/ABAC policies.
- Architect end‑to‑end data solutions supporting analytics, ML, actuarial models, and business-critical reporting workloads.
- Evaluate new Databricks features, MLflow enhancements, Photon execution, serverless compute, and recommend adoption strategies.
- Familiar with working on Agile methodologies - scrum, sprint planning, backlog refinement etc.
Qualifications
- 8-12 years experience on Data Engineering role working with Databricks & Azure Cloud technologies.
- Bachelor’s degree in computer science, Information Technology, or related field.
- Strong proficiency in PySpark, Python, SQL.
- Strong experience in data modeling, ETL/ELT pipeline development, and automation
- Hands-on experience with performance tuning of data pipelines and workflows
- Proficient in working on Azure cloud components Azure Data Factory, Azure DataBricks, Azure Data Lake etc.
- Preferred - Knowledge of the insurance industry and its data requirements.
- Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.
- Excellent communication and problem-solving skills to work effectively with diverse teams
- Excellent problem-solving skills and ability to work under tight deadlines.
Verify Python for this role
Free PRACTICE for Python adds a verified skill signal that can boost how roles like this rank for you — optional, not required to browse or apply.
Sign up — verify Python free →Want match scores and deeper insight? Create a free candidate profile
Job application FAQ
Last updated 9 October 2026
- How do I apply for Lead Cloud Data Engineer at EXL?
- Open this job on Feedback AI and sign up free (or sign in). You can apply from the job detail page; match scores and skill gaps appear when your profile is complete. EXL may attach structured assessments to interview rounds after you apply.
- Does Feedback AI show a match score for this Lead Cloud Data Engineer role?
- Yes after you add a resume or skills. Match score ranks this role against your profile — skills met, gaps, level, and location — so you prioritise applications where fit is strongest.
- Is Lead Cloud Data Engineer remote or on-site in Gurugram, Haryana?
- This listing is marked on_site with location Gurugram, Haryana. Confirm details on the job description before applying.
- What skills matter for this Lead Cloud Data Engineer role at EXL?
- This is a lead Lead Cloud Data Engineer role. Key skills include skills listed in the job description. Feedback AI highlights matched vs missing skills on your profile after signup.