Create a free account
One signup unlocks everything for this job:
- See your personalized profile match score
- See the skills this role is missing for you
- Apply to this job and track your application
- Generate an AI cover letter for this role
Visakhapatnam · On-site · 4-7 Yrs · Oct 1
2 views
12 open roles1 posted in 7d12 in 30d
Hiring: Engineering
Job description
Overview
Role Purpose Build and operate the data pipelines that feed the Entity Hub.
Responsibilities
- Role Purpose
- Build and operate the data pipelines that feed the Entity Hub. This role lands all six in-scope sources into Fabric, implements standardization and transformation logic, and maintains the data quality checks and monitoring that the entity resolution engine depends on. Reliable, observable ingestion is the foundation the entire programme rests on.
- Ingestion development — build and maintain pipelines to land the six in-scope sources (Secretary of State, D&B;, ARROW, E1, hCue, DocCentral) into the Fabric Bronze/raw layer.
- Mirroring & CDC — implement Fabric Mirroring for supported structured sources and establish change-data-capture patterns; implement watermark/incremental load logic where mirroring is unavailable.
- Raw layer management — maintain one Delta table per source on an append-only basis, retaining evidence records and full source provenance.
- Standardization & transformation — implement name normalization, address parsing and attribute standardization logic in Spark notebooks; support identifier-spine construction.
- Data quality — implement data quality checks, validation rules, threshold alerts and exception handling; support reconciliation against source.
- Pipeline operations — schedule, monitor and troubleshoot pipeline runs; investigate failures and performance issues; maintain run documentation.
- Performance tuning — optimise Spark jobs, Delta file sizes, partitioning and pipeline efficiency to manage Fabric capacity consumption.
- Documentation — produce and maintain source-to-target mappings, transformation logic documentation and lineage records.
- 4+ years hands-on data engineering with solid PySpark and SQL
- Production experience building ingestion pipelines from multiple heterogeneous sources
- Working knowledge of Delta Lake and medallion/lakehouse architecture
- Experience implementing incremental loads and CDC-style processing
- Experience implementing data q
Verify SQL for this role
Free PRACTICE for SQL adds a verified skill signal that can boost how roles like this rank for you — optional, not required to browse or apply.
Sign up — verify SQL free →Want match scores and deeper insight? Create a free candidate profile
Job application FAQ
Last updated 27 October 2026
- How do I apply for Data Engineering Fabric (Visakhapatnam) at EXL?
- Open this job on Feedback AI and sign up free (or sign in). You can apply from the job detail page; match scores and skill gaps appear when your profile is complete. EXL may attach structured assessments to interview rounds after you apply.
- Does Feedback AI show a match score for this Data Engineering Fabric (Visakhapatnam) role?
- Yes after you add a resume or skills. Match score ranks this role against your profile — skills met, gaps, level, and location — so you prioritise applications where fit is strongest.
- Is Data Engineering Fabric (Visakhapatnam) remote or on-site in Visakhapatnam, Andhra Pradesh?
- This listing is marked on_site with location Visakhapatnam, Andhra Pradesh. Confirm details on the job description before applying.
- What skills matter for this Data Engineering Fabric (Visakhapatnam) role at EXL?
- Key skills for this role include skills listed in the job description. Upload a resume to see which requirements you already meet and which are gaps.