Browse Jobs
Explore open roles across India.Explore active software roles. Sign up to apply and get AI match scores.
Top MatchesTop Job Matches
Loading jobs…
Back to Browse Jobs
Cencora
Internal Audit - Data Engineer III
Cencora
Pune•On-site•3-6 Yrs•3 days ago
Job description
Overview
The Internal Audit Data Analytics team is seeking experienced Data Engineer to support the build‑out and ongoing enhancement of Internal Audit’s Databricks-based analytics environment.
Qualifications
- Bachelor’s or Masters degree in Computer Science, Data Engineering, Information Systems, Analytics, or related discipline; equivalent
- Minimum 3–5 years of relevant experience required; 5–7 years preferred including 2-4 years of hands-on Data Engineering experience with Databricks.
- Build and manage scalable ETL/ELT pipelines integrating data from SAP ECC or SAP S/4HANA.
- Deep expertise working with Databricks, including cluster design, notebook development, Spark optimization, Delta Lake, Delta Live Tables, Unity Catalog (Centralized permissions, Data lineage, Table & schema access controls), and data governance/access controls.
- Strong proficiency in Python, PySpark/Spark, and SQL; understanding of Spark architecture: Driver, Executors, Stages, Tasks and Shuffle, portioning, caching. Performance tuning and optimization on large datasets.
- Hands-on experience with Azure (preferred), Amazon Web Services (AWS), or Google Cloud Platform (GCP) cloud services.
- Solid understanding of data warehousing/Lake house concepts, Delta Lake (Delta Lake table design, ACID transactions, schema enforcement & evolution, time travel, handling late arriving data) and medallion architecture.
- Prior experience developing semantic models for analytics consumption.
- Strong experience with data quality frameworks, validation routines, and monitoring strategies.
- Databricks Data Engineer Professional or Associate Certification is preferred.
- Azure Data Engineer Associate (DP‑203) Certification is preferred