Browse Jobs
Explore open roles across India.Explore active software roles. Sign up to apply and get AI match scores.
Top MatchesTop Job Matches
Loading jobs…
Senior Data Engineer-2
CDW
Hyderabad•On-site•6-9 Yrs•2 days ago
Job description
Overview
We are seeking a Senior / Lead Consultant – Data Engineering with 6–10 years of experience to lead the design and delivery of modern cloud data solutions.
Responsibilities
- Lead the architecture, design, and optimization of enterprise-scale data pipelines and ETL/ELT solutions using Microsoft Fabric, Azure Data Factory (ADF), and PySpark.
- Drive modern data warehousing architecture, dimensional modeling, and end-to-end lifecycle management for analytics platforms.
- Apply advanced SQL engineering for complex transformations, performance tuning, query optimization, and scalable data processing.
- Own platform administration and operational excellence across Azure Portal and Azure data services, including monitoring, cost awareness, reliability, and security.
- Partner with business stakeholders, architects, and cross-functional teams to translate complex requirements into robust data models, integration patterns, and reporting-ready datasets.
- Establish and enforce data governance, security, quality, and metadata management standards aligned with enterprise best practices.
- Provide technical leadership for solution design reviews, implementation guidance, and engineering best practices across the data platform landscape.
- Lead root-cause analysis, resiliency improvements, and performance optimization for cloud-based data pipelines and distributed processing workloads.
- Drive continuous improvement through reusable frameworks, automation, and engineering practices that improve maintainability, supportability, and delivery efficiency.
Qualifications
- 6–10 years of progressive experience in Data Engineering, including ownership of large-scale data platforms, solution design, and technical leadership.
- Deep expertise in advanced SQL, including complex query optimization, performance tuning, data transformations, stored procedures, and troubleshooting at scale.
- Strong hands-on experience with data warehousing architecture, dimensional modeling, partitioning, indexing strategies, and scalable analytical data design.
- Proven expertise in Microsoft Fabric, Azure Data Factory (ADF), and modern ETL/ELT orchestration patterns for enterprise-grade data integration.
- Strong operational knowledge of Azure Portal and Azure data services for environment management, monitoring, security, governance, and cost optimization.
- Hands-on experience with Python and PySpark for distributed data processing, transformation frameworks, and reusable engineering patterns.
- Ability to establish engineering standards, reusable patterns, and delivery best practices for modern data platform implementations.
- Broad experience with cloud data ecosystem components such as Azure Synapse, Azure SQL Database, Azure Storage, and related integration services.
- Strong experience in data modeling, data governance, metadata management, data quality frameworks, and security controls across enterprise environments.
- Strong analytical and decision-making skills, with the ability to navigate complex technical challenges and guide teams toward effective solutions.
Nice to have
- Relevant certifications in Azure Data Engineering (such as DP-203), Microsoft Fabric (such as DP-600 or DP-700), or other advanced cloud data platform certifications.
- Exposure to Power BI, DevOps/CI-CD practices, infrastructure-as-code, or data observability frameworks is an added advantage.
Education
- Bachelor’s degree in Computer Science, Information Technology, or a related field.