Browse Jobs
Explore open roles across India.Explore active software roles. Sign up to apply and get AI match scores.
Top MatchesTop Job Matches
Loading jobs…
Back to Browse Jobs
Quest Global
Principal Data Engineer
Quest Global
Pune•On-site•8-11 Yrs•6 days ago
Job description
Overview
- Architect Data based solutions (foundational and analytical data product) based on business need and in line with the Mastercard technology portfolio, patterns and standards.
Qualifications
- Architect Data based solutions (foundational and analytical data product) based on business need and in line with the Mastercard technology portfolio, patterns and standards.
- Collaborate closely with finance, business and technical stakeholders to translate requirements into technical data architecture and solution.
- Handson, with the ability to write / develop complex code and also help the engineering teams.
- Exposure to building Data contracts and Data products.
- Partner with data and engineering teams to build robust data pipelines, data modeling, and ensure seamless integration across diverse systems and domains.
- Facilitate trade-off discussions with both business and technical stakeholders to balance priorities and make informed decisions.
- Ability to choose between different technical options considering all aspects of engineering principles.
- Ensure alignment between business goals and technical execution, making sure features and solutions meet business requirements and customer needs.
- Participate in sprint planning, retrospectives, and other agile ceremonies to ensure the team is aligned and delivering efficiently.
- Drive the adoption of best practices in software engineering, including code reviews, testing, and continuous integration/continuous delivery (CI/CD).
- Optimize the cost/benefit of software features and architecture, ensuring scalability, performance, and operational efficiency.
- Act as leader of Data platform / technology, providing guidance on complex technical challenges and driving resolution, ensuring solutions align with Mastercard’s engineering and data principles, and technical policies.
- Identify opportunities for process improvements, helping to streamline workflows and enhance team productivity.
- Mentor and guide engineers across various experience levels, helping them grow technically and improve their software and data engineering skills.
- Proven experience as data architect and engineer, both on on-prem and cloud-based data platforms (traditional to modern platforms) with a strong focus on delivering large-scale projects in an agile environment.
- Work with the engineering team to help design, develop and implement large scale, high-volume, high-performance, highly available, scalable data platform and pipelines for the Lakehouse being built on on-prem Cloudera Data Platform - CDP. Ability to handle large-scale data processing and distributed computing across massive datasets.
- Must - Hands-on experience with deep understanding and experience with modern Data Platforms – Cloudera Data Platform (CDP).
- Strong hands-on experience with PySpark
- Knowledge of security best practices and experience in ensuring the secure development of applications.
- Knowledge of CI/CD, data engineering best practices
- Understanding of financial data structures, accounting processes, or reconciliation workflows
- Prior experience with financial systems, such as Oracle Financials, Oracle Fusion Cloud, and Hyperion, with experience optimising their integration into broader data ecosystems will be a plus.