Overview

As a Senior Data Engineer (Technical Lead), you will lead a team of Data Engineers responsible for delivering enterprise data solutions.

Responsibilities

• Lead, mentor, and manage a team of 5 to 8 Data Engineers.
• Provide technical guidance throughout the software development lifecycle.
• Conduct design reviews, code reviews, and solution reviews.
• Establish and enforce development standards, coding best practices, and quality controls.
• Support team members in resolving complex technical and production issues.
• Design, develop, and support enterprise‑scale data engineering solutions using Python and Microsoft SQL.
• Develop and maintain ETL/ELT processes for data ingestion, transformation, and validation.
• Build scalable and maintainable data pipelines for reporting, analytics, and operations.
• Develop reusable frameworks and utilities to improve efficiency and maintainability.
• Design and implement data quality frameworks and controls.
• Establish automated validation, reconciliation, completeness, and accuracy checks.
• Investigate and resolve data quality issues through root cause analysis.
• Continuously improve data reliability and governance practices.
• Analyse and optimise complex SQL queries, stored procedures, and database objects.
• Perform execution plan analysis, indexing reviews, and query optimisation.
• Troubleshoot production performance issues and implement improvements.
• Ensure database solutions are scalable, stable, and efficient.
• Implement and manage source code repositories using Git.
• Drive DevOps best practices across the lifecycle.
• Manage branching strategies and CI/CD deployment pipelines.
• Support release management and change implementation processes.
• Ensure deployments follow governance, quality, and security standards.
• Prepare and maintain technical documentation including specifications, mapping documents, deployment guides, and runbooks.
• Ensure documentation is complete and accurate throughout the project lifecycle.
• Support audit, compliance, and governance requirements.
• Work closely with Business Analysts, Architects, Project Managers, QA teams, and stakeholders.
• Participate in project planning, estimation, and resource allocation.
• Manage technical risks, dependencies, and delivery challenges.
• Provide regular status updates and recommendations to management.
• Actively participate in development activities when required.

Qualifications

• You hold a bachelor's degree in Computer Science, IT, Engineering, or related discipline.
• You have 10–12 years of IT experience in Data Engineering and Application Development.
• You have at least 4 years of experience leading technical teams.
• You have delivered enterprise‑scale data engineering solutions.
• You have strong experience designing and implementing Data Engineering solutions.
• You have extensive experience developing ETL/ELT processes and integration frameworks.
• You are proficient in Python for data transformation, automation, and workflow development.
• You have advanced SQL and T‑SQL programming expertise.
• You are skilled in stored procedures, views, functions, query optimisation, indexing, and database design.
• You have experience implementing data quality controls and monitoring frameworks.
• You are experienced with Git‑based source control and branching strategies.
• You have implemented CI/CD deployment processes and release management practices.
• You demonstrate strong leadership and mentoring skills.
• You collaborate effectively with cross‑functional teams and stakeholders.
• You communicate clearly and provide structured technical guidance.
• You thrive in hands‑on problem solving and delivery under pressure.