Browse Jobs
Explore open roles across India.Explore active software roles. Sign up to apply and get AI match scores.
Top MatchesTop Job Matches
Loading jobs…
Back to Browse Jobs
Amgen
Principal Data Engineer
Amgen
Hyderabad•On-site•12+ Yrs•Jul 6
Job description
Overview
Let’s do this. Let’s change the world. We are looking for highly motivated expert Principal Data Engineer who can own the design & development of complex data pipelines, solutions and frameworks for R&D domain. The ideal candidate will be responsible to design, develop, and optimize data pipelines, data integration frameworks, and metadata-driven architectures that enable seaml
Responsibilities
- Architect and maintain robust, scalable data pipelines using Databricks, Spark, and Delta Lake, enabling efficient batch and real-time processing.
- Lead efforts to evaluate, adopt, and integrate emerging technologies and tools that enhance productivity, scalability, and data delivery capabilities.
- Drive performance optimization efforts, including Spark tuning, resource utilization, job scheduling, and query improvements.
- Identify and implement innovative solutions that streamline data ingestion, transformation, lineage tracking, and platform observability.
- Build frameworks for metadata-driven data engineering, enabling reusability and consistency across pipelines.
- Foster a culture of technical excellence, experimentation, and continuous improvement within the data engineering team.
- Collaborate with platform, architecture, analytics, and governance teams to align platform enhancements with enterprise data strategy.
- Define and uphold SLOs, monitoring standards, and data quality KPIs for production pipelines and infrastructure.
- Partner with cross-functional teams to translate business needs into scalable, governed data products.
- Mentor engineers across the team, promoting knowledge sharing and adoption of modern engineering patterns and tools.
- Collaborate with cross-functional teams, including data architects, business analysts, and DevOps teams, to align data engineering strategies with enterprise goals.
- Stay up to date with emerging data technologies and best practices, ensuring continuous improvement of Enterprise Data Fabric architectures.
Qualifications
- Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies.
- Proficiency in workflow orchestration, performance tuning on big data processing.
- Strong understanding of AWS services
- Ability to quickly learn, adapt and apply new technologies
- Strong problem-solving and analytical skills
- Excellent communication and teamwork skills
- Good to have deep expertise in Biotech & Pharma industries
Education
- 12 to 15 years of experience in Computer Science, IT or related field
- AWS Certified Data Engineer preferred
- Databricks Certificate preferred
- Scaled Agile SAFe certification preferred
- Excellent analytical and troubleshooting skills.
- Strong verbal and written communication skills
- Ability to work effectively with global, virtual teams
- High degree of initiative and self-motivation.
- Ability to manage multiple priorities successfully.
- Team-oriented, with a focus on achieving team goals.
- Ability to learn quickly, be organized and detail oriented.
- Strong presentation and public speaking skills.