Browse Jobs
Explore open roles across India.Explore active software roles. Sign up to apply and get AI match scores.
Top MatchesTop Job Matches
Loading jobs…
Back to Browse Jobs
SteerLean Consulting
Data Engineer IV
SteerLean Consulting
Anywhere•Remote•5-8 Yrs•2 days ago
Job description
Remote
Overview
You will be a crucial contributor to the Digital Risk Office GRC Platforms & Products Group within our Tech Ecosystem and will be responsible for the delivery of capabilities required by the group's stakeholders.
Responsibilities
- You will be a crucial contributor to the Digital Risk Office GRC Platforms & Products Group within our Tech Ecosystem and will be responsible for the delivery of capabilities required by the group's stakeholders. This includes technical architecture, design, development and maintenance of the group's solution portfolio (custom, COTS and SaaS) in adherence with industry best practices.
- You will actively collaborate with team members, product teams in different portfolios and stakeholders alike.
- You will be an active learner: tinkering with new products and services, using unfamiliar technologies, and encouraging continuous research inside
- Design, build, and maintain scalable and efficient data pipelines to move data between cloud-native databases (e.g., Snowflake) and SaaS providers using AWS Glue, Lambda, and Python.
- Implement and manage batch and event based ETL/ELT processes ensuring seamless data integration, transformation, and delivery across systems.
- Ensure adherence to information security, compliance, and data governance standards.
- Maintain and enhance data environments including data lakes, data warehouses, and distributed data systems.
- Utilize GitHub for version control, code collaboration, and CI/CD integration.
- Enhance existing solutions, develop new capabilities, resolve defects, and provide production support for ETL workloads using AWS native services.
- Troubleshoot and resolve production data pipeline issues efficiently; participate in on-call rotations as needed.
- Maintain clear and comprehensive technical documentation for data pipelines and deployment processes.
- Leverage GenAI-powered development tools (e.g., GitHub Copilot, Cursor AI) to accelerate coding, automate test generation, and perform AI-driven code review.
- Strong development experience with Python and PySpark for ETL orchestration.
- Excellent command of AWS Glue, AWS Lambda, and related serverless data services.
Qualifications
- Advanced SQL skills, including optimization and complex query building.
- Hands-on experience with CI/CD pipelines using GitHub Actions.
- Proficiency in Agile methodologies and iterative delivery.
- Strong understanding of non-functional aspects including performance, scalability, and reliability of data systems.
- Well-versed in data governance, compliance, and application security practices.
- Familiarity with observability and monitoring tools (e.g., CloudWatch, Datadog, or equivalent) for production data pipelines.
- Strong communication and interpersonal collaboration skills for stakeholder alignment and teamwork.
- Ability to work independently while contributing effectively to a distributed team.
- Strong analytical skills to interpret complex business processes and translate them into data-driven solutions.
- Comfortable working with global teams across multiple time zones.
- Passion for emerging technologies and staying updated with industry trends.
- Familiarity with Jira, GitHub, and project collaboration tools.
- Demonstrated problem-solving ability with a track record of delivering complex data engineering solutions end-to-end.
- Ownership mindset — takes initiative, drives tasks to completion, and holds themselves accountable for outcomes.
- Effective cross-team collaboration, working with product managers, analysts, QA, and stakeholders to align on goals.
- Awareness of risk management and compliance considerations relevant to enterprise data systems in regulated environments.
- Comfortable navigating ambiguity and adapting to shifting priorities in a fast-paced environment.
- Python / PySpark – 5+ years
- AWS Glue (Crawler, Data Catalog) – 2+ years
- Snowflake (preferred) or similar Data Warehouse – 5+ years
- PL/SQL – 5+ years
- CloudFormation / Terraform – 2+ years
- CI/CD (GitHub Actions) – 2+ years
- AWS Services (S3, SNS, Secrets Manager, Athena, Lambda) – 2+ years
- Business Intelligence Tools (Power BI, Tableau) – 2+ years
- Event-driven Architecture / Streaming – 2+ years
- GenAI Development Tools (GitHub Copilot, AI-assisted testing) – 1+ years
- Observability (CloudWatch, Datadog, or equivalent) – 1+ years
- Jira, GitHub – Familiarity required
- Be part of the Product Group — a high-impact team that builds and operates the data solutions powering risk management, early warning, and service excellence capabilities.
Education
- Bachelor's degree in quantitative field like Computer Science, Engineering, Statistics, Mathematics or related field required. Advanced degree is a strong plus