Browse Jobs
Explore open roles across India.Explore active software roles. Sign up to apply and get AI match scores.
Top MatchesTop Job Matches
Loading jobs…
Back to Browse Jobs
Leading
Backend Engineer - AI/ML Platform (Senior / Staff-ready) (Mumbai)
Leading
Mumbai•On-site•Salary•6-9 Yrs•Jun 29
Job description
Backend EngineerAI/ML PlatformSenior LevelSystem Design
Overview
Senior-level backend/platform engineer to build and operate ML-backed systems that power large-scale, production-grade AI applications. Role intersects backend engineering with applied machine learning with ownership over system design, runtime orchestration, and end-to-end reliability.
Responsibilities
- Design, build, and operate scalable backend systems that support ML-driven applications in production
- Own runtime orchestration including session and state management, retrieval and memory pipelines such as chunking, embeddings, indexing, vector search, re-ranking, caching, freshness, and deletion
- Productionize ML workflows by defining feature and metadata services, model integration contracts, and ensuring offline and online parity
- Implement evaluation and instrumentation frameworks to continuously measure system and model performance
- Drive system performance, reliability, and cost efficiency across latency, throughput, infrastructure usage, and token economics
- Build observability-first platforms with strong tracing, metrics, logging, guardrails, and fallback mechanisms
- Partner closely with applied ML teams on prompt schemas, tool routing, evaluation datasets, and safe, incremental releases
- Take full ownership of systems from design to deployment, monitoring, and ongoing improvements, shipping independently and responsibly
Qualifications
- 6-10 years of experience in backend or platform engineering, operating at a senior or staff-level scope
- Solid background in building and maintaining distributed, production-grade systems at scale
- Hands-on exposure to ML-adjacent systems such as model serving, retrieval pipelines, orchestration layers, and inference workflows
- Demonstrated ownership of reliability, performance optimization, and cost control in live production environments
- Comfortable working in-office and based in Mumbai or Bangalore, with flexibility for a future location transition
Nice to have
- Experience building greenfield AI platforms
- Working with US enterprise clients
- Already being based in Mumbai