Oolka
Create a free account
One signup unlocks everything for this job:
- See your personalized profile match score
- See the skills this role is missing for you
- Apply to this job and track your application
- Generate an AI cover letter for this role
Bengaluru · On-site · 5-8 Yrs · Oct 30
Hiring: Engineering
Job description
Overview
Design and implement asynchronous multi-agent orchestration.Own end-to-end latency from user message to AI response.Build resilient inference pipelines that gracefully degrade under load.Implement intelligent request routing and load balancing for AI workloads.Migrate critical AI conversation flow from monolith to dedicated services.Implement WebSocket/streaming infrastructure
Responsibilities
- Design and implement asynchronous multi-agent orchestration.Own end-to-end latency from user message to AI response.
- Build resilient inference pipelines that gracefully degrade under load.
- Implement intelligent request routing and load balancing for AI workloads.Migrate critical AI conversation flow from monolith to dedicated services.
- Implement WebSocket/streaming infrastructure for real-time chat.
- Design circuit breakers and fallback strategies for AI model failures.
- Build comprehensive observability for AI system performance.
- Optimize credit data retrieval and caching strategies
Qualifications
- Hands-on experience scaling ML/AI inference in production.Deep understanding of caching strategies (Redis, in-memory, CDN).
- Experience with message queues and real-time communication protocols AI-Specific.
- Experience with AI model serving frameworks (TensorFlow Serving, Triton, etc. ).Understanding of AI inference optimization (batching, caching, model quantization).
- Knowledge of conversation state management and context handling.Has debugged production issues under high AI inference load.
- 6+ years building production systems handling > 10k concurrent users.Proven experience with async/event-driven architectures (not just REST APIs).
Verify Engineering for this role
Free PRACTICE for Engineering adds a verified skill signal that can boost how roles like this rank for you — optional, not required to browse or apply.
Sign up — verify Engineering free →Want match scores and deeper insight? Create a free candidate profile
Job application FAQ
Last updated 3 November 2026
- How do I apply for Lead AI / ML Engineer at Oolka?
- Open this job on Feedback AI and sign up free (or sign in). You can apply from the job detail page; match scores and skill gaps appear when your profile is complete. Oolka may attach structured assessments to interview rounds after you apply.
- Does Feedback AI show a match score for this Lead AI / ML Engineer role?
- Yes after you add a resume or skills. Match score ranks this role against your profile — skills met, gaps, level, and location — so you prioritise applications where fit is strongest.
- Is Lead AI / ML Engineer remote or on-site in Bengaluru, Karnataka?
- This listing is marked on_site with location Bengaluru, Karnataka. Confirm details on the job description before applying.
- What skills matter for this Lead AI / ML Engineer role at Oolka?
- This is a lead Lead AI / ML Engineer role. Key skills include skills listed in the job description. Feedback AI highlights matched vs missing skills on your profile after signup.