Back to Browse Jobs
The Ops Layer
Create a free account
One signup unlocks everything for this job:
- See your personalized profile match score
- See the skills this role is missing for you
- Apply to this job and track your application
- Generate an AI cover letter for this role
Mumbai · On-site · 3-5 Yrs · Oct 8
2 views
1 open role0 posted in 7d1 in 30d
Hiring: Engineering
Job description
Overview
The Ops Layer is building HELIOS, an AI-powered operational intelligence platform that transforms organizational questionnaire responses into structured, evidence-grounded decision intelligence.
Responsibilities
- Review and assess the existing AI processing architecture and Python backend.
- Improve extraction and interpretation of source-grounded organizational claims.
- Develop reliable recurring-decision identification and semantic consolidation.
- Distinguish operational decisions from activities, recommendations, inputs, prerequisites, and authority statements.
- Preserve decision ownership, approval boundaries, conditions, numerical thresholds, and exception paths.
- Prevent hallucinated decisions, unsupported authority assignments, and incorrect organizational diagnoses.
- Implement evidence-validation mechanisms and source-level traceability.
- Build automated LLM evaluation, regression testing, and quality assurance frameworks.
- Optimize pipeline performance, reliability, and deployment stability.
- Maintain clear technical documentation and reproducible development environments.
- Strong Python backend engineering, preferably FastAPI and SQLAlchemy.
- Hands-on experience developing and deploying LLM-powered applications.
Qualifications
- Structured extraction, JSON schemas, function calling, and output validation.
- Semantic classification, entity resolution, and information normalization.
- Multi-stage AI workflows and reasoning pipelines.
- LLM evaluation frameworks, gold-standard datasets, and regression testing.
- Ability to investigate complex semantic failures systematically.
- Strongly Preferred
- Document intelligence, enterprise AI, or decision-support systems.
- Evidence-grounded generation and hallucination mitigation.
- Human-in-the-loop review architectures.
- Model benchmarking, automated evaluation, and deterministic validation.
- Correctly identify recurring organizational decisions from multiple respondents.
- Consolidate semantically equivalent decisions without merging distinct authority scopes.
- Preserve decision-specific inputs, conditions, thresholds, and dependencies.
- Distinguish formal authority, actual practice, exceptions, and unresolved information.
- Ensure every published interpretation is supported by traceable evidence.
- Produce consistent, independently verifiable results across diverse organizational scenarios.
- Relevant AI/LLM projects you have built.
- Your specific technical contributions.
- GitHub repositories or technical work samples, where available.
- Availability and indicative contract rates.
- Apply: vishnu@theopslayer.com
Verify Python for this role
Free PRACTICE for Python adds a verified skill signal that can boost how roles like this rank for you — optional, not required to browse or apply.
Sign up — verify Python free →Want match scores and deeper insight? Create a free candidate profile
Job application FAQ
Last updated 20 October 2026
- How do I apply for Senior Applied AI Engineer — LLM Reasoning & Evaluation at The Ops Layer?
- Open this job on Feedback AI and sign up free (or sign in). You can apply from the job detail page; match scores and skill gaps appear when your profile is complete. The Ops Layer may attach structured assessments to interview rounds after you apply.
- Does Feedback AI show a match score for this Senior Applied AI Engineer — LLM Reasoning & Evaluation role?
- Yes after you add a resume or skills. Match score ranks this role against your profile — skills met, gaps, level, and location — so you prioritise applications where fit is strongest.
- Is Senior Applied AI Engineer — LLM Reasoning & Evaluation remote or on-site in Mumbai, Maharashtra?
- This listing is marked on_site with location Mumbai, Maharashtra. Confirm details on the job description before applying.
- What skills matter for this Senior Applied AI Engineer — LLM Reasoning & Evaluation role at The Ops Layer?
- This is a senior Senior Applied AI Engineer — LLM Reasoning & Evaluation role. Key skills include skills listed in the job description. Feedback AI highlights matched vs missing skills on your profile after signup.