Sovos
Create a free account
One signup unlocks everything for this job:
- Apply to this job and track your application
- See your personalized profile match score
- Generate an AI cover letter for this role
Computer Hardware Development · 1001 to 5000 Employees · Atlanta, US
Sovos provides businesses with the confidence needed to navigate an increasingly regulated world. Offering a modern, IT driven response to compliance, Sovos’ solutions are scalable, reliable and secure and provide a great user experience. Sovos has more than 100,000 customers, including half the Fortune 500, as well as businesses of every size operating in more than 70 countries. The company’s cloud-based solutions integrate with a wide variety of business applications and government compliance processes. Sovos has employees throughout the Americas and Europe and is owned by Hg and TA Associates.
Hiring: Engineering
What employees say
+ - Smooth onboarding experience that was only one day and not overwhelming - Friendly coworkers - Fully remote! - Accessible teammates and leadership despite varied time zones - Unl
− - Pay seems lower than industry standard
More reviews on the company profile.
Interview experience · Software Engineer
There were multiple rounds. If I had any problem, I reached out to the HR and they were kind and quick in their replies. It took a few months, but understandable because of the volume they must be receiving.
Very_difficult difficulty · Mumbai · 2 reports
More interview insightsJob description
Overview
Build your future with Sovos.
Responsibilities
- Gate new AI agents, prompts, and models before production release
- Design and run evaluation frameworks using deterministic testing and LLM-as-a-Judge methodologies
- Build and maintain golden datasets, annotation pipelines, and human-review workflows
- Monitor AI quality, hallucinations, drift, latency, cost, and safety metrics
- Convert customer feedback and production learnings into measurable quality improvements
- Drive AI adoption and quality standards across your assigned product portfolio
Qualifications
- Experience with Langfuse, LangSmith, Phoenix, or similar LLM observability/evaluation platforms
- Strong understanding of LLMOps, AI quality engineering, and evaluation frameworks
- Experience with hallucination detection, model drift monitoring, prompt regression management, and AI safety evaluations
- Hands-on experience building evaluation datasets, quality benchmarks, and feedback loops
- Familiarity with NLP concepts such as embeddings, semantic similarity, classification, and retrieval
- Strong product mindset and stakeholder management skills
- Applied AI Engineers from AI-native or AI-first organizations
- Product-minded Engineers with strong customer and business awareness
- QA/Test Automation Engineers who have transitioned into AI evaluation
- AI Quality Analysts with expertise in hallucination detection, drift monitoring, and LLM-as-a-Judge frameworks
- Work on cutting-edge Generative AI products
- Global, remote-first collaboration with AI, Product, and Engineering leaders
- Bi-Weekly Meeting Free Days
- Mentoring and career development programs
- Globally recognized training opportunities
- Comprehensive health and wellness benefits
- Opportunity to shape AI experiences used by customers around the world
- CCAT & EPP Assessment
- Automated Video Interview
- Hiring Manager / Team Interview
- Final Interview
Verify Engineering for this role
Free PRACTICE for Engineering adds a verified skill signal that can boost how roles like this rank for you — optional, not required to browse or apply.
Sign up — verify Engineering free →Want match scores and deeper insight? Create a free candidate profile
Job application FAQ
Last updated 13 October 2026
- How do I apply for AI Ops Engineer at Sovos?
- Open this job on Feedback AI and sign up free (or sign in). You can apply from the job detail page; match scores and skill gaps appear when your profile is complete. Sovos may attach structured assessments to interview rounds after you apply.
- Does Feedback AI show a match score for this AI Ops Engineer role?
- Yes after you add a resume or skills. Match score ranks this role against your profile — skills met, gaps, level, and location — so you prioritise applications where fit is strongest.
- Is AI Ops Engineer remote or on-site in Navi Mumbai, Maharashtra?
- This listing is marked remote with location Navi Mumbai, Maharashtra. Confirm details on the job description before applying.
- What skills matter for this AI Ops Engineer role at Sovos?
- This is a mid-level AI Ops Engineer role. Key skills include Remote. Feedback AI highlights matched vs missing skills on your profile after signup.