Create a free account
One signup unlocks everything for this job:
- See your personalized profile match score
- See the skills this role is missing for you
- Apply to this job and track your application
- Generate an AI cover letter for this role
Kolkata · On-site · 1-3 Yrs · Oct 17
2 views
62 open roles1 posted in 7d62 in 30d
Hiring: Engineering
Job description
Responsibilities
- Define and operationalize evaluation strategies for GenAI systems across use cases like Q&A assistants, summarization, extraction, drafting, agentic systems, and multi-step workflows. Translate business use-cases into a structured evaluation plan: scope, assumptions, success criteria, datasets, metrics, red-team scenarios, thresholds, and reporting requirements.
- Drive standardization: reusable evaluation templates, test case libraries, scoring rubrics, and reporting formats across product teams.
Verify Python for this role
Free PRACTICE for Python adds a verified skill signal that can boost how roles like this rank for you — optional, not required to browse or apply.
Sign up — verify Python free →Want match scores and deeper insight? Create a free candidate profile
Job application FAQ
Last updated 20 October 2026
- How do I apply for Agentic AI Evaluation Engineer at EY?
- Open this job on Feedback AI and sign up free (or sign in). You can apply from the job detail page; match scores and skill gaps appear when your profile is complete. EY may attach structured assessments to interview rounds after you apply.
- Does Feedback AI show a match score for this Agentic AI Evaluation Engineer role?
- Yes after you add a resume or skills. Match score ranks this role against your profile — skills met, gaps, level, and location — so you prioritise applications where fit is strongest.
- Is Agentic AI Evaluation Engineer remote or on-site in Kolkata, West Bengal?
- This listing is marked on_site with location Kolkata, West Bengal. Confirm details on the job description before applying.
- What skills matter for this Agentic AI Evaluation Engineer role at EY?
- This is a mid-level Agentic AI Evaluation Engineer role. Key skills include skills listed in the job description. Feedback AI highlights matched vs missing skills on your profile after signup.