Overview

LLM/AI Model Engineer – Training, Evaluation & Benchmarking

Responsibilities

• You will work closely with the Head of AI, Research Partners and engineering teams to implement and operationalize LLM training approaches and build a reliable model improvement lifecycle:
• Data Preparation → Training → Evaluation → Benchmarking → Error Analysis → Model Improvement
• The role combines hands-on LLM fine-tuning, dataset engineering, tokenization, evaluation framework development and model quality management.
• LLM Training & Fine-tuning
• Training Data & Tokenization
• Golden Dataset & Model Evaluation
• Benchmarking & Error Analysis
• Model Quality & Release

Qualifications

• Industry: Enterprise AI / Generative AI / Machine Learning / NLP
• About QubeLabs
• QubeLabs is building the next generation of Enterprise AI Systems that transform workforce operations and intelligence for the financial services industry.
• Our platform combines Conversational AI, Agentic AI, workflow automation, proprietary language models and enterprise intelligence. Our flagship product, QubeLabs Workmate, serves banks, NBFCs, MFIs, wealth management firms, insurance companies and fintechs across India and Europe.
• At the core of our AI platform is the Vectro Series, our proprietary family of language models designed for enterprise and financial-services use cases.
• We are looking for an LLM/AI Model Engineer to build the training pipelines, datasets and evaluation infrastructure required to continuously improve the Vectro Series.
• 3–5 years in Machine Learning, Deep Learning, NLP, Generative AI or related fields.
• Hands-on experience training or fine-tuning LLMs using open-source foundation models.
• Practical experience building training pipelines, preparing datasets and evaluating model performance.
• Financial-services, multilingual AI or enterprise AI experience is preferred.
• Build the proprietary Vectro Series of enterprise and financial-services language models.
• Develop model training, evaluation and benchmarking infrastructure from the ground up.
• Work closely with the Head of AI and Research Partners.
• Develop proprietary datasets, benchmarks and model improvement systems.
• Ability to independently build reliable model training and evaluation systems from scratch.
• QubeLabs is an equal opportunity employer and values diversity and inclusion. We encourage applications from qualified candidates regardless of background or identity.