Quantiphi
Create a free account
One signup unlocks everything for this job:
- Apply to this job and track your application
- See your personalized profile match score
- Generate an AI cover letter for this role
Mysuru · On-site · 3-5 Yrs · Sep 9
Business consulting · 1001 to 5000 Employees · Marlborough, US
Quantiphi is an award-winning AI-first digital engineering company driven by the desire to reimagine and realize transformational opportunities at the heart of the business. Since its inception in 2013, Quantiphi has solved the toughest and most complex business problems by combining deep industry experience, disciplined cloud, and data-engineering practices, and cutting-edge artificial intelligence research to achieve accelerated and quantiphi-able business results.
Hiring: Engineering
What employees say
+ Pay is consistent and gets credited ontime
− Check conditions for bonus pay
More reviews on the company profile.
Interview experience · Business Analyst Intern
An Online Test containing Aptitude, Verbal Ability, CSE Fundamentals & Coding followed by Group Discussion. Technical round 1 Interview followed by Technical round 2 Interview then HR Discussion to end the process.
Average difficulty · India · 664 reports
More interview insightsJob description
Overview
Summary We are looking for an experienced Senior Data Engineer to join our team at Quantiphi, a leader in AI-first engineering and innovative GenAI solutions.
Responsibilities
- Design partitioning, parallelism, and throughput strategies to sustain high-volume ingestion.
- Build real-time streaming ingestion pipelines consuming document creation and update events, processing them through chunking and embedding generation.
- Build vector and indexing pipelines targeting vector store platforms (e.g., Vertex AI Vector Search, Pinecone, Weaviate, Milvus, pgvector)
- Manage vector store index operations: bulk load, incremental upsert, index refresh, and consistency validation post-ingestion.
- Implement metadata tagging on vector records to support filtered retrieval at query time.
- Implement end-to-end lineage tracking for vector records - linking each chunk back to its source document.
- Implement document-level change tracking to detect upstream updates, deletions, and re-ingestion events and trigger appropriate vector store operations (upsert, delete, re-index) without full corpus re-processing.
- Tag all vector records with pipeline run metadata - ingestion timestamp, pipeline version, chunking strategy version, embedding model version, to support retrieval quality debugging and model refresh traceability.
Qualifications
- Python- Strong proficiency in Python for data processing, pipeline development, automation, and transformation frameworks.
- Streaming Technologies - Experience building real-time ingestion pipelines using Apache Kafka, GCP Pub/Sub, Azure Event Hubs, or equivalent event streaming platforms.
- Data Platforms - Experience working with BigQuery/Synapse, Databricks, Snowflake, or equivalent cloud-native analytical platforms.
- Data Modeling & SQL - Strong SQL skills and experience designing scalable analytical and operational data models.
- Vector databases - Familiarity with Pinecone, Vertex AI Vector Search, Weaviate, Milvus, pgvector, or similar retrieval platforms.
- Document processing - Familiarity with PDF, RTF, JSON, OCR pipelines, and metadata extraction workflows.
- Data Quality & Governance - Experience implementing validation frameworks, reconciliation, lineage, metadata management, monitoring, and pipeline observability.
- Cloud Platforms - Hands-on experience building cloud-native data solutions using GCS/ADLS, BigQuery/Synapse, Dataflow/ADF, Cloud Composer/Airflow, or equivalent services.
- Regulated Data - Experience working with regulated data environments where security, auditability, governance, and compliance are critical.
Verify Python for this role
Free PRACTICE for Python adds a verified skill signal that can boost how roles like this rank for you — optional, not required to browse or apply.
Sign up — verify Python free →Want match scores and deeper insight? Create a free candidate profile
Job application FAQ
Last updated 17 September 2026
- How do I apply for Senior Data Engineer(15-30 days joiners only) at Quantiphi?
- Open this job on Feedback AI and sign up free (or sign in). You can apply from the job detail page; match scores and skill gaps appear when your profile is complete. Quantiphi may attach structured assessments to interview rounds after you apply.
- Does Feedback AI show a match score for this Senior Data Engineer(15-30 days joiners only) role?
- Yes after you add a resume or skills. Match score ranks this role against your profile — skills met, gaps, level, and location — so you prioritise applications where fit is strongest.
- Is Senior Data Engineer(15-30 days joiners only) remote or on-site in Mysuru, Karnataka?
- This listing is marked on_site with location Mysuru, Karnataka. Confirm details on the job description before applying.
- What skills matter for this Senior Data Engineer(15-30 days joiners only) role at Quantiphi?
- This is a senior Senior Data Engineer(15-30 days joiners only) role. Key skills include skills listed in the job description. Feedback AI highlights matched vs missing skills on your profile after signup.