Sarvam AI

Staff Data Engineer

Sarvam AI

Bengaluru•On-site•5-8 Yrs•3 hours ago

Job description

Overview

We're hiring a Staff Engineer to design and build Sarvam's Data & Analytics Platform from the ground up. This is a high-ownership, high-leverage role — you will be the technical owner of a system that every Sarvam product writes to and every Sarvam customer reads from.

Responsibilities

A high-throughput event ingestion API in Go that accepts arbitrary event payloads, validates them, and lands them in ClickHouse with automatic table creation, column addition, and safe schema evolution as event shapes change.
CDC pipelines using Debezium and Kafka to mirror product Postgres/MySQL databases into ClickHouse, with deduplication, ordering guarantees, and replay tooling.
A multi-tenant query API with strict RBAC, per-tenant isolation, query budgets, and the same surface powering customer-facing dashboards, internal analytics, and the finance team's billing extracts.
A no-code dashboard layer that lets customers build product-analytics views without writing SQL — and lets internal teams ship dashboards in hours, not days.
The operational backbone: ClickHouse cluster design (sharding, replication, MergeTree families, materialized views), capacity planning, cost controls, observability, on-call playbooks, and SLOs.
The engineering culture for this team — design reviews, RFC process, testing standards, and the bar that future hires will be measured against.

Qualifications

5+ years of backend / data-platform engineering, with a meaningful chunk spent designing and operating analytics systems in production.
Track record of building 0-to-1 platforms that other engineering teams depend on.
ClickHouse in production at scale — sharding, replication, MergeTree variants, materialized views, projection design, query tuning, and operational know-how (backups, upgrades, capacity planning).
Golang for high-throughput backend services — strong grasp of concurrency, performance, and API design (REST/gRPC).
Kafka as a primary streaming backbone — partitioning strategy, consumer groups, exactly-once / idempotency patterns, schema registry.
Debezium-based CDC — you've built and operated CDC pipelines from transactional databases into analytical stores.
Strong systems instincts: you reason about throughput, latency, cost, and failure modes before you write code.
Worked on or integrated with BI / dashboarding tools (Superset, Metabase, Cube, or similar) — bonus if you've built embedded customer-facing analytics.
Exposure to billing / metering data feeds where correctness is non-negotiable.
Want to be the technical owner of a foundational platform, not a feature contributor on someone else's system.
Like writing code as much as writing design docs — and refuse to do one without the other.
Care about cost-per-query and dollar-per-event, not just p99 latency.
Are comfortable making decisions with imperfect information, and revisiting them when the data changes.
Want to work on-site in Bengaluru with a small team of senior builders, shipping fast.

Nice to have

Spark + Airflow for batch enrichment, backfills, and scheduled aggregations.

Browse Jobs

Top MatchesTop Job Matches