AVISOFT
Create a free account
One signup unlocks everything for this job:
- Apply to this job and track your application
- See your personalized profile match score
- Generate an AI cover letter for this role
1 to 50 Employees · Noida, India
What employees say
+ You will find great colleagues
− Every thing there is a con
More reviews on the company profile.
Interview experience · Senior Software Engineer
Had 3 rounds of interview and completed assignment. After that they told me to be ready fourth round and not picking my call then. In these three rounds itself they didn't attended meeting on time. I was waiting the cli
Difficult difficulty · Bengaluru · 1 reports
More interview insightsJob description
Overview
We are looking for a Senior Data Engineer with strong expertise in Databricks, PySpark, SQL, and Delta Lake to build scalable data platforms and modern Lakehouse solutions.
Responsibilities
- Design and implement scalable Lakehouse architectures using Databricks and Delta Lake.
- Migrate Hadoop-based workloads to modern Databricks platforms.
- Develop and optimize ETL/ELT pipelines using PySpark and SQL.
- Build Medallion Architecture (Bronze, Silver, Gold) for enterprise analytics.
- Implement workflow orchestration using Airflow, Databricks Workflows, or NiFi.
- Develop real-time data pipelines using Kafka and streaming technologies.
- Ensure data governance, security, lineage, and access management using Unity Catalog.
- Collaborate with business stakeholders and global clients to deliver data solutions.
Qualifications
- Strong experience in Databricks, PySpark, SQL, Delta Lake, and Apache Spark.
- Hands-on experience with Hadoop (HDFS, Hive, YARN) and large-scale data processing.
- Expertise in ETL/ELT development, data modeling, and distributed systems.
- Experience with Airflow, NiFi, Kafka, and streaming data pipelines.
- Knowledge of Lakehouse Architecture, Medallion Architecture, and Unity Catalog.
- Experience with AWS, Azure, or GCP cloud platforms.
- Strong understanding of data governance, security, and performance optimization.
Nice to have
- Experience with Generative AI, NLP, LLMs, and Conversational AI platforms.
- Knowledge of Vector Databases, Semantic Search, and RAG architectures.
- Exposure to Banking or Financial Services domain.
- Understanding of GDPR, CCPA, and AI compliance standards.
Verify SQL for this role
Free PRACTICE for SQL adds a verified skill signal that can boost how roles like this rank for you — optional, not required to browse or apply.
Sign up — verify SQL free →Want match scores and deeper insight? Create a free candidate profile