Browse Jobs
Explore open roles across India.Explore active software roles. Sign up to apply and get AI match scores.
Top MatchesTop Job Matches
Loading jobs…
Back to Browse Jobs
Logic Planet Inc
Data Integration Engineer
Logic Planet Inc
Mumbai•On-site•5-8 Yrs•2 hours ago
Job description
Overview
You will manage data ingestion and systems integration activities specifically within the Databricks platform.
Responsibilities
- Integrate data from diverse source systems by tailoring approaches to specific system requirements.
- Design, maintain, and oversee ETL/ELT pipelines on Databricks.
- Automate and schedule ingestion jobs using Apache Airflow.
- Document all ingestion and integration flows, pipelines, and metadata.
- Monitor pipeline performance and ensure adherence to SDLC best practices and security guidelines.
Qualifications
- 5+ years of experience in data engineering, ingestion pipelining, and ETL/ELT.
- Hands-on experience with Databricks.
- Proficiency in Python, PySpark, SQL, Spark, or Scala.
- Practical knowledge of CI/CD pipelines.
- Working experience with Git and version control.
- Understanding of data quality guidelines and PII management.