Browse Jobs
Explore open roles across India.Explore active software roles. Sign up to apply and get AI match scores.
Top MatchesTop Job Matches
Loading jobs…
Back to Browse Jobs
Bahwan CyberTek
Data Engineer / Architect
Bahwan CyberTek
Chennai•On-site•3-5 Yrs•3 hours ago
Job description
Data EngineeringDatabricksLakehouse ArchitectureCloud Data Platforms
Overview
Senior Data Engineer/Architect role requiring strong Databricks expertise and deep knowledge in data modeling, ETL/ELT pipelines, data governance, and CI/CD for data.
Responsibilities
- Demonstrate strong proficiency in the Databricks platform including Delta Lake, Spark SQL, PySpark, Unity Catalog, MLflow, and Databricks Workflows.
- Deep expertise in data modeling encompassing dimensional, data vault, and medallion/lakehouse architectures.
- Building ETL/ELT pipelines using Databricks, Apache Spark, or similar data engineering tools.
- Proficiency in SQL and Python for data transformation, pipeline orchestration, and automation.
- Understanding data governance principles such as data cataloging, lineage, quality monitoring, access control, and metadata management.
- Familiarity with cloud data platforms like Azure Data Lake Storage, Azure Synapse, AWS S3/Glue.
- Knowledge of AI/ML data requirements including feature engineering, RAG data preparation, embedding storage, and LLM training/fine-tuning data pipelines.
- Experience in integrating data from enterprise systems such as ServiceNow, Workday, Active Directory, CMDB, and Jira.
- Knowledge of data privacy and compliance standards (GDPR, LGPD) and security best practices for data platforms.
- Comfortable with CI/CD pipelines for data including Databricks Asset Bundles, Terraform, GitHub Actions, Azure DevOps.
- Strong skills in documentation, data storytelling, and cross-functional communication.
Qualifications
- Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or related field.
Nice to have
- Experience with enterprise system integration (ServiceNow, Workday, Active Directory, CMDB, Jira).
- Knowledge of data privacy and compliance standards (GDPR, LGPD).
Education
- Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or related field.