Overview

We are seeking a Data Engineer with expertise in Python and Azure to join our team in Indore. As a Data Engineer, you will play a critical role in designing, building, and maintaining data pipelines, leveraging Azure services, and working with a range of technologies, including Snowflake, Databricks, Postgres, PySpark, and Python.

Responsibilities

• Design, develop, and maintain data pipelines and ETL processes to support data-driven initiatives
• Collaborate with cross-functional teams to understand data requirements and deliver data solutions
• Manage and optimize data infrastructure using Azure services
• Utilize PySpark for large-scale data processing and transformation
• Ensure efficient automation of data workflows and pipeline optimization
• Monitor data quality, implement data validation, and set up data monitoring mechanisms

Qualifications

• Bachelors degree or equivalent experience in Computer Science or a related field
• Proven experience in data engineering, with 3 to 8 years of relevant work
• Proficiency in Python and its libraries for data manipulation and transformation
• Strong familiarity with Azure services and cloud-based data solutions
• Experience with Snowflake, Databricks, Postgres, and PySpark is highly advantageous
• Solid SQL skills and data modeling experience
• Ability to work with data integration tools and workflow orchestration

Nice to have

• Strong problem-solving abilities, attention to detail, and a commitment to data quality

Education

• Bachelors degree or equivalent experience in Computer Science or a related field