Overview

Data Engineer with experience in Azure ADF, Databricks, PySpark, SQL. Responsible for implementing cloud-based solutions on Azure Cloud Analytics, collaborating with internal and external stakeholders, identifying automation opportunities, working closely with Data Architects and Technical Managers.

Responsibilities

• Implement cloud-based solutions on Azure Cloud Analytics
• Collaborate with internal and external stakeholders to understand business requirements and implement them
• Identify and implement automation opportunities to increase operational efficiency
• Interact and collaborate with various teams (web Development/ MS Apps / API Development etc.) to deliver products
• Work closely with Data Architects/Technical Managers in agile environment to identify and understand problem statements and develop/prototype solutions accordingly

Qualifications

• 1-4 years of experience in SQL, Azure Analytics for Developing Data Products
• Strong SQL Expertise and Hands-on experience
• Strong PySpark Expertise and Hands-on experience
• Expertise experience with integration of different Sources System (ERPs, Applications DBs, Cloud Systems and Sharepoint) using Azure Data Factory, Azure Synapse pipelines and ADLS
• Strong Hands on experience on ADF, ADLS and Synapse
• Good Hands on Experience on DataBricks and should be able to demonstrate the usecases for DataBricks usage
• Good Understanding on Unity Catalog and Delta Lake concepts
• Understanding of data modelling concepts
• Exposure on Azure AI Fundamentals
• Experience with BI, and data analytics databases
• Experience in working with NoSQL using MongoDB or similar
• Experience in real-time data ingestion from LIVE sources using Apache Kafka, Spark Streaming, EventHub and related technologies
• Exposure on PowerBi or similar reporting tools

Nice to have

• Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution
• Strong verbal and written communication skills (written and verbal formal and informal)
• Ability to multi-task under pressure and work independently with minimal supervision
• Must be a team player and enjoy working in a cooperative and collaborative team environment
• Adaptable to new technologies and standards

Benefits

• Participate in all aspects of Big Data solution delivery life cycle including analysis, design, development, testing, production deployment, and support