Browse Jobs
Explore open roles across India.Explore active software roles. Sign up to apply and get AI match scores.
Top MatchesTop Job Matches
Loading jobs…
Back to Browse Jobs
Providence India
Principal Data Analytics Engineer
Providence India
Mumbai•On-site•8-11 Yrs•Jul 1
Job description
Principal Data Analytics EngineerHealthcare IntelligenceAzure TechnologiesAI Initiative SupportML Pipeline Development
Overview
A Principal Data Analytics Engineer is responsible for architecting, designing and modelling data lake solutions/data ingestion pipelines by collaborating with customers to understand digital transformation requirements. The role requires navigating ambiguous environments and working closely with stakeholders for data readiness for AI initiatives and architectural support.
Responsibilities
- Architect, design and model data lake solutions/data ingestion pipelines
- Collaborate with customers to understand requirements on digital transformation
- Work in aggressively changing and ambiguous situations
- Engage with Software Engineers, Data Scientists, Azure & Network Administrators
- Build scalable and compliant data systems and ML pipelines
- Provide SME guidance for Data Engineering in AI initiatives
- Develop data engineering and analytics solutions within Healthcare Intelligence
- Ensure continuity of data processes and associated batch jobs
- Partner with leadership and engineers to understand data needs
- Identify, design and implement scalable processes and infrastructure for automation
- Manage end-to-end data solutions from raw data analysis to predictive framework configurations
- Monitor performance, capacity, availability, security and compliance of platforms
- Work independently on problems and prepare client ready deliverables
- Elicit, analyze and validate customer data from ingestion to production
- Solve day-to-day data problems and customer challenges
- Own automation and deployment of data pipelines on MS Azure
- Build tools for monitoring and optimizing system components
- Develop custom integrations between cloud-based systems using APIs
- Create automated data quality profiling and cleansing routines
- Proactively evaluate and integrate emerging Azure technologies
- Monitor and manage Azure consumption and compute costs
- Build telemetry, alerting, and monitoring dashboards
- Lead technical design reviews and mentorship for junior engineers
Qualifications
- Working knowledge on Azure data technologies like Data Lake ADLS Gen2, Databricks, ADF, SQL, Synapse
- Proven track record in advanced analytics using Python, SQL or Generative AI abilities along with visual analytics
- Experience in creating data orchestration using ADF and optimizing through regular monitoring
- Exposure to Snowflake Cloud Data Platform
- Familiarity with Linux/Unix scripting, Python, SQL Queries and Database concepts
- Experience working with large datasets and building data processing platforms
- Fluent and fast with SQL query analysis and optimization
- Deep skills in modeling data warehouses
- Exposure and understanding of Agile processes and DevOps
- Experience in batch scheduling & rationalization through Control M
- Excellent interpersonal, verbal and written communication skills
- Excellent analytical and critical thinking capabilities and problem-solving skills
- Conduct exploratory data analysis to gain insights into patterns and structures
- Engage in statistical analysis and hypothesis testing to validate assumptions
- Develop and deploy advanced machine learning models effectively
- Evaluate and fine-tune algorithms for improved accuracy and performance
- Present findings and insights through data visualizations and reports to non-technical users
- Document data analysis processes for future reference and knowledge sharing
- Foster innovation, knowledge-sharing, and continuous improvement culture