Overview

PC-1513-Data Engineer (ADF / Dataflow Specialist)

Responsibilities

• Design & Build Pipelines: Develop, orchestrate, and maintain scalable data ingestion and transformation pipelines using Azure Data Factory (ADF) and Dataflows.
• Accelerate Migrations: Build automated data solutions and core data assets focusing on the Data Migration Accelerator for Dynamics 365, Dataverse, and Microsoft Fabric.
• Embed Agentic Logic: Develop and integrate intelligent, automated agents (including validation, reconciliation, and data-stewardship agents) within pipelines to shift client value from one-time migration builds to ongoing, subscription-based service models.
• Analytics Delivery: Create and pre-package robust Analytics & Insights Accelerators utilizing Microsoft Fabric and Power BI to maximize day-one reporting capabilities for end-users.
• Data Governance: Implement and enforce native data governance, security baselines, and tracking frameworks seamlessly across environments using Microsoft Purview.
• Agile Delivery: Deliver and deploy all assigned data products utilizing the internal Agentic Development Lifecycle (AiDLC), adhering strictly to a 90-day development-to-production cycle (the "3-month rule").
• Quality Assurance: Ensure all data pipelines and products strictly align with ISO/IEC 25010 software quality standards and pass uncompromising security clearance checks before entering active client environments.

Qualifications

• Domain Skills & Technologies Must / Preferred
• Core Cloud Data Microsoft Azure Data Factory (ADF) / Dataflows / Azure Data Engineering / Microsoft Fabric / Dataverse Must-Have
• Governance & Quality Microsoft Purview, ISO/IEC 25010 Compliance Frameworks Good-to-Have
• Analytics & BI Power BI, Advanced DAX, Pre-packaged Analytics Frameworks Good-to-Have
• AI & Lifecycle Agentic Development Lifecycle (AiDLC), Embedded Validation Agents Good-to-Have
• Target Architecture Dynamics 365 Core Schemas & Migration APIs Preferred
• Mandatory Certification Timeline: Must currently hold, or explicitly commit to achieving, the DP-203 (Azure Data Engineer Associate) or DP-600 (Fabric Analytics Engineer Associate) along with PL-300 (Power BI Data Analyst) certifications by December 2026 to support Softobiz's Solutions Partner for Data & AI designation roadmap.
• Accountability & Drive: High ownership mindset with a proven ability to independently drive complex engineering milestones to completion under 90-day cycles.
• Cross-Border Communication: Strong written and verbal communication skills, with the capability to clearly articulate technical logic, documentation, and product requirements.
• Product-Centric Thinking: Ability to design data flows with modularity and reusability in mind, looking past single-project silos to build scalable platforms.

Benefits

• Leading-Edge Innovation: Deep, direct engagement with emerging technologies like Agentic AI orchestration, Micro-Agent Architectures, and advanced Microsoft Fabric implementations.
• Global Exposure: Opportunity to contribute directly to data systems deployed for premier enterprise clients across Australia, the US, and India.
• Upskilling & Certification Support: Structured organizational tracking and learning assistance to clear premier Microsoft and Azure technical certifications.