Overview

About Boston Insights At Boston Insights, we believe every patient in a clinical trial deserves timely access to life-changing investigational drugs.

Responsibilities

• The Lead Data
• Engineer will be instrumental in designing, implementing, and managing scalable data solutions. This is hands-on technical leadership role where you will architect scalable data pipelines, build Lakehouse and Warehouse structures, and drive data quality and governance across our multi-tenant SaaS platform. You will work closely with the product and architecture teams to deliver analytics-ready data that powers real-time clinical supply chain intelligence for global pharmaceutical companies.
• Manage OneLake file structures, Delta tables, partitioning strategies, and storage governance for a multi-tenant SaaS environment
• Develop incremental loading frameworks, data quality validation, and error handling mechanisms
• Optimize query performance, schema design, and data models to support Power BI semantic models and real-time analytics
• Implement CI/CD pipelines for data engineering artifacts using Azure DevOps and Git integration
• Collaborate with Power BI developers, Power Apps developers, and data analysts to ensure seamless data delivery for reporting and application layers
• Support multi-tenant workspace isolation (workspace-per-customer model on shared Fabric capacity) and enforce tenant-level data security
• Build and maintain integrations with external systems including ERP, MES, WMS, CTMS, RTSM/IRT, and 3PL platforms
• Stay current with Microsoft Fabric updates, recent features, and best practices to continuously improve the platform

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related field
• 45+ years of hands-on experience in data engineering, with at least 12 years working with Microsoft Fabric
• Strong proficiency in SQL, PySpark, Python, and Delta Lake
• Deep experience with Microsoft Fabric components: Lakehouse, Warehouse, Data Factory, Dataflows Gen2, Notebooks, and OneLake
• Solid understanding of ETL/ELT patterns, data modeling (star schema, snowflake schema), and data warehousing concepts
• Proficiency in Power BI integration semantic models, datasets, and DirectLake mode
• Strong understanding of data governance, security, and compliance in multi-tenant environments
• Excellent written and verbal communication skills; ability to produce clear technical documentation Preferred Qualifications Microsoft Certified: Fabric Data Engineer Associate (DP-700) certification
• Familiarity with clinical trial data systems (CTMS, RTSM/IRT, CDISC standards)
• Exposure to AI/ML integration within Microsoft Fabric (Synapse Data Science, notebooks)
• Knowledge of Kusto Query Language (KQL) and Real-Time Analytics in Fabric What We Offer Opportunity to build a category-defining product in Ab