Overview

I have 2 exciting Senior Data Engineer openings with a globally strategic data modernisation programme at one of the world's leading investment intelligence firms.

Responsibilities

• Build and maintain scalable distributed data pipelines on Microsoft Fabric including OneLake lakehouse layers and Delta Lake merge workflows
• Design and implement bitemporal data models to support certified regulatory grade time-series datasets
• Build and maintain software testing frameworks unit, non-regression and user acceptance for pipelines and transformation logic Acquire, normalise, transform and release large volumes of financial market data
• Support AI solution integration including AI assisted ingestion, anomaly detection and semantic search over the lakehouse
• Build and maintain scalable distributed data pipelines on GCP including BigQuery based lakehouse layers and Dataproc driven Delta Lake workflows
• Design and implement bitemporal data models on BigQuery to support certified regulatory grade time-series datasets
• Build and maintain software testing frameworks unit, non-regression and user acceptance for pipelines and transformation logic Acquire, normalise, transform and release large volumes of financial market data through the OMDP data factory
• Support AI solution integration using Vertex AI including AI assisted ingestion, anomaly detection and semantic search over the lakehouse