Project Manager

Build and operate the data pipelines that feed the Entity Hub. This role lands all six in-scope sources into Fabric, implements standardization and transformation logic, and maintains the data quality checks and monitoring that the entity resolution engine depends on. Reliable, observable ingestion is the foundation the entire programme rests on.

• Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.

• Create the data integration and data diagram documentation.

• Lead the data validation, UAT and regression test for new data asset creation.

• Create and maintain data models, including schema design and optimization.

• Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency.

• Strong knowledge on Python and Pyspark

• Expectation is to have ability to write Pyspark scripts for developing data workflows.

• Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum