Technical Specialist

Job Summary

JD & Role Summary Design and deliver cloud-native data provisioning, subsetting, and refresh capabilities for GCP lower environments. Build secure and scalable pipelines using BigQuery and associated GCP services to extract, transform, protect, load, validate, and refresh test datasets. Optimize performance and cost while ensuring that data movement, storage, lineage, and access comply with privacy, security, and data-governance requirements.

Key Responsibilities

• Design and build automated provisioning pipelines for GCP and BigQuery lower environments.
• Implement metadata-driven extraction, subsetting, transformation, loading, and refresh workflows.
• Integrate TDM masking and synthetic-data services into end-to-end data pipelines.
• Develop incremental and full refresh patterns with scheduling, restartability, reconciliation, and exception handling.
• Optimize BigQuery SQL, partitioning, clustering, storage, and compute utilization.
• Implement secure service integration, access controls, encryption, logging, lineage, and audit evidence.
• Validate record counts, schema consistency, referential integrity, and data quality after provisioning.
• Support environment onboarding, performance testing, release deployment, and operational knowledge transfer.