HCLTech
IT Services & IT-BPM
Senior Technical Specialist
- Location IN
- Experience ~5-10 yrs
- Job type Full-time
- Posted 13 Oct 2026
You will be taken to HCLTech’s own careers page to apply. Job ID 1371446355.
Job description
Job Summary
Hands-on build (the core of the role)
- Design and build data pipelines in Microsoft Fabric — Data Factory pipelines, Copy activities, and Spark notebooks (PySpark) — across a bronze/silver/gold medallion architecture.
- Write production-grade PySpark and SQL for ingestion, transformation, cleansing, and star-schema modelling in Delta Lake / OneLake.
- Build and optimise semantic models (Direct Lake), including relationships, DAX measures, and row-level security, tuned for performance against the gold layer.
- Design and implement metadata-driven ingestion frameworks — config-driven, parameterised pipelines that scale across many sources rather than one pipeline per table.
- Implement robust handling for incremental loading, schema drift/evolution, and data quality, including CDC/watermark/hash-based patterns as appropriate per source.
- Integrate and configure governance via Microsoft Purview — lineage, cataloguing, classification — as a first-class part of the build, not an afterthought.
Technical leadership
- Own the technical architecture and set the design patterns, coding standards, and best practices the team builds against.
