HCLTech
IT Services & IT-BPM
Technical Specialist
- Location IN
- Experience ~5-10 yrs
- Job type Full-time
- Posted 13 Oct 2026
You will be taken to HCLTech’s own careers page to apply. Job ID 1372099955.
Job description
Job Summary
AI, Machine Learning, Kafka, Big Query
- Design and develop batch and real-time data pipelines for analytics, AI, and machine learning use cases.
- Build Kafka producers, consumers, topics, connectors, and stream-processing workflows with appropriate partitioning, ordering, replay, retry, and dead-letter handling.
- Create and optimize BigQuery datasets, tables, views, materialized views, partitioning, clustering, and SQL workloads for performance and cost efficiency.
- Integrate structured and unstructured data from applications, APIs, databases, files, and event streams.
- Prepare curated, reusable datasets and feature pipelines for model training, validation, deployment, and monitoring.
- Implement data-quality checks, schema validation, lineage, metadata, retention, and access controls.
- Develop reliable orchestration, CI/CD, automated testing, observability, and incident-response practices for data workloads.
- Troubleshoot pipeline failures, data delays, duplication, schema changes, and performance bottlenecks.
- Collaborate with data scientists to operationalize machine learning workflows and ensure reproducible data inputs.
