LatentView Analytics—Assistant Manager - Data Engineering

Job description

Description: Designation : Assistant Manager - Data Engineering Level : L3 Location : Chennai, Tamil Nadu , India (CHN) Experience : 5 to 8 Years Job Role : We are seeking a Lead / Senior Data Analytics Engineer to drive the design, development, and delivery of enterprise data platforms. You will act as a technical authority for data pipelines, data warehousing, and big data architecture while providing technical guidance to junior/mid-level team members. In addition to core data engineering expertise, experience leveraging AI / GenAI to accelerate data modeling, pipeline automation, and code generation is highly desirable. Responsibilities : Architecture & Design: Design and architect scalable, high-throughput, and reliable end-to-end data systems (databases, warehouses, and big data platforms) adhering to data governance, privacy, and compliance standards. Lead & Technical Delivery: Drive the end-to-end technical delivery of complex data initiatives. Translate broad business requirements into robust, production-grade technical designs. Pipeline Engineering: Lead the implementation and optimization of complex ETL/ELT data pipelines using SQL, PySpark, Hive, and Airflow across large-scale distributed environments. Team Leadership & Mentorship: Provide technical leadership, code reviews, and architectural guidance to junior and mid-level data engineers to enforce best practices and quality standards. Stakeholder Management: Collaborate with business leadership, product managers, and enterprise architects to align data strategies with overall organization goals. AI & Innovation: Leverage AI / GenAI tools to streamline pipeline generation, query optimization, automated test suite generation, and metadata management. Required skills : Advanced PySpark, Advanced SQL, Data Architecture & Design, Big Data Ecosystem ;Hadoop, HDFS, Hive, Airflow / Workflow Orchestration, Data Warehousing (Snowflake / Redshift / BigQuery). Enterprise Cloud Platforms (AWS / GCP / Azure), CI/CD & DevOps for Data Platforms, GenAI / AI-driven pipeline automation, Data Governance & Quality Frameworks, Streaming (Kafka / Spark Streaming). We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status.