Birlasoft—Sr. Lead Data Architect

Job description

Description: Area(s) of responsibility Skills: Sr. Data Architect (Snowflake & Databricks) Experience: 16+ years Location: Noida/ Mumbai/ Pune/ Bangalore/ Hyderabad/ Chennai Role Overview: We are seeking a highly experienced Data Architect with deep expertise in modern cloud data platforms, specifically Snowflake and Databricks. The ideal candidate will be responsible for designing, developing, and governing scalable, high-performance data architectures that support advanced analytics, AI/ML, and enterprise data initiatives. This role requires a strategic thinker who can translate business requirements into robust technical solutions while ensuring data quality, security, and scalability. Key Responsibilities: • Design and implement end-to-end data architecture across Snowflake and Databricks platforms. • Define data modeling standards including dimensional, normalized, and Data Vault models. • Architect scalable data lakes, lakehouses, and data warehouses using best practices. • Lead data integration strategies using ETL/ELT frameworks leveraging tools like ADF, dbt, and Spark. • Optimize performance and cost across Snowflake and Databricks environments. • Implement data governance, security, lineage, and compliance frameworks. • Enable real-time and batch data processing architectures. • Collaborate with business stakeholders to align data strategy with business goals. • Mentor engineering teams and enforce architectural standards. Technical Skills & Expertise • Strong expertise in Snowflake: architecture design, Snowpipe, Streams/Tasks, performance tuning, and data sharing. • Advanced knowledge of Databricks: Delta Lake, Lakehouse architecture, Spark (PySpark/Scala), and performance optimization. • Experience with Databricks features such as Unity Catalog, Delta Live Tables, MLflow, and Mosaic AI. • Proficiency in SQL, Python, and distributed data processing frameworks. • Hands-on experience with cloud platforms (Azure/AWS/GCP) and related services. • Strong understanding of data ingestion, transformation, orchestration, and data warehousing concepts. • Experience with data visualization tools such as Power BI, Tableau, or Qlik. Architecture & Design Capabilities • Design hybrid architectures leveraging Snowflake for warehousing and Databricks for advanced analytics and ML workloads. • Define data lakehouse strategies integrating structured, semi-structured, and unstructured data. • Build event-driven, real-time data pipelines. • Establish reusable frameworks for ingestion, transformation, and consumption. Data Governance & Security • Implement robust data governance frameworks including cataloging, lineage, and data quality controls. • Ensure compliance with enterprise security policies and regulatory requirements. • Define access control strategies using role-based and attribute-based access. Qualifications & Experience • 10+ years of overall experience in data engineering and architecture. • Proven experience working with both Snowflake and Databricks in enterprise environments. • Strong experience in designing large-scale data platforms and migration strategies. • Experience in AI/ML data pipeline enablement is highly preferred. • Relevant certifications in Snowflake, Databricks, or cloud platforms are a plus. Soft Skills • Strong stakeholder management and communication skills. • Ability to translate complex technical concepts into business outcomes. • Leadership skills with experience managing cross-functional teams. • Strong problem-solving and analytical thinking abilities.