Birlasoft—Azure Databricks Architect

Job description

Description: Area(s) of responsibility Skills: Azure Databricks Sr. Architect, Python, Pyspark, Data Factory, Data Lake Experience: 15+ years Location: Mumbai/ Pune/ Noida/ Bangalore/ CHennai/ Hyderabad Responsibilities: • Develop and maintain scalable architecture, database design and data pipelines and build out new Data Source integrations to support continuing increases in data volume and complexity • Design and Develop the Data lake, Data warehouse using Azure Cloud Services • Assist in designing end to end data and Analytics solution architecture and perform POCs within Azure • Drive the design, sizing, POC setup, etc. of Azure environments and related services for the use cases and the solutions • Reviews the solution requirements support architecture design to ensure the selection of appropriate technology, efficient use of resources and integration of multiple systems and technology. • Must possess good client-facing experience with the ability to facilitate requirements sessions and lead teams • Support internal presentations to technical and business teams • Provide technical guidance, mentoring and code review, design level technical best practices Experience Needed: • 12-15 years of industry experience and at least 3 years of experience in architect role is required along with at least 3 to 4 years’ experience designing and building analytics solutions in Azure. • Experience in architecting data ingestion/integration frameworks capable of processing structured, semi-structured & unstructured data sets in batch & real-time • Hands-on experience in the design of reporting schemas, data marts and development of reporting solutions • Develop batch processing, streaming and integration solutions and process Structured and Non-Structured Data • Demonstrated experience with ETL development both on-premises and in the cloud using SSIS, Data Factory, and Azure Analysis Services and other ETL technologies. • Experience in Perform Design, Development & Deployment using Azure Services ( Azure Synapse, Data Factory, Azure Data Lake Storage, Databricks, Python and SSIS) • Worked with transactional, temporal, time series, and structured and unstructured data. • Deep understanding of the operational dependencies of applications, networks, systems, security, and policy (both on-premise and in the cloud; VMs, Networking, VPN (Express Route), Active Directory, Storage (Blob, etc.), Windows/Linux). Mandatory Skills: Azure Synapse, Data Factory, Azure Data Lake Storage, Databricks, Python