Sonata Software—Digital Senior Engineer

Job description

Description: Job Description – Senior Azure Data Engineer with Microsoft Fabric & Claude Experience: 6–8 Years Primary Skills Azure Data Factory (ADF) | Microsoft Fabric | Claude / Claude Code | AI-Assisted Development | SQL | PySpark | Python Position Overview We are looking for a Senior Data Engineer with strong hands-on experience in Azure Data Factory, Microsoft Fabric, SQL, and modern data engineering practices. The candidate should also have practical exposure to AI-driven development tools such as Claude, Claude Code, GitHub Copilot, or Fabric AI capabilities to accelerate development and improve engineering productivity. Roles & Responsibilities 1. Data Engineering & Development - Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF). - Develop data integration workflows using ADF and Microsoft Fabric Data Factory. - Build and maintain Fabric Notebooks, Lakehouse, Data Warehouse, and Medallion Architecture solutions using PySpark and SQL. - Analyze, transform, and integrate data from multiple sources. - Develop and optimize complex SQL queries, stored procedures, and data models. - Ensure data quality through validation, reconciliation, exception handling, governance, and security practices. 2. AI-Driven Engineering - Leverage AI tools such as Claude, Claude Code, GitHub Copilot, and Fabric AI capabilities to improve productivity and accelerate software delivery. - Apply AI-assisted coding, debugging, documentation, unit testing, and code optimization in day-to-day development. - Utilize Generative AI to enhance data engineering workflows and automate repetitive development activities. - Identify opportunities to integrate AI-assisted approaches into modern data engineering practices. 3. Collaboration & Delivery - Collaborate with Solution Architects, Technical Leads, BI Developers, QA teams, Data Analysts, and business stakeholders. - Participate in technical design, code reviews, troubleshooting, and production support. - Translate business requirements into scalable cloud data solutions. - Contribute to coding standards, reusable frameworks, and engineering best practices. 4. DevOps & Automation - Implement CI/CD practices using Azure DevOps and/or GitHub. - Automate deployment, testing, monitoring, and operational processes. - Follow Git best practices, DataOps principles, and documentation standards. Required Skills - Strong hands-on experience in Azure Data Factory (ADF). - Strong knowledge of Azure SQL Database/SQL Server, T-SQL, and Stored Procedures. - Experience with Azure Data Lake Storage (ADLS Gen2). - Good understanding of Microsoft Fabric and modern data engineering practices. - Experience with Data Warehouse concepts, Fact/Dimension modeling, and Star Schema. - Intermediate knowledge of Python and working knowledge of PySpark. - Experience with Azure DevOps/Git and CI/CD. - Practical exposure to AI-assisted development tools such as Claude, Claude Code, or GitHub Copilot. - Strong analytical, problem-solving, and communication skills. Good to Have - Microsoft Fabric – Data Factory, Lakehouse, and Warehouse. - Azure Logic Apps. - Power BI Semantic Models. - Experience with Generative AI-based automation and AI-driven engineering workflows. Important Screening Criteria: Candidates must have practical exposure to AI-assisted development, preferably Claude or Claude Code, along with core Azure Data Engineering skills. Profiles with only traditional data engineering experience and no AI-driven development exposure should not be shortlisted.