EY—Azure Data Engineer

Job description

Description: At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. STS Cross-Function Cloud Automation Engineer EY Technology: Technology has always been at the heart of what we do and deliver at EY. We need technology to keep an organization the size of ours working efficiently. We have 450,000 people in more than 160 countries, all of whom rely on secure technology to be able to do their job every single day. Everything from the laptops we use, to the ability to work remotely on our mobile devices and connecting our people and our clients, to enabling hundreds of internal tools and external solutions delivered to our clients. Technology solutions are integrated in the client services we deliver and is key to us being more innovative as an organization. EY Technology supports our technology needs through three business units: Client Technology (CT) - focuses on developing new technology services for our clients. It enables EY to identify new technology-based opportunities faster, and pursue those opportunities more rapidly. Enterprise Technology (ET) – ET supports our Core Business Services functions and will deliver fit-for-purpose technology infrastructure at the cheapest possible cost for quality services. ET will also support our internal technology needs by focusing on a better user experience. Information Security (Info Sec) - Info Sec prevents, detects, responds and mitigates cyber-risk, protecting EY and client data, and our information management systems. The Opportunity The STS Cross-Function Cloud Automation Engineer partners with Security Technology Services (STS) and Information Security stakeholders to design, build, and optimize cloud-native analytics, integration, and automation solutions that improve operational efficiency, visibility, and service delivery. The role combines expertise in Microsoft Fabric, data engineering, cloud integration, workflow automation, and operational intelligence to enable scalable, resilient, and secure security technology services. This engineer is responsible for developing enterprise analytics platforms using Microsoft Fabric and OneLake, building cloud-native integrations across Microsoft 365, ServiceNow, Azure, and security platforms, and creating automated workflows that transform operational insights into actionable outcomes. The role enables closed-loop operational intelligence by combining analytics, automation, AI-driven insights, and service management processes to drive continuous improvement, operational excellence, and business value realization across the Information Security organization. Your Key Responsibilities Analytics & Data Engineering - Design, build, and maintain enterprise-scale analytics solutions using Microsoft Fabric, leveraging OneLake, Lakehouse, and Medallion (Bronze, Silver, Gold) architecture patterns. - Develop and optimize scalable data ingestion frameworks using Fabric Pipelines, Dataflow Gen2, Notebooks, Mirroring, Event Streams, and Shortcuts. - Implement data integration solutions across multiple platforms including ADLS Gen2, Azure services, Dataverse, SaaS platforms, ServiceNow, Microsoft 365, and external cloud storage sources. - Design and manage Lakehouse environments, ensuring data quality, consistency, governance, lifecycle management, and performance optimization. - Build and maintain semantic models, Direct Lake datasets, and Power BI solutions to support executive, operational, and strategic reporting needs. - Design and implement enterprise KPIs, operational metrics, trend analysis, root cause analysis (RCA), and business intelligence solutions. - Enable advanced analytics and AI-driven use cases including AI Search, vector-based retrieval, cross-source correlation, predictive insights, and GenAI-powered recommendations. - Implement and enforce data governance, security, lineage, auditing, and compliance controls across the analytics environment. Cloud Automation & Workflow Engineering - Design, develop, and maintain cloud-native automation solutions using Azure Logic Apps, Power Automate, Power Apps, and API-driven integration services. - Build scalable workflow orchestration capabilities to automate operational processes, approvals, notifications, service requests, and security operations activities. - Develop event-driven automation capabilities leveraging Fabric Event Streams, Logic Apps, APIs, webhooks, and cloud-native integration services. - Design automated operational workflows that improve service onboarding, lifecycle management, compliance monitoring, and platform health management. - Enable self-service and low-code automation capabilities through Power Platform technologies. Enterprise Integration Engineering - Design and implement integrations across Microsoft 365, ServiceNow, Azure services, security platforms, CMDB solutions, inventory systems, and third-party SaaS applications. - Develop reusable integration frameworks, APIs, connectors, and data exchange services to support enterprise operational and analytics requirements. - Enable secure, scalable, and resilient movement of operational, telemetry, and business data across multiple enterprise platforms. - Partner with platform owners and stakeholders to streamline data exchange, workflow automation, and service interoperability. Operational Intelligence & Service Automation - Build ingestion and analytics solutions for operational telemetry, log analytics, platform health, incidents, requests, and service management data. - Develop operational intelligence solutions that correlate data across multiple technology platforms to provide actionable business and operational insights. - Integrate analytics and automation platforms with ServiceNow to support incident management, request fulfillment, change management, workflow approvals, and operational processes. - Design and implement automated ticket creation, escalation workflows, notifications, exception management, and remediation processes. Closed-Loop Intelligence & Continuous Improvement - Design and implement closed-loop operational intelligence capabilities that transform insights, anomalies, recommendations, and RCA findings into automated actions and operational workflows. - Build feedback mechanisms that capture outcomes, approvals, resolutions, and remediation activities to improve future recommendations and operational effectiveness. - Partner with business and technology stakeholders to identify automation opportunities and continuously improve operational processes. - Drive innovation through AI, analytics, automation, and process optimization initiatives across STS services. Platform Engineering & Operational Excellence - Establish CI/CD practices, deployment standards, testing frameworks, monitoring, logging, and operational support processes. - Implement governance, resiliency, performance optimization, and operational readiness standards across analytics, integration, and automation platforms. - Contribute to platform architecture, engineering standards, and best practices across cloud engineering, automation, analytics, and integration domains. Skills and Attributes for Success - Strong understanding of modern cloud data platform architecture, automation engineering, and enterprise integration patterns. - Ability to design end-to-end solutions spanning data ingestion, analytics, automation, orchestration, and operational workflows. - Experience implementing Lakehouse and Medallion architecture patterns in enterprise environments. - Strong understanding of workflow automation, low-code platforms, API integrations, and event-driven architectures. - Experience designing enterprise integration solutions across cloud services, ITSM platforms, security technologies, and business applications. - Strong analytical and problem-solving skills with the ability to derive actionable insights from large and complex datasets. - Excellent stakeholder management and communication skills with the ability to explain technical concepts to both technical and non-technical audiences. - Ability to work independently while collaborating effectively across multiple business and technology teams. - Experience balancing scalability, governance, security, resiliency, and performance requirements across enterprise platforms. - Passion for emerging technologies including AI, GenAI, intelligent automation, and advanced analytics. To Qualify for the Role You Must Have - Bachelor's or Master's degree in Computer Science, Information Technology, Data Analytics, Engineering, or a related field. - Total of 9+ years, with 5+ years of experience in Data Engineering, Cloud Engineering, Automation Engineering, Analytics, Platform Engineering, or related technical disciplines. - Knowledge of security concepts, practices, and technologies, or prior experience supporting a Security or Information Security organization is highly desirable. Microsoft Fabric Experience Hands-on experience with: - Fabric Data Factory - OneLake - Lakehouse - Dataflow Gen2 - Notebooks - Semantic Models - Direct Lake - Fabric Pipelines - Event Streams Technical Skills - Strong proficiency in SQL and Python/PySpark. - Experience designing and implementing Bronze, Silver, and Gold data architectures. - Strong understanding of data modelling, dimensional modelling, semantic modelling, and Power BI best practices. - Experience working with Data Lakes and large-scale enterprise datasets. - Understanding of data governance, lineage, auditing, security controls, and compliance requirements. - Experience building executive dashboards, KPI frameworks, and operational reporting solutions. Automation & Integration Experience - Hands-on experience with Azure Logic Apps, Power Automate, and Power Platform solutions. - Experience developing enterprise integrations using REST APIs, JSON, webhooks, and API-driven architectures. - Experience integrating cloud services, SaaS applications, Microsoft 365, ServiceNow, and enterprise platforms. - Experience working with event-driven architectures and automation frameworks. Operational Platforms Experience with one or more of: - Azure Data Explorer (ADX) - Azure Data Factory (ADF) - Azure Functions - Azure Event Hub - Azure Service Bus - ServiceNow Platform DevOps & Engineering Practices - Experience with Azure DevOps, Git, CI/CD pipelines, and automated deployment processes. - Experience with Infrastructure as Code technologies such as Terraform, Bicep, or ARM templates. - Understanding of platform monitoring, observability, resiliency, and operational support best practices. Certifications (Preferred) - Microsoft Fabric Analytics Engineer Associate - Microsoft Power Platform Certifications - Azure Data Engineer Associate - Azure Solutions Architect Expert - Relevant analytics, integration, or automation certifications What We Look For We are seeking a highly motivated and innovative cloud engineer who is passionate about building modern analytics, automation, and integration platforms that enable data-driven decision making and operational excellence. The ideal candidate combines deep technical expertise in Microsoft Fabric, cloud automation, and enterprise integration with strong business acumen and a collaborative mindset. The successful candidate will demonstrate: - Proven experience delivering enterprise-scale analytics, integration, and automation solutions. - Strong expertise in modern cloud-native architecture, workflow automation, and operational intelligence. - Curiosity and enthusiasm for adopting AI, analytics, GenAI, and intelligent automation capabilities. - The ability to lead technical discussions and influence architectural decisions. - A commitment to quality, governance, security, resiliency, and operational excellence. - Strong interpersonal skills and the ability to collaborate effectively across business and technology teams. - A continuous improvement mindset with a focus on innovation, automation, and measurable business outcome What working at EY offers We offer a competitive remuneration package where you’ll be rewarded for your individual and team performance. Our comprehensive Total Rewards package includes support for flexible working and career development, and with FlexEY you can select benefits that suit your needs, covering holidays, health and well-being, insurance, savings and a wide range of discounts, offers and promotions. Plus, we offer: - Support, coaching and feedback from some of the most engaging colleagues around - Opportunities to develop new skills and progress your career - The freedom and flexibility to handle your role in a way that’s right for you EY | Building a better working world EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets. Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate. Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.