Microsoft—Data Engineer 2

Job description

Description: Overview The Windows and Devices mission is to build innovative, trusted, and open products and platforms that are centered on people, showcase the best of Microsoft, and empower every person and organization on the planet to achieve more. To achieve this mission, Microsoft Devices designs and manufactures 1st party premium hardware products including Surface, Xbox Gaming, HoloLens and Accessories. From product creation through product delivery, we innovate in technology and processes across our supply and manufacturing base. Within the Windows and Devices (W+D) organization, we are the Microsoft Devices Operations organization. Our mission to enrich work, life, and play by bringing iconic Microsoft products to life, and we accomplish this by managing a highly leveraged, fully digitized supply base that meets our product and business goals. As part of our scope, we manage New Product Introduction, Product Engineering, Strategic Sourcing, Global Manufacturing Operations, Manufacturing Test & Infrastructure (MTI), Supply Chain, and Device Services. Data is a key strategic asset for running Microsoft Devices Operations. If you are looking for the opportunity to build highly scalable services and rich data insights on Azure, then MDO is the right place for you to come and take on your next challenge. We are seeking a skilled Data Engineer II to join our dynamic team. The ideal candidate should have a solid background in data engineering, a passion for working with large datasets, and a drive to help our organization make data-driven decisions. You will be responsible for building, maintaining, and optimizing data pipelines and systems, ensuring data quality and availability, and supporting our data analytics, AI and ML initiatives. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. Responsibilities - As a Data Engineer in MDO, you will drive critical initiatives to help our data platform scale to the needs of business priorities and technology advancements. - Build scalable data models and data pipelines to extract, load and transform data, ensure secure data storage, with focus on data quality and compliance on Azure using services (ADF, HDI, Databricks, Fabric/Synapse etc.). - You will play a critical role in developing and building datasets and integrate with AI/ML and Co-Pilot applications. - Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. - Implement and manage CI/CD(YAML + Classic) pipelines for data engineering projects, leveraging tools like Azure DevOps. - You will anticipate data governance needs, designing data modeling and handling procedures to ensure compliance with all applicable laws and policies. You’ll also govern data accessibility within your assigned pipelines. - Acts as a Designated Responsible Individual (DRI) and guides other engineers by developing and following the playbook, working on call to monitor system/product/service for degradation, downtime, or interruptions, alerting stakeholders about status and initiates actions to restore system/product/service for simple and complex problems when appropriate. Qualifications Preferred Qualifications: - Bachelor’s degree in computer science, Engineering, or a related field. - OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field. - OR equivalent experience. - Experience with building data pipelines and data stores. - 6+ years of experience in data engineering or a similar role. - Proficiency in programming languages such as Python, Scala. - Solid experience with SQL and database technologies. - Familiarity with big data technologies (e.g., Hadoop, Spark). - Excellent communication and interpersonal skills are required. - Experience with data visualization tools (e.g., Tableau, Power BI) is a plus. - Experience in working and integrating with AI/Co-Pilot applications. #W+DJOBS #MDO This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.