Oliver Wyman—Senior Principal Engineer - IT Quality & Assurance Testing

Job description

Description: Company: Marsh Description: We are seeking a talented individual to join People and Investment at Marsh . This role will be based in Gurugram/Noida/Pune.This is a hybrid role that has a requirement of working at least three days a week in the office Senior Principal Engineer/Manager - IT Quality & Assurance Testing A visionary forward thinker who views Quality holistically and can drive a Quality Engineering mindset across traditional software and AI-powered applications. Understanding industry trends, tools and practices and implementing the right approaches to deliver high-quality, scalable and reliable software. We will count on you to: - Strong understanding of Quality Engineering, Manual Testing, Automation and AI/LLM Testing. - Strong experience with Playwright, WebdriverIO/Selenium, Python, JavaScript/TypeScript and Java. - Good knowledge of UI, API, SQL/Database and data validation testing. - Understanding of RAG, embeddings, vector databases, semantic search, retrieval and LLM evaluation. - Experience with AI/LLM evaluation and testing tools such as PromptFoo, Ragas, DeepEval, LangSmith and PyRIT. - Understanding of AI security, prompt injection, jailbreaks, hallucination, guardrails, red-team testing and responsible AI. - Experience with GitHub and CI/CD pipelines. - Experience building and maintaining scalable automation frameworks. - Proven experience managing, mentoring and developing QA/Quality Engineering teams. - Strong communication, stakeholder management, analytical and problem-solving skills. - Ability to evaluate emerging technologies and introduce effective testing solutions. - Passion for AI, automation, Quality Engineering and continuous improvement. - Work within a global firm with exposure to complex delivery environments and multiple stakeholders. - Opportunity to drive modern QA practices, continuous improvement, and measurable quality outcomes. - Support for development through on-the-job learning and access to internal learning resources. What you need to have? - 7+ years' experience in Software Testing / Quality Engineering with experience in managing end-to-end project delivery. - Proven experience leading QA teams across Manual, Automation and AI/LLM testing. - Strong understanding of STLC, SDLC, Agile, test strategy, test planning, risk management, defect management and quality metrics. - Experience defining testing strategies for Web/UI, API, Database, AI/LLM, RAG and AI-powered applications. - Strong automation experience using Python, JavaScript/TypeScript, Java, Playwright, Selenium and WebdriverIO (WDIO). - Opportunity to drive modern QA practices, continuous improvement, and measurable quality outcomes. - Support for development through on-the-job learning and access to internal learning resources. What makes you stand out? - Good understanding of API testing, SQL, relational databases and data validation. - Understanding of RAG architecture, embeddings, vector databases, semantic search, retrieval and reranking. - Experience with Generative AI, LLM evaluation, prompt engineering, AI agents and AI safety testing. - Experience with AI/LLM testing and evaluation frameworks such as PromptFoo, Ragas, DeepEval, LangSmith and PyRIT, or similar tools. - Strong understanding of AI quality and security risks including prompt injection, jailbreaks, hallucination, data leakage, guardrails and responsible AI. - Experience with modern DevOps and test automation practices, including Git, GitHub, GitHub Actions and CI/CD pipeline integration. - Strong communication, stakeholder management, analytical and people leadership skills. Why join our team: - We help you be your best through professional development opportunities, interesting work and supportive leaders. - We foster a vibrant and inclusive culture where you can work with talented colleagues to create new solutions and have impact for colleagues, clients and communities. - Our scale enables us to provide a range of career opportunities, as well as benefits and rewards to enhance your well-being. Marsh (NYSE: MRSH) is a global leader in risk, reinsurance and capital, people and investments, and management consulting, advising clients in 130 countries. With annual revenue of over $27 billion and more than 95,000 colleagues, Marsh helps build the confidence to thrive through the power of perspective. For more information, visit corporate.marsh.com, or follow us on LinkedIn and X. Marsh is committed to embracing a diverse, inclusive and flexible work environment. We aim to attract and retain the best people and embrace diversity of age, background, caste, disability, ethnic origin, family duties, gender orientation or expression, gender reassignment, marital status, nationality, parental status, personal or social status, political affiliation, race, religion and beliefs, sex/gender, sexual orientation or expression, skin color, or any other characteristic protected by applicable law. Marsh is committed to hybrid work, which includes the flexibility of working remotely and the collaboration, connections and professional development benefits of working together in the office. All Marsh colleagues are expected to be in their local office or working onsite with clients at least three days per week. Office-based teams will identify at least one “anchor day” per week on which their full team will be together in person Marsh (NYSE: MRSH) is a global leader in risk, reinsurance and capital, people and investments, and management consulting, advising clients in 130 countries. With annual revenue of over $27 billion and more than 95,000 colleagues, Marsh helps build the confidence to thrive through the power of perspective. For more information, visit marsh.com, or follow us on LinkedIn and X. Marsh is committed to embracing a diverse, inclusive and flexible work environment. We aim to attract and retain the best people and embrace diversity of age, background, caste, disability, ethnic origin, family duties, gender orientation or expression, gender reassignment, marital status, nationality, parental status, personal or social status, political affiliation, race, religion and beliefs, sex/gender, sexual orientation or expression, skin color, or any other characteristic protected by applicable law. Marsh is committed to hybrid work, which includes the flexibility of working remotely and the collaboration, connections and professional development benefits of working together in the office. All Marsh colleagues are expected to be in their local office or working onsite with clients at least three days per week. Office-based teams will identify at least one “anchor day” per week on which their full team will be together in person.