Senior Data Analyst - AI Evaluation (Life Sciences).

Senior Data Analyst - AI Evaluation (Life Sciences).

Automate and conduct LLM-as-jury evaluations to improve AI-powered life sciences solutions through scientific expertise and rigorous analysis.

About our Team: We are a growing team working on the evaluation of AI systems in development and on cross-domain harmonization. Our mission is to enable better, more trustworthy AI-driven products by combining scientific expertise with rigorous evaluation and AI-ready data. We generate actionable evidence that accelerates product improvement, and we unlock greater value from curated scientific knowledge by making it interoperable, interpretable, and reliably usable by AI across domains.

About the Role: The Senior Data Analyst - AI Evaluation will support the evaluation of AI-powered solutions that use life sciences, chemistry, and regulatory data. Working with scientific domain experts, product, data science, and engineering teams, you will contribute to evaluation strategies and rubrics, evaluation scenarios, and acceptance criteria that reflect customer needs and product goals. A key focus of this role is adapting and validating automated evaluation approaches. Using an “LLM as jury” framework, you will tailor evaluation criteria and methods to specific products, use cases, and metrics. You will assess the reliability of automated judgments, identify gaps or inconsistencies, and refine the approach in collaboration with relevant experts. Through structured analysis, domain-informed judgment, and iterative validation you will contribute to more robust evidence of quality, faster feedback cycles for product development, and stronger alignment with real-world scientific and customer requirements.