Senior Biomedical AI Evaluation Expert

About the role

We are seeking a Senior Biomedical AI Evaluation Expert to lead the assessment of generative AI solutions for life‑science applications. You will ensure that AI outputs align with real‑world scientific knowledge and support pharmaceutical safety and efficacy decisions.

Key responsibilities

• Design customer‑focused success criteria for AI solutions using scientific expertise.
• Prepare evaluation sets through AI‑assisted and human review tailored to product use cases.
• Manage and participate in expert human and automated evaluation of GenAI outputs.
• Support the development of automated evaluation methods, validated by subject‑matter experts.
• Oversee SME evaluators to score GenAI output via formal evaluation and user feedback.
• Align evaluation activities with Operations, Product, and Marketing strategies.
• Translate evaluation findings into clear, documented recommendations for stakeholders.

Required profile

• Strong academic background in life sciences (e.g., bioinformatics, cheminformatics, biochemistry, medicinal chemistry, pharmacology).
• Experience evaluating or validating AI/algorithmic outputs with scientific data.
• Proven ability to work with structured data environments such as databases or taxonomies.
• Solid understanding of data flows, APIs, and version‑control systems.
• Effective collaboration in matrixed, cross‑functional teams.
• Strong management and communication skills for expert audiences.

Required skills

• GitHub
• APIs