Strategy Consultant – AI Training & Evaluation

About the role

Join Toloka AI’s new Management Consulting domain to translate real‑world consulting engagements into structured learning environments for advanced AI systems. This remote, project‑based position focuses on designing realistic consulting scenarios that help train and evaluate large language models.

Key responsibilities

• Create detailed, industry‑specific project scenarios that reflect real engagement dynamics, including financials, constraints, and incomplete information.
• Design structured consulting tasks for AI agents such as market sizing, commercial due diligence, cost optimization, growth strategy, and operational diagnosis.
• Develop evaluation criteria, grading frameworks, and golden‑answer solutions to calibrate an LLM‑based grading system.
• Collaborate with a team of former top‑tier consultants to ensure authenticity and rigor of the learning environments.

Required profile

• 3+ years of hands‑on consulting experience at McKinsey, BCG, Bain, Oliver Wyman, Roland Berger, Monitor Deloitte, EY‑Parthenon, Kearney, or Strategy&.
• Proven ability to structure ambiguous problems, build financial models or market analyses, and deliver client‑ready recommendations under tight deadlines.
• Experience presenting and defending recommendations in uncertain, data‑limited contexts.

Required skills