Loading...
Mercor is seeking a Bilingual German STEM Expert who is native to Switzerland (German-speaking), Germany, or Austria, with experience in biology / physics / chemistry theory and problem-solving, to develop and refine high-quality reasoning questions that evaluate AI models.
Your expertise in biology / physics / chemistry will ensure the scientific accuracy, rigor, and instructional quality of these assessment items. You will create and evaluate German/English prompts and responses, ensuring scientific precision while maintaining clear, natural German phrasing consistent with academic conventions in Switzerland (German-speaking), Germany, or Austria, and alignment with English where needed.
Create detailed prompts in German and/or English with multiple constraints and scientifically accurate instructions.
Establish high-level expectations for correct responses in STEM contexts, and develop comprehensive rubrics that account for scientific rigor and—when written in German—linguistic clarity, regionally appropriate terminology (Switzerland [German-speaking], Germany, or Austria usage), and academic tone.
Run prompts through AI models and assess preliminary outputs against expectations for scientific accuracy, reasoning quality, and clarity. Compare German and English responses where needed.
Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific standards. Maintain consistency and reliability across German-language benchmarks prior to integration into official evaluation sets.
Apply directly on Mercor to get started.