Internet-Native Bilingual Evaluator Expert (French)

Mercor is seeking Internet-Native Bilingual Evaluator Experts (French–English) to contribute to cutting-edge AI research focused on multilingual communication, internet culture, and real-world language use. This role is ideal for individuals who actively participate in both French- and English-language online communities and understand how internet culture, slang, humour, and social norms differ across languages.

Job Responsibilities

Evaluate Internet-Native Communication

• Analyse content from French- and English-speaking online communities.
• Evaluate AI outputs for linguistic accuracy, cultural relevance, and internet authenticity.
• Identify errors involving slang, memes, cultural references, sarcasm, and code-switching.

Develop Evaluation Standards

• Build evaluation rubrics for bilingual internet communication.
• Define expectations for culturally appropriate and platform-native language.
• Document linguistic and cultural edge cases.

Conduct Model Testing and Feedback

• Test language models using real-world bilingual prompts.
• Evaluate outputs in English and French.
• Provide detailed feedback to improve performance.

Support Quality Assurance

• Participate in QA reviews and benchmark creation.
• Ensure consistency across evaluators and datasets.

Minimum Qualifications

• Native or near-native fluency in French and professional fluency in English.
• Strong familiarity with online communities across France, Québec, Belgium, Switzerland, or other French-speaking regions.
• Active participation in internet culture across both languages.
• Strong writing, analytical, and critical thinking skills.
• Available to commit 10–20 hours per week.

Preferred Qualifications

• Background in linguistics, translation, localisation, social media, journalism, humanities, or AI evaluation.
• Familiarity with differences between European French, Québec French, and other French varieties.
• Experience evaluating online content and internet-native communication.
• Interest in AI and multilingual language technologies.