Mercor is seeking a Bilingual Italian STEM Expert who is native to Italy or Italian-speaking Switzerland, with experience in biology / physics / chemistry theory and problem-solving, to develop and refine high-quality reasoning questions that evaluate AI models.

Your expertise in biology / physics / chemistry will ensure the scientific accuracy, rigor, and instructional quality of these assessment items. You will create and evaluate Italian/English prompts and responses, ensuring scientific precision while maintaining clear, natural Italian phrasing consistent with academic conventions in Italy or Italian-speaking Switzerland, and alignment with English where needed.

Job Details
Design and Optimize STEM-Based Prompts (Bilingual)

Create detailed prompts in Italian and/or English with multiple constraints and scientifically accurate instructions.

Define and Document Evaluation Standards

Establish high-level expectations for correct responses in STEM contexts, and develop comprehensive rubrics that account for scientific rigor and—when written in Italian—linguistic clarity, regionally appropriate terminology (Italy or Italian-speaking Switzerland usage), and academic tone.

Conduct Model Testing and Grading (Bilingual)

Run prompts through AI models and assess preliminary outputs against expectations for scientific accuracy, reasoning quality, and clarity. Compare Italian and English responses where needed.

Support Benchmarking and Quality Assurance

Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific standards. Maintain consistency and reliability across Italian-language benchmarks prior to integration into official evaluation sets.

Minimum Qualifications

Native-level fluency in Italian (written), specifically native to Italy or Italian-speaking Switzerland

Strong reading and writing proficiency in English

BS or BA in Biology / Physics / Chemistry

Familiarity with undergraduate-level biology / physics / chemistry topics

Strong writing and critical thinking skills

Ability to work independently and meet deadlines

Preferred Qualifications

2+ years of experience in teaching, research, or an applied STEM discipline

Experience working with Italian or Swiss secondary/university STEM curricula

Application & Onboarding Process

Complete a short AI-led interview (approximately 15 minutes)

Then, if selected, you will be invited to work on the project.

More Details About This Role

Expected commitment: Minimum 20 hours per week

Work environment: Structured project setting with defined goals, tools, and review processes

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.