Chemistry (PhD) Expert - Ai Training Evaluation

Job Description

Job Description

Engagement Type: Independent Contractor
Work Mode: Fully Remote
Schedule: Flexible (Project-Based)

We partner with leading AI teams to improve the quality, usefulness, and reliability of conversational AI systems.

In chemistry-related contexts, AI systems must demonstrate:

• Accurate mechanistic reasoning

• Quantitative precision

• Strong command of chemical theory and application

This role focuses on evaluating and improving how AI models reason about, explain, and communicate chemistry concepts across foundational and advanced topics.

• Write and refine prompts to guide AI model behavior in chemistry contexts

• Evaluate AI-generated responses for:

  • Scientific accuracy

  • Mechanistic correctness

  • Quantitative reasoning

• Conduct fact-checking using authoritative sources and domain expertise

• Annotate responses by identifying:

  • Strengths

  • Weak reasoning

  • Conceptual inaccuracies

• Assess explanation clarity and structure for different audience levels

• Ensure responses align with conversational guidelines and evaluation standards

• Apply structured taxonomies, benchmarks, and detailed review frameworks

• PhD in Chemistry or a closely related field

Deep expertise in one or more of the following domains:

• Organic Biological Chemistry

• Inorganic Materials Chemistry

• Physical Theoretical Chemistry

• Analytical Instrumental Chemistry

Additional Requirements:

• Significant experience using large language models (LLMs)

• Strong understanding of how LLMs are used and where they fail

• Excellent technical writing and explanation skills

• Exceptional attention to detail

• Experience reviewing or editing academic or technical writing

• Experience with RLHF, AI model evaluation, or data annotation

• Teaching or mentoring experience

• Familiarity with structured evaluation rubrics or benchmarking systems

• You identify subtle inaccuracies or weak reasoning in chemistry outputs

• Your feedback improves scientific rigor and clarity

• You deliver reproducible evaluation artifacts

• AI systems become more reliable in chemistry-related applications

• Apply PhD-level expertise to frontier AI development

• Contribute to high-impact AI research beyond traditional academic roles

• Flexible schedule with project-based autonomy

• Competitive compensation aligned with expertise

• Independent Contractor engagement

• Fully remote with flexible working schedule

• Project-based work (may be extended or concluded based on needs and performance)

• Weekly payments via Stripe or Wise

• Unable to support H1-B or STEM OPT candidates at this time