About the Role
About OpenTrainOpenTrain AI is the hiring and contracting organization for this role. OpenTrain is the #1 platform for finding and building careers in AI training and data labeling, helping contributors discover projects, build a professional profile, and apply in minutes.
Creating an OpenTrain account is free, and this opportunity is available as a remote contractor role worldwide.
About AI Training and LLM EvaluationAI training is the human side of building artificial intelligence. People create examples, review model outputs, write feedback, and design evaluations that help modern AI systems become more accurate, useful, and reliable.
In this role, your physics expertise will help test how well large language models handle abstraction, symbolic manipulation, multi-step reasoning, and advanced scientific concepts.
Remote work that can fit around other commitmentsDirectly contribute to the development and evaluation of cutting-edge AI systemsUse advanced subject knowledge in a specialized AI training projectThe Physics LLM Evaluation Expert RoleOpenTrain is recruiting an expert in physics and related STEM fields to help fine-tune and evaluate large language models. You will create difficult problems that test model limits, produce high-quality step-by-step solutions, and collaborate with LLM researchers on evaluation goals.
The work spans physics curricula from early undergraduate through PhD-level topics. It emphasizes rigorous reasoning, clear communication, abstraction, symbolic manipulation, and the design of new evaluation benchmarks.
Role type: Part-time contractorTime requirement: 20+ hours per weekWork arrangement: Remote and worldwideLanguage: EnglishExperience level: ExpertData focus: Text generation and evaluation ratingWhat You'll DoYou will turn advanced physics knowledge into precise, challenging evaluation material. Your work will help researchers understand where language models succeed, where they fail, and how their reasoning can be assessed more effectively.
Design and solve challenging STEM problems that probe model limitations.Write clear, detailed, step-by-step solutions with well-articulated reasoning.Collaborate with LLM researchers to align problems with evaluation goals.Help define new evaluation benchmarks based on physics curricula.Break down complex STEM concepts into simple, precise explanations.Provide detailed annotations and constructive feedback.Required QualificationsThis position is intended for an experienced STEM specialist who can reason carefully through advanced physics problems and communicate solutions in structured English. Your background should be consistent with graduate, PhD, or postdoctoral STEM study or work.
Strong analytical and research abilitySolid STEM background, especially in physics, mathematics, and related sciencesGraduate, PhD, or postdoctoral STEM backgroundExcellent English comprehension and structured communicationAbility to write clear step-by-step solutionsExperience with abstraction, multi-step reasoning, or symbolic manipulationAbility to work independently in a remote settingHelpful BackgroundApplied physics or a related STEM specialization is helpful. You should also be comfortable explaining difficult physics concepts in simple language and using clear visuals and reasoning when appropriate.
Applied Physics specializationExperience explaining complex physics concepts clearlyComfort with abstract reasoning and symbolic manipulationExperience developing or assessing challenging problem-solving tasksHow to Apply Through OpenTrainCreate a free OpenTrain account, build your profile around your physics and STEM expertise, and apply for this contract opportunity in minutes. If selected, you will contribute to text-based LLM evaluation work as part of a flexible, remote AI training career.
Create or update your free OpenTrain profileHighlight graduate, PhD, or postdoctoral STEM experienceShowcase physics reasoning, communication, and evaluation strengthsApply for the role and follow the project instructions
