Senior Product Design And Vibecoding AI Evaluator

About OpenTrainOpenTrain AI is the hiring and contracting organization for this role. OpenTrain is the #1 platform for finding and building careers in AI training and data labeling, helping contributors discover projects, build a professional profile, and apply in minutes. This opportunity lets experienced product designers and AI-native engineers contribute directly to the development and evaluation of advanced AI systems while building experience in a fast-growing technical field. Remote contractor opportunityOpen to contributors worldwideApply through OpenTrainAbout AI Evaluation WorkAI training is the human side of building artificial intelligence. People create examples, review model outputs, and establish standards that help AI systems become more useful, reliable, and aligned with real-world expectations. In this role, your product judgment will help distinguish strong AI-assisted prototypes, code artifacts, design systems, and user experiences from generic or incomplete work. Work on cutting-edge AI-assisted development and design evaluationCreate human-authored examples and standards for model assessmentUse product and usability judgment to assess AI-generated workThe RoleOpenTrain is seeking a Senior Product Design and Vibecoding AI Evaluation Expert to design evaluation scenarios, draft reference outputs, and write rubrics for AI systems working across rapid prototyping, product design, and human-AI collaborative coding. The role combines two connected tracks: vibecoding, or AI-assisted software development driven by natural-language instructions, and product design spanning UX/UI and visual design systems. You will create materials that capture senior-level product builder judgment rather than generic execution. Role focus: AI evaluation for product design and vibecodingData work includes evaluation rating and text generationPrimary working language: EnglishWhat You'll DoYou will translate senior product and design expertise into practical evaluation tasks, reference artifacts, and assessment criteria. The work requires iterative prompt-driven development alongside human-centered design methods. Design scenarios spanning rapid prototyping and design system developmentBuild evaluation tasks for AI-assisted application development and UX/UI designProduce reference prototypes and code artifactsCreate design specifications and usability evaluation reportsAuthor rubrics that capture senior product builder judgmentApply iterative prompt-driven development methodologiesApply human-centered design methodologiesRequired Experience And SkillsThis role requires substantial professional experience in product design, design leadership, or AI-native engineering. Candidates should have directly owned production-shipped design systems or AI-assisted development workflows and be comfortable using relevant design or vibecoding tools. A portfolio of shipped work is preferred. Previous rubric or training authorship is a plus, but it is not listed as a required qualification. 5+ years as a product designer, design lead, or AI-native engineerExperience at a major product-forward company such as Figma, Airbnb, Notion, or LinearDirect ownership of product design systems or AI-assisted development workflows shipped to productionFluency in Cursor, Claude Code, v0, or Replit, or in Figma or FramerUnderstanding of user-centered design principles and rapid prototypingPortfolio of shipped work preferredPrior rubric or training authorship is a plusPay, Schedule, And Work ArrangementThe listed pay range is $70-$80 per hour, with the structured rate showing up to $80 per hour. The opportunity is remote and available on a contractor, part-time basis. The role description lists a 40-hour-per-week commitment, while the structured listing specifies a minimum time requirement of 20+ hours per week. Review the expected schedule during the application process. Pay: $70-$80 per hourRemote work arrangementContractor engagementPart-time classificationSchedule information includes 40 hours per week and a 20+ hour minimumWhy This Work MattersEvery major AI system depends on human contributors who prepare examples, evaluate outputs, and define what quality looks like. By creating rigorous product and coding evaluation materials, you can help shape how AI systems support real product-building workflows. AI training and data-labeling work can be performed remotely with flexible project structures, and specialist expertise is especially valuable for technical evaluation assignments like this one. Help shape the behavior and capabilities of modern AI systemsApply specialized product design and AI-assisted development expertiseContribute to the evolving field of human-AI collaborationHow To ApplyCreate a free OpenTrain account to build your profile and apply to this opportunity in minutes. Highlight your relevant product design, AI-native engineering, shipped systems, prototyping, tool fluency, and evaluation or rubric experience.