Prompt Engineering Fellow

ABOUT KHAN ACADEMY Khan Academy is a nonprofit with the mission to deliver a free, world-class education to anyone, anywhere. Our proven learning platform offers free, high-quality supplemental learning content and practice that cover Pre-K - 12th grade and early college core academic subjects, focusing on math and science. We have over 155 million registered learners globally and are committed to improving learning outcomes for students worldwide, focusing on learners in historically under-resourced communities. OUR COMMUNITY Our students, teachers, and parents come from all walks of life, and so do we. Our team includes people from academia, traditional/non-traditional education, big tech companies, and tiny startups. We hire great people from diverse backgrounds and experiences because it makes our company stronger. We value diversity, equity, inclusion, and belonging as necessary to achieve our mission and impact the communities we serve. We know that transforming education starts in-house with learning about ourselves and our colleagues. We strive to be world-class in investing in our people and commit to developing you as a professional. THE ROLE As a Prompt Engineering Fellow, you’ll take responsibility for the scoping, development, evaluation, and maintenance of generative AI prompts and flows that drive Khanmigo experiences, collaborating with our Product Management, Design, Engineering, and Content teams to develop new tools and processes that ensure output consistency and quality. Discover, develop, test, and document best practices for prompt development and evaluation. Work with User Research and Product Management to prioritize and implement high impact prompt engineering projects. Collaborate with designers, product managers, and engineers to create prompt-driven features that support education use cases. WHAT YOU BRING Growth mindset A true passion for education and a desire to change the world for the better. An entrepreneurial mindset, including a high tolerance for ambiguity, a penchant for experimentation, and a bias towards action. Kind collaboration: you’re a detail-oriented team player, and people love working with you. Outstanding creative problem-solving skills: you embrace challenges, and love working cross-functionally to clarify requirements and solve puzzles. You enjoy identifying core principles that can translate across scenarios. You know how to troubleshoot issues with performance and can devise creative solutions to improve the user experience. Strong execution Technical Proficiency: You have 2+ years of experience utilizing relevant programming languages (such as Python) to build software solutions, and you are familiar with tools relevant to emerging best practices in generative AI implementation. Prompt design and evaluation: You understand what generative AI models are good at and how to elicit the best performance from them. You have an engineer’s knack for structured, analytical thought, and you’re detail-oriented with high standards for quality. You understand techniques—including chaining, RAG, agents, and fine-tuning—for guiding generative AI outputs in service of a robust and performant enterprise product. Testing and quality assurance: You’re committed to a careful, iterative, data-driven approach for optimization, innovation, and continuous experimentation. You have experience developing evaluation data sets for benchmarking model fit and prompt performance. You have a solid understanding of classrooms and learning science and/or an eagerness to learn. Data Analysis: You know how to analyze interaction data, both programmatically and manually, to identify actionable insights to optimize the user experience. Strategic thinking: You have experience using data to inform strategic decisions. Research: You keep informed about developments in AI, and take an active interest in emerging research and industry trends, and you understand their implications for our product’s competitiveness and performance. Communication: Your strong communication skills help you collaborate effectively with cross-functional teams, including educators, developers, and designers. You can teach technical concepts and create high quality documentation. Collaboration: You have a history of working cross-functionally to achieve shared success in organization-wide goals and projects. Growth mindset: You’re adaptable to a fast-paced environment, and open to learning new tools and tech. Ethical Considerations and Bias Mitigation: You’re aware of ethical considerations in AI and machine learning, especially in an educational context, and are familiar with strategies for mitigating bias. Background/experience Bachelor’s degree, with a concentration in Computer Science or learning science preferred; Master’s degree preferred. 2-3 years of relevant or transferrable experience (for example: software engineering, MLops, machine translation, other development of AI-po