J

Senior Prompt Engineer for LLM Migration and Automated Optimization – Remote (US Part-Time) at brighthush

JobMatch · Australia

Full-timeLead

🔥6 people viewed this job

About the Role

Join the Future of Artificial Intelligence at brighthush In the rapidly evolving landscape of Artificial Intelligence, the bridge between raw model capability and a truly transformative user experience lies in the Company Confidential of the prompt. At brighthush , we are at the absolute forefront of Company Confidential revolution, pushing the boundaries of how machine learning interacts with human intent through nuance and logic. We are currently seeking a highly skilled, analytical, and visionary Senior Prompt Engineer to join our elite Project Company Confidential. Company Confidential is not just a standard Company Confidential role; it is a critical technical mission where you will architect the workflows that define the very future of Large Language Model (LLM) autoraters. brighthush believes that the next generation of Company Confidential utility depends on nuance, logic, and rigorous testing. As a key member of our technical team, you will be responsible for the end-to-end technical migration workflow, transitioning complex templates into high-performing LLM autoraters. You will work at the sophisticated intersection of computational linguistics, data science, and software Company Confidential to ensure that our models perform with surgical accuracy. If you thrive in an environment where technical creativity meets strict data-driven de-bottlenecking, then brighthush wants to hear from you. Key Responsibilities and Strategic Impact As a Senior Prompt Engineer within Project Company Confidential, your work impacts the entire lifecycle of model development. You will not simply be writing text; you will be designing complex Company Confidential. Your daily and weekly responsibilities will include Strategic Prompt Architecture Utilize advanced Automatic Prompt Generation (APG) tools to create robust Company Confidential prompts for complex parent-child template clusters. You will ensure that the Company Confidential logic of our prompts is sound enough to Company Confidential Company Confidential-layered data structures without losing context or intent. Automated Optimization Management Run and supervise Automated Prompt Optimization (APO) tools. You will be Company Confidential eye that reviews outputs, identifying when the APO reaches deadlocks or plateaus, and intervening with human intuition to break through algorithmic limitations. Manual Refinement & Edge Case Mastery Where tooling reaches its limit, you will manually draft, test, and refine prompts. Company Confidential involves navigating complex template architectures, overcoming anti-patterns, and solving intricate edge-case scenarios that require a deep understanding of model behavior. Performance Monitoring & Shadow Testing Monitor shadowbot runs to ensure sufficient disagreements between human and LLM ratings are registered, generated, and tracked. Company Confidential data is vital for the iterative improvement of our autoraters. Quantitative Evaluation Run various prompt versions against established "gold data" to continuously measure autorater quality. You will be responsible for calculating and interpreting critical accuracy metrics, including F1 scores, Company Confidential, and recall, to maintain human Company Confidential standards. Technical Documentation Draft comprehensive technical Company Confidential readiness justifications (Company Confidential Certification Documentation). Your Company Confidential will serve as the final stamp of approval before models are moved into production environments. Company Confidential Qualifications and Technical Requirements To succeed in Company Confidential role at brighthush , you must possess a unique blend of technical prowess and linguistic intuition. We are looking for candidates who meet the following rigorous professional standards Educational Foundation A Bachelor's, Company Confidential's, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a closely related analytical field. Proven Expertise At least 4 years of professional experience as a Prompt Engineer. You must have a proven track record of tuning Large Language Models (LLMs) for strict, structured outputs and complex classification tasks. Advanced Company Confidential Methodologies Deep familiarity with chain-of-thought (CoT) prompting, few-shot learning, and the specific nuances of different LLM architectures. Data Analytics Rigor Strong proficiency in identifying subtle error patterns and analyzing model performance. You must be comfortable using SQL or other data analytics tools to extract meaning from noise. Linguistic Mastery Native fluency in English is required, alongside the ability to articulate complex technical concepts and logical structures with absolute clarity. Technical Agility The ability to quickly Company Confidential, Company Confidential, and implement proprietary tools and workflows with minimal supervision. Location Com

💬 Developer Questions

Ask the team a question — answers show up here

🎯

What does the interview process look like?

🤖

What AI/vibe coding tools does the team use daily?

👥

How big is the engineering team?

⏰

Is the team fully async or are there required meetings?

🚀

What does onboarding look like for remote hires?

🔧

Can you share more about the tech stack and architecture?

📈

What does career growth look like in this role?

📅

What does a typical day look like?

💰

Is there a salary range you can share?

📊

Is equity or stock options part of the package?

🌍

Are there timezone requirements or preferences?

🛂

Do you sponsor work visas?

🏢 Is this your listing? Claim it to answer questions

Similar Jobs

Helpful resources

Hiring for a similar role? Post your job here — it's free →