About the Role
This role is for one of our clients
Pay: 150–200/hour
Role Type: Contractor
Location: Remote
We are seeking a motivated and detail-oriented Junior Software Engineer to contribute to the evaluation and improvement of advanced artificial intelligence systems. This opportunity is ideal for early-career software engineers with strong programming fundamentals, analytical thinking, and practical experience developing and reviewing software applications.
In this role, you will evaluate AI-generated code for correctness, quality, efficiency, and design. You will create challenging programming problems, develop reference solutions and test cases, and assess AI models' ability to solve real-world software engineering challenges. You will also review technical reasoning related to debugging, architecture, and system design, providing structured feedback to improve the reliability and performance of AI-generated solutions.
The ideal candidate has professional software engineering experience, a solid understanding of programming principles, and the ability to explain technical decisions clearly. Prior experience in artificial intelligence is not required.
Key Responsibilities
AI-Generated Code Evaluation: Review AI-generated code for functional correctness, readability, maintainability, efficiency, and adherence to software engineering best practices.Coding Problem Development: Design challenging programming problems that assess algorithmic thinking, debugging skills, implementation quality, and practical engineering judgment.Reference Solution Creation: Develop accurate, well-structured reference solutions that demonstrate effective approaches to solving software engineering problems.Test Case Development: Create comprehensive test cases to validate functionality, identify edge cases, and detect incomplete or incorrect implementations.Technical Reasoning Assessment: Evaluate AI-generated explanations and decisions involving software architecture, system design, debugging, and implementation strategies.Code Quality Analysis: Identify bugs, inefficient algorithms, poor design choices, security concerns, and violations of established coding standards.Technical Feedback: Provide detailed, actionable feedback explaining errors, weaknesses, and opportunities to improve code quality and model performance.Documentation: Clearly document problem requirements, expected behavior, solution approaches, testing procedures, and technical evaluation findings.Quality Assurance: Ensure that coding tasks, reference solutions, and evaluation criteria are accurate, consistent, and reproducible.Required Qualifications
At least one year of professional experience as a software engineer at a well-established technology company.At least part of the relevant professional experience should have been gained within the past three years.Strong understanding of programming fundamentals, data structures, algorithms, and object-oriented programming.Practical experience writing, debugging, testing, and reviewing code.Familiarity with software development practices, including version control, code reviews, testing, and debugging.Ability to assess code for correctness, performance, readability, and maintainability.Foundational understanding of software architecture and system design principles.Strong analytical and problem-solving skills.Excellent written communication skills, with the ability to explain technical decisions and complex engineering concepts clearly.Ability to work independently and deliver accurate, high-quality technical assessments.Must-Have Skills
Software Engineering FundamentalsProgramming and CodingData Structures and AlgorithmsCode Review and Quality AssessmentDebugging and TroubleshootingAutomated Testing and Test Case DevelopmentProblem-Solving and Logical ReasoningTechnical Documentation and Written CommunicationGood-to-Have Skills
Python, Java, C++, JavaScript, TypeScript, Go, or similar programming languagesObject-Oriented Programming and Design PatternsAPI Development and Backend EngineeringSoftware Architecture and System DesignPerformance Optimization and ProfilingGit and Version ControlUnit Testing and Integration TestingCI/CD and Software Development WorkflowsAI-Generated Code EvaluationFamiliarity with AI coding assistants and model benchmarkingPreferred Qualifications
Professional software engineering experience at a recognized technology company.Experience developing and maintaining production-quality applications, services, or APIs.Familiarity with reviewing complex codebases and identifying implementation weaknesses.Experience designing coding exercises, technical assessments, or automated evaluation tests.Candidates based in English-speaking countries are preferred.Ability to communicate technical findings in clear, structured, and concise English.
The weekdays and weekend are the complementary parts of the week, devoted to labour and rest, respectively. The legal weekdays, or workweek, is the part of the seven-day week devoted to working. In most of the world, the workweek is from Monday to Friday and the weekend is Saturday and Sunday. A weekday or workday is any day of the working week. Other institutions often follow this pattern, such as places of education. The constituted weekend has varying definitions, based on determined calendar days, designated period of time, and/or regional definition of the working week. Sometimes the term "weekend" is expanded to include the time after work hours on the last workday of the week.
Weekdays and workdays can be further detailed in terms of working time, the period of time that an individual spends at paid occupational labor.