Systems Engineer - AI CLI Tools

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Software Engineer Type: Freelance Compensation: $75–$80/hour Location: Remote Duration: 1–2 weeks Commitment: 15–40 hours/week Role Responsibilities Evaluate and compare the performance of AI-powered CLI coding agents on real-world infrastructure debugging tasks. Solve TerminalBench tasks using AI CLI agents to diagnose and fix failing systems. Write bash scripts to address root causes and ensure they survive service restarts. Diagnose broken systems inside Docker containers involving databases, TLS, pipelines, and more. Compare and rank agents' approaches after each task to inform product decisions. Work independently and asynchronously with flexible hours. Qualifications Must-Have 3+ years of experience in software engineering with hands-on debugging of systems and infrastructure. Strong bash/shell scripting proficiency. Experience with Docker and containerization. Skills in infrastructure and systems debugging with PostgreSQL, MySQL, Redis, nginx, TLS, systemd, and log analysis. Familiarity with version control workflows (Git, PRs, issue tracking). Preferred Experience with AI coding tools like Copilot, Cursor, or Claude. Start Date Immediate Application Process (Takes 20–30 mins to complete) Upload resume AI interview: A short, 15-minute conversational session to understand your background, experience, and interest in the role Follow-up communication within a few days with next steps and onboarding details Resources & Support For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome For any help or support, reach out to: support@mercor.com PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.