[Remote] LLM DevOps / Inference Engineer

Note: The job is a remote job and is open to candidates in USA. Xaxis Solutions is seeking an LLM DevOps / Inference Engineer to support a healthcare-focused AI benchmark and evaluation platform. The role owns infrastructure for the benchmark harness, self-hosted model serving stack, and platform reliability, including provisioning GPU infrastructure, optimizing model inference, and managing AWS cloud systems. Responsibilities Build and maintain AWS infrastructure using Terraform, including networking, compute, orchestration, secrets, observability, and CI/CDDeploy and manage self-hosted LLM inference workloads on GPU infrastructureImplement batching, quantization, autoscaling, and multi-GPU strategies for efficient inferenceDevelop standardized processes for onboarding new models quicklyBuild provider abstraction layers for API-based models such as OpenAI, Anthropic, and Gemini, as well as self-hosted modelsImplement rate limiting, retries, backoff, quota management, request/response logging, and cost attributionEnsure benchmark runs are reproducible and cost-efficient through pinned model/container versions and optimized cloud capacityBuild observability dashboards covering throughput, latency, token usage, GPU-hour costs, failures, and per-model performanceSupport burst workloads while preventing orphaned or unnecessary cloud resourcesContribute to Trusted Execution Environment (TEE) architecture and evaluate AWS Nitro Enclaves and comparable confidential-computing solutions Skills Hands-on experience launching and managing inference containersStrong experience building and maintaining AWS infrastructure as code, including networking, compute, orchestration, secrets, observability, and CI/CDExperience working in a startup or fast-paced environmentStrong AI/LLM and model infrastructure experienceExcellent communication skillsUS Citizens will be given first preferenceActive and complete LinkedIn profileProduction-scale AWS infrastructure experienceStrong knowledge of EKS/ECS, EC2 GPU instances (G5/G6, P4d/P5), VPC, IAM, KMS, Secrets Manager, ECR, CloudWatch, and Service QuotasStrong Terraform / Infrastructure as Code experienceHands-on experience with LLM model serving and inference optimizationPractical knowledge of batching strategies, KV cache behavior, quantization, and multi-GPU shardingExperience managing GPU workloads with EKS/ECS, node autoscaling, and CUDA-based container pipelinesStrong reliability and cost-engineering experience, including SLOs, monitoring, alerting, and cloud cost optimizationExperience with AWS SageMaker and BedrockStrong Python development skillsKnowledge of confidential computing, including Enclaves, remote attestation, and sealed key releaseUnderstanding of healthcare compliance, including HIPAA-eligible services, BAA requirements, audit logging, and PHI access controlsExperience with security hardening, image scanning, and network egress controls Company Overview X-Axis Solutions is a management consulting company dedicated to providing clients cutting-edge cost-effective solutions streamlined to the needs of their organization to help make the organizational process a more effective one. It was founded in undefined, and is headquartered in Mississauga, Ontario, CA, with a workforce of 2-10 employees. Its website is http://www.xaxis.consulting.