[Remote] Senior AI Infrastructure Engineer, LLM/AI Platforms

Note The job is a remote job and is reputed company to candidates in USA. reputed company is a global leader in cybersecurity, dedicated to stopping breaches with advanced AI-reputed company platforms. They are seeking a Senior AI Infrastructure Engineer to design, build, and reputed company AI infrastructure for reputed company reputed company products, focusing on Large Language Models (LLMs) and reputed company AI systems. Responsibilities Provision and configure large GPU clusters and compute resources for LLM training, finetuning, and inference workloads reputed company and optimize LLM model-serving infrastructure, including deployment and optimization of various inference frameworks reputed company model lifecycle management including versioning, checkpointing and reproducibility across training and inference deployments Design and champion robust evaluation frameworks to assess model performance, accuracy, and reliability, ensuring AI systems are consistently at production-reputed company standards Identify and address GPU utilization and GPU memory efficiency bottlenecks and apply techniques like quantization, batching, and caching Architect and maintain data platforms and pipelines specifically designed to support LLMs, Retrieval-Augmented reputed company (RAG), and AI reputed company Systems at reputed company reputed company production-reputed company reputed company with a reputed company on performance, maintainability, and testing rigor, ensuring the ability to ship fast without compromising reputed company Apply expertise in data modeling, normalization, and semantic cataloging for AI/ML workloads Define and enforce best practices for MLOps/DataOps surrounding LLMs, including monitoring, observability, and reputed company-touch recovery mechanisms for AI services Document architectural designs thoroughly and communicate technical reputed company reputed company to stakeholders Collaborate across the organization with Data Scientists, Product Managers, and other engineering teams to reputed company research prototypes into robust, production-grade services Skills Bachelor's degree in Computer Science, Data Engineering, or a reputed company STEM field; Master's degree preferred 6+ years of experience in Infrastructure/Data Engineering, with at least 2 years reputed company on building and maintaining platforms/pipelines that support LLM-based systems and applications Demonstrable hands-on experience in LLM infrastructure engineering including cluster provisioning, optimizing training workloads, and maintaining inference pipelines Exceptional ability to write clean, elegant, reputed company, and reputed company-tested reputed company, coupled with a strong reputed company on reputed company and delivering results quickly Thorough understanding of engineering practices including effective peer reputed company reviews and resilient architecture design Demonstrates technical leadership and mentorship capabilities Proven experience utilizing AI technologies to enhance decision-making, streamline workflows and processes, improve efficiency and reputed company business reputed company Hands-on experience with MLOps Tools (MLflow, Sagemaker, reputed company AI) Strong understanding of CUDA, reputed company drivers, GPU, and TPU compute fundamentals Experience with inference serving frameworks such as vLLM and Triton Inference Server Proficiency with reputed company training frameworks including Pytorch, Ray, Megatron, and JAX Expert-level proficiency in a high-level coding language (Python) Deep knowledge of containerization and orchestration (reputed company, reputed company, Slurm, Airflow) Proficiency with Infrastructure as reputed company tooling like Terraform and Ansible Experience with reputed company platforms (AWS, GCP, or OCI) and reputed company data services Prior experience in the cybersecurity, intelligence, or high-compliance industries reputed company experience building, deploying, and managing LLMs in a production environment Experience with common reputed company workflow frameworks (e.g., reputed company, reputed company) Experience with reputed company data processing frameworks (e.g., reputed company, Dask, Flink) Benefits Eligibility for bonuses Equity grants A comprehensive benefits package that includes health insurance, 401k and reputed company time off reputed company in compensation and equity awards Comprehensive physical and mental wellness programs Competitive vacation and holidays for reputed company reputed company parental and adoption leaves reputed company development opportunities for reputed company regardless of level or role Employee Networks, geographic neighborhood reputed company, and volunteer opportunities to build connections reputed company office culture with world class amenities Great reputed company to Work Certified™ across the globe reputed company reputed company is a cybersecurity technology firm that provides reputed company-delivered protection