N

LLM Inference Engineer

Near AI · Anywhere

Full-timeLeadPyTorch

🔥22 people viewed this job

About the Role

Locations: San Francisco or Remote About The Role The NEAR AI team is building decentralized and confidential machine learning infrastructure to enable user-owned AI. Our mission is to build highly scalable and efficient infrastructure for open-source AI at a global scale. We are specifically seeking an expert in high-performance LLM serving systems and inference optimization. In this role, you will push the boundaries of how large language models are served. What You'll Be Doing Architect and maintain production high-traffic LLM serving systems. Optimize throughput, latency, and cost for leading open-source LLMs. What We're Looking For Strong hands-on experience in LLM inference, with expertise debugging and optimizing major inference engines such as SGLang, vLLM, or TensorRT. Deep knowledge of state-of-the-art GPU architectures, and effectively exploit them using PyTorch, Triton, CuTe, CUDA, etc. Proven track record in designing and maintaining end-to-end high-traffic LLM serving systems. Strong problem-solving skills and ability to communicate technical ideas clearly. We'd Love If You Have Experience with Trusted Execution Environments (TEE). Active contributor to open-source LLM inference engines. Please let us know if you require any special requirements for your interview and we'll do our best to accommodate.

💬 Developer Questions

Ask the team a question — answers show up here

🎯

What does the interview process look like?

🤖

What AI/vibe coding tools does the team use daily?

👥

How big is the engineering team?

⏰

Is the team fully async or are there required meetings?

🚀

What does onboarding look like for remote hires?

🔧

Can you share more about the tech stack and architecture?

📈

What does career growth look like in this role?

📅

What does a typical day look like?

💰

Is there a salary range you can share?

📊

Is equity or stock options part of the package?

🌍

Are there timezone requirements or preferences?

🛂

Do you sponsor work visas?

🏢 Is this your listing? Claim it to answer questions

Similar Jobs

Helpful resources

Hiring for a similar role? Post your job here — it's free →