Back-end Engineer (Rust)

About TensorZero: TensorZero is an open-source stack for industrial-grade LLM applications, unifying gateway, observability, optimization, evaluations, and experimentation. We’re seeking a Back-end Engineer (Rust) to join our technical-first team, where you’ll design and implement high-performance systems for our LLM infrastructure. This role involves working with Rust, ClickHouse, and distributed systems to ensure our gateway achieves sub-1ms latency at scale.

Key Responsibilities:

• Design and develop high-performance backend systems using Rust
• Optimize LLM gateway performance and scalability
• Collaborate with ML researchers on inference-time optimizations
• Build and maintain ClickHouse integrations for observability
• Contribute to open-source projects and community engagement

Required Skills:

• Proficiency in Rust and systems programming
• Experience with distributed systems and concurrency
• Strong understanding of network protocols and optimization
• Familiarity with database systems (especially ClickHouse)
• Experience with CI/CD and testing in Rust ecosystems
• Excellent problem-solving skills and attention to detail

Ideal Candidate: A motivated engineer with 5+ years of experience in backend development, particularly with Rust. You should have a track record of building scalable systems and a passion for open-source contributions. Experience with LLM infrastructure or high-throughput systems is highly valued. This role offers the opportunity to work with a small, collaborative team on cutting-edge AI infrastructure with significant impact on TensorZero’s product direction.

About the Company: TensorZero provides an open-source platform for industrial-grade LLM applications, enabling developers to build, deploy, and manage LLM applications with ease. We’re backed by reputable investors and have raised $7.2M in seed funding. Our team includes experts from top institutions and industry leaders, creating a collaborative environment focused on innovation and growth.

Compensation: The estimated pay range for this role is $180,000 - $240,000, with equity options as part of our compensation package.