Founding Member of Technical Staff - Back-end / Systems Engineering

TensorZero is creating a feedback loop for optimizing LLM applications, turning production data into smarter, faster, and cheaper models. We unify inference, observability, optimization, evaluations, and experimentation for LLMs. We are backed by leading investors (FirstMark, Bessemer, Bedrock) and have years of runway.

We are seeking a Founding Member of Technical Staff focused on Back-end / Systems Engineering. You will join a small, entirely technical team including a former Rust compiler maintainer and ML researchers with thousands of citations.

Responsibilities:
- Design, build, and maintain core back-end systems and infrastructure using Rust.
- Contribute to making TensorZero a best-in-class product across inference, observability, optimization, and experimentation.
- Implement new inference-time optimizations, improve RAG support, integrate with other tools (especially OSS).
- Enhance experimentation capabilities (e.g., advanced A/B testing).
- Focus on performance, scalability, and reliability of the system.
- Collaborate across the stack and contribute to our open-source codebase (the vast majority of your work).

Technical Skills Required:
- Deep expertise in Rust programming.
- Strong background in systems engineering, distributed systems, and performance optimization.
- Experience with cloud infrastructure (e.g., AWS) and databases (e.g., ClickHouse).
- Familiarity with LLMs or ML infrastructure is a plus.

Ideal Candidate:
- Passionate about building high-performance, reliable systems.
- Eager to work in a fast-paced startup environment on a deeply technical product.
- Strong collaborator and willing to learn/teach across different domains.
- Values open-source development.
- Comfortable working onsite 5 days a week in NYC.