About the Role

You’ll own LiteLLM’s migration from Python to Rust, end to end.

This is a high-stakes, high-visibility role where you will:

Plan the migration directly with the CTO
Restructure the existing codebase so it is ready for an incremental move to Rust
Lead a gradual, stability-first rollout
Drive LiteLLM toward becoming the lowest-latency, highest-throughput AI gateway in the category
Ensure performance improvements never compromise the reliability our enterprise customers depend on

This is a single-owner mandate. You will be the person responsible for leading the entire Python-to-Rust migration.

Responsibilities

Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through production rollout
Plan the migration alongside the CTO and sequence the work to minimize risk to live, high-volume traffic
Design and execute a gradual rollout with stability as the top constraint
Restructure the existing codebase to enable a clean, incremental migration
Drive improvements across latency, throughput, and resource efficiency at more than 1 billion requests per month
Collaborate across teams to align the migration with backend priorities across performance, reliability, and security

Deep, long-standing expertise in Rust
- You have written production Rust for years and know the language deeply
An obsession with performance
- You care deeply about latency, throughput, and resource efficiency
Strong instincts for stability
- You have a track record of balancing ambitious technical changes with production reliability
Experience with backend infrastructure, databases such as PostgreSQL and Redis, and high-volume production systems