Affiliate Disclosure: 9bests.com is supported by our readers. When you click on links and make a purchase, we may receive a small affiliate commission from the seller at no additional cost to you.

Millwright

Name: Millwright
Author: 9bests.com

An open-source, self-hosted LLM router in a single Rust binary. It sits between your AI apps and model providers, routing each request to the lowest-cost healthy model your policy allows — with cache-aware affinity and spend control.

★★★★☆ 4 Free (Open Source)

Visit Website 🔗 Compare Tool

📖 9bests In-Depth Review Jul 26, 2026

Millwright Review 2026: A Self-Hosted LLM Router in One Rust Binary

Millwright is an open-source, self-hosted LLM router that sends each request to the lowest-cost healthy model your policy allows. We review its routing, cache affinity, and spend control.

Read the full long-form review & analysis →

💡 9bests Editorial Buying Advice

Why choose Millwright: An open-source, self-hosted LLM router in a single Rust binary. It sits between your AI apps and model providers, routing each request to the lowest-cost healthy model your policy allows — with cache-aware affinity and spend control.

Optimal workflow match: Ideal for teams seeking automated and streamlined AI workflows.

✅ Pros / Key Advantages

• Self-hosted LLM router in one Rust binary — no hosted control plane
• Policy-controlled routing across cheap, mid, and frontier roles
• Cache-aware session affinity to protect prompt-cache reuse
• Accepts OpenAI Chat Completions and Anthropic Messages; routes to OpenAI-compatible, Anthropic, or Bedrock
• Spend ledger (SQLite default, PostgreSQL for prod) with routing provenance

❌ Cons / Limitations

• Early release (v0.1.0) — the API may shift
• Router only — does not orchestrate agents or inspect prompts
• Requires Rust 1.97+ to build from source

💰 Pricing Plans & Structure

Free (Open Source)

Pricing details are gathered from public sources and are subject to change. Please visit the official website for real-time rates and trial terms.

Pricing verified from official public sources · Reviewed by Bill (Lead Editor)

🎯 Who should use Millwright

Best suited for users focused on digital productivity and AI automation who value self-hosted llm router in one rust binary — no hosted control plane.

⚠️ Who should look elsewhere

Users who require features outside its core scope or cannot accommodate early release (v0.1.0) — the api may shift may benefit from exploring alternative tools in this category.

🚀 Common use cases

Autocompleting and refactoring code

Multi-file AI edits

Debugging and test generation

⚖️ Direct Head-to-Head Comparisons

Curated Matchups

Compare Matrix → Free (Open Source) vs Free / $20/mo

Millwright vs Cursor

Side-by-side analysis of features, scores, pros, and cons.

Compare Matrix → Free (Open Source) vs $10-39/mo

Millwright vs GitHub Copilot

Side-by-side analysis of features, scores, pros, and cons.

Compare Matrix → Free (Open Source) vs Free / $15/mo

Millwright vs Windsurf (Codeium)

Side-by-side analysis of features, scores, pros, and cons.

Compare Matrix → Free (Open Source) vs Free / $25/mo

Millwright vs Replit Agent

Side-by-side analysis of features, scores, pros, and cons.

❓ Frequently asked questions

Is Millwright free?

Pricing for Millwright is available on its official site.

What is Millwright used for and what are its strengths?

Key strengths of Millwright: Self-hosted LLM router in one Rust binary — no hosted control plane, Policy-controlled routing across cheap, mid, and frontier roles. An open-source, self-hosted LLM router in a single Rust binary. It sits between your AI apps and model providers, routing each request to the lowest-cost healthy model your policy allows — with cache-aware affinity and spend control.

What is the best alternative to Millwright?

If you're looking for an alternative to Millwright, consider Cursor: it stands out for Best AI code editor, Multi-file editing.

How do I choose the right alternative to Millwright?

Selection advice: compare ratings, pricing, and core features within the AI Coding category, then match to your own workflow. See the comparison matrix and Top alternatives list on this page.