Learn how smart routing works, integrate any chat-completions client in 2 minutes, and master Budget Controls, auto-recharge and the Guardian system.
Start with the quickstartFrom signup to your first routed request in under 2 minutes.
Python, TypeScript and a one-liner CLI. MIT-licensed. Use HiWay without touching the dashboard.
OpenAI, Anthropic, LangChain, Vercel AI SDK, n8n — change one line.
How to sign requests with your hw_live_ key.
Seven analyzers, sub-millisecond decision, no LLM call.
Flat monthly subscription. 0% markup on inference. BYOK.
Per-workspace rules to block runaway agents, duplicate traffic and cost spikes.
Cap your monthly upstream BYOK spend. Verdict: BLOCK, DOWNGRADE or LIGHT_ONLY.
When a provider fails, HiWay retries against the cheapest same-tier model. Max 2 retries.
Qdrant-backed, cosine ≥ 0.92. Skip identical and near-identical requests entirely.
Opt-in. Regex on email / phone / card / IBAN / API keys before cache hashing.
Run N variants of a request in parallel across models. Compare cost, latency, quality.
OpenAI-compatible body + _hiway metadata + X-HiWay-Routed-* headers.
How HiWay forwards Server-Sent Events end-to-end.
HiWay is tool-calling transparent across every supported provider.
Why the system prompt affects which tier your request is routed to.
Per-workspace thresholds, alert webhooks, rule-level on/off.
Monthly USD cap on upstream BYOK cost.
Qdrant-backed cache — Scale plan and above.
Regex masking before cache, embedding and (optionally) provider call.
Scale+ — benchmark models on real traffic without writing glue code.
Drop-in: change one line, route through HiWay.
The TypeScript/JavaScript path to HiWay.
Point LangChain at HiWay with one base_url change.
Streaming chat UIs with HiWay as the provider.
Use HiWay as the LLM endpoint for every n8n AI node.
No SDK? No problem. HiWay speaks standard chat-completions.
Swap two lines, keep every other part of your integration.
Managed alternative to your self-hosted router — when the ops cost stops being worth it.
Stay on Vercel if you want. Just swap the upstream from Vercel's gateway to HiWay.
BYOK + smart routing, minus Portkey's guardrails and prompt library.
Keep your provider account, add a router — smart model selection without rewriting a line of logic.
When HiWay refuses a request because a cap was hit.
Your API key didn't authenticate. Here's how to fix it.
Who rate-limited you, and how to unblock.
When all fallback attempts failed.
The questions we get the most, answered in one place.
HiWay-specific terms explained.
What shipped, when.