Frequently Asked Questions

Is HiWay a reseller of LLM tokens?

No. HiWay is BYOK - Bring Your Own Key. You plug your own provider API keys into HiWay, and the provider bills you directly for inference. HiWay charges a markup % on your monthly API spend (9-12.5% on Scale by volume). This markup decreases automatically as your volume grows.

Does HiWay store my prompts?

By default, zero log of prompt content, zero log of response content. We only store per-request metadata (model, tokens, cost, tier, latency). If you enable the semantic cache, prompts are embedded and stored in Qdrant within your workspace namespace - they never leave our infrastructure and never flow to another workspace.

How accurate is the routing?

The scoring engine is deterministic (7 analyzers, pure CPU). On our internal benchmarks across 1,000+ prompts, the router agrees with a human expert ~95% of the time. When it doesn't, you can pin a tier or a specific model - or run an A/B Experiment to verify the call yourself.

Can I restrict routing to EU providers only?

Yes. Open Settings → Providers, enable only Mistral (and any other EU provider you trust), disable the US ones. All routing stays within your enabled set.

What happens when my HiWay wallet is empty?

Routing falls back to passthrough mode - requests still go through but without smart routing optimization. Top up your wallet in Dashboard → Billing or enable auto-reload to top up automatically when balance drops below a configurable threshold.

Is my data sent to US providers (OpenAI, Anthropic)?

Yes, if you enable those providers. HiWay is a routing proxy, not a training-data intermediary. When a request routes to an American provider, your prompt goes to them under the provider's standard privacy terms (OpenAI and Anthropic APIs do not train on API traffic by default). If that's a concern, restrict providers to EU-only.

Where is HiWay hosted?

OVH Gravelines (France, EU). The proxy runs on a VPS in France. Redis cache, Postgres ledger, Qdrant semantic cache and logs are all in the same datacenter. No hop outside the EU for the routing decision itself.

What's the SLA?

99.9% uptime target for the routing proxy (excluding provider outages and planned maintenance). See Terms Section 5 for the full Service Level commitment.

Is the SDK open-source?

Yes. CLI, Python SDK, TypeScript SDK, installer scripts, examples and the benchmark harness are all MIT-licensed on GitHub (Hiway2llm/client). The router backend is proprietary.