MiawRouter 1.1.9 / Node.js 20.9+

One endpoint for every model route.

MiawRouter runs locally and presents one OpenAI-compatible endpoint to editors, agents, and applications.

It handles provider translation, multi-account failover, SSE normalization, cache layers, MITM interception, and local model connectors.

Install MiawRouter Open repository View npm package

Installation

Run the gateway locally.

The default dashboard and API endpoint are available after the service starts.

Install and start

npm install -g miawrouter
miawrouter

# OpenAI-compatible base URL
http://127.0.0.1:21128/v1

API basehttp://127.0.0.1:21128/v1

Dashboardhttp://127.0.0.1:21128/dashboard

Config~/.miawrouter

CacheL0 prompt, L1 exact, L2 semantic, L3 disk

Routing layer

The gateway work stays in one process.

Provider adapters

One request shape across configured backends

The current MiawLabs reference tracks 146 adapters for cloud APIs, subscription-backed sessions, and local runtimes.

SSE normalization

Provider-specific streams are translated into a consistent OpenAI-compatible response.

Account pools

Round-robin selection and cooldown handling move traffic away from unavailable accounts.

Four cache layers

L0 through L3 reduce repeated prompt work while keeping fail-open behavior.

MITM interception

Compatible developer tools can route requests through the local gateway without changing their normal workflow.

Local runtimes

Connectors cover llama.cpp, vLLM, Whisper, Kokoro, and other self-hosted services.

Administrative surface

Inspect routes, usage, and runtime state.

MiawRouter gateway architecture and dashboard concepts — The web dashboard covers providers, pools, usage, cache, logs, model discovery, privacy, and runtime health.

Client request

Keep the standard OpenAI shape.

POST /v1/chat/completions

curl http://127.0.0.1:21128/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer local" \
  -d '{
    "model": "your-model-route",
    "messages": [{"role": "user", "content": "Hello"}]
  }'

Specifications

Local by default.

Version1.1.9

RuntimeNode.js 20.9 or newer

Default port21128

InterfacesOpenAI-compatible API, dashboard, CLI, and provider adapters

StorageLocal configuration and SQLite data under ~/.miawrouter

LicenseMIT