Thriving 
JV Self-hosted LLM gateway for Java and Spring Boot teams: one OpenAI-compatible endpoint in front of Ollama, vLLM, GPUStack and cloud models, with RBAC, rate limiting, circuit breaking, audit and a visual console.
https://jairouter.com/ ↗// readme
Ollama · vLLM · GPUStack · Xinference · LocalAI · OpenAI · Claude · Gemini
Routing · load balancing · rate limiting · circuit breaking · failover · RBAC · audit · visual console
This README is written to be read by people and AI agents alike: the facts block below and the Repository map / Commands / HTTP surfaces sections are the machine-actionable core. Where the code and this file disagree, the code wins — please open an issue so we can fix the file.
product: JAiRouter
repository: Lincoln-cn/JAiRouter
checkout_dir: model-router # the local/git directory name differs from the product name
artifact: model-router # Maven artifactId
project_version: 3.8.5 # pom.xml
latest_release: v3.8.5 (2026-11-12)
stack:
backend: Java 17 + Spring Boot 4.1.2 (WebFlux / reactive)
frontend: Vue 3 + TypeScript + Vite, bilingual zh-CN / en-US
build: Maven wrapper — ./mvnw (Unix) · .\mvnw.cmd (Windows)
runtime:
default_port: 8080
console: /admin/
swagger_ui: dev profile only
required_env_in_prod: [JWT_SECRET,…