English | 简体中文

• 🚀 Extreme Performance: Powered by Bun & ElysiaJS, delivering 3.6x more throughput than Gin (Go).
• ☁️ Redis-Free Architecture: High-concurrency rate limiting and billing powered entirely by PostgreSQL 18.3, simplifying deployment.
• 🧠 Dual-Mode Semantic Cache: Features both Exact Match (instant lightning hits ⚡) and Vector Semantic Match (intelligent breeze hits 🍃) to save costs and reduce latency.
• 🔐 Enterprise-Grade Security: HttpOnly Cookie sessions, server-side session management, and CSRF/XSS protection by default.
• 💰 Robust Billing: High-concurrency batch billing with support for dual-currency (USD/RMB) and dynamic price ratios.
• 📊 Professional Analytics: Real-time monitoring, 24h trends, interactive charts, and detailed latency tracking.
• 🌍 I18n Ready: Full multi-language support (English/Chinese) with automatic browser locale detection.

Elygate is designed as a modern, unified gateway that consolidates billing, caching, and model management into a single high-performance engine.

graph TD
    Client[Admin Panel / API Client] --> Gateway[Bun + ElysiaJS Gateway]
    Gateway --> Auth[Session & JWT Auth]
    Gateway --> Cache{Response Cache}
    Cache -- Hit --> Exact[⚡ Exact Match]
    Cache -- Hit --> Semantic[🍃 Semantic Match]
    Cache -- Miss --> Models[Model Providers / Upstream]
    Gateway --> DB[(PostgreSQL 18.3)]
    DB --> Billing[Batch Billing logic]
    DB --> Stats[Real-time Stats Engine]

Elygate is fully compatible with both OpenAI and Anthropic API standards. You can use any library or tool designed for these services.

Most tools (NextChat, ChatBox, OpenAI SDK) work with the base URL.

• Base URL: http://your-elygate/v1
• Key: Your generated sk-... token.

Works natively with the Anthropic SDK and Claude Code.

• Base URL: http://your-elygate/v1 (Note: the SDK appends /messages automatically)
• Key: Your generated sk-... token.

Anthropic SDK Example (Node.js):

import Anthropic from '@anthropic-ai/sdk';

const anthropic = new Anthropic({
  apiKey: 'your-sk-token',
  baseURL: 'http://your-elygate/v1' 
});

const msg = await anthropic.messages.create({
  model: "claude-3-5-sonnet-20240620",
  max_tokens: 1024,
  messages: [{ role: "user", content: "Hello, Claude" }],
});

export ANTHROPIC_BASE_URL=http://your-elygate/v1
export ANTHROPIC_API_KEY=your-sk-token
claude

• Provider: Select Anthropic (Messages API)
• Base URL: http://your-elygate/v1
• API Key: your-sk-token

High-performance AI Gateway. Build on Bun + PostgreSQL 18.

Launch the entire stack (Database, Gateway, and Web UI) with one command.

git clone https://github.com/zuohuadong/elygate.git && cd elygate
cp .env.example .env

By default, this pulls images from ghcr.io. Note: If you are in Mainland China, see the Chinese README for mirror acceleration.

# Download the lightweight production compose file
curl -O https://raw.githubusercontent.com/zuohuadong/elygate/main/docker-compose.prod.yml

# Check and restore "ghcr.io" if it was changed to a mirror
sed -i 's/ghcr.nju.edu.cn/ghcr.io/g' docker-compose.prod.yml

# Run the stack
docker compose -f docker-compose.prod.yml up -d

Inspired by New-API, Elygate provides pre-compiled single-file binaries. No Node.js, Bun, or Docker required.

1. Download: Go to Releases and download the binary for your OS.
2. Configure: Create a .env file with your DATABASE_URL.
3. Run:
   • Linux / macOS:

     chmod +x elygate-linux-amd64
     ./elygate-linux-amd64

   • Windows:

     elygate-bun-windows-x64.exe

   The binary embeds both the Gateway API engine and the Svelte Admin Panel.

For high-performance production use without Docker:

# Build the web application
bun run build

# Start both Gateway and Web with one command
bun run start

This will start:

• Gateway API on port 3000
• Web Admin Panel on port 3001

If you prefer to run services manually on your host machine:

# Install dependencies
bun install

# Start both Gateway and Web in development mode
bun run dev

This will start:

• Gateway API on port 3000 (with hot reload)
• Web Admin Panel on port 5173 (with hot reload)

1. Ensure PostgreSQL 15+ is running
2. Run packages/db/src/init.sql to initialize schema
3. Configure DATABASE_URL in .env

We chose Bun + Elysia.js for its exceptional throughput. While Gin is highly efficient, Elysia leverages Bun's native asynchronous I/O to push boundaries.

Elysia  (Bun)  ███████████████████████████████████ 2,454,631  (🥇 3.6x vs Gin)
Gin     (Go)   █████████                           676,019
Spring  (Java) ███████                             506,087
Fastify (JS)   ██████                              415,600
Express (JS)   █                                   113,117    (21x slower)

Numbers based on standard TechEmpower-style plaintext benchmarks.

Elygate comes with built-in performance optimizations for PostgreSQL 18.3:

# Run automatic optimization script
chmod +x scripts/deploy-optimizations.sh
./scripts/deploy-optimizations.sh

• ✅ PostgreSQL 18.3 Async Commit: 30-50% write performance boost
• ✅ Connection Pool: 20 connections with optimized lifecycle
• ✅ Performance Indexes: 20+ indexes for query optimization
• ✅ Semantic Cache: Built-in vector similarity caching

See Performance Optimization Guide for details.

elygate
├── apps
│   ├── gateway    # Gateway engine (Elysia.js, billing, auth)
│   └── web        # Admin Panel (Svelte 5 + Tailwind 4)
├── packages
│   └── db         # Database schema, init SQL and types
├── Dockerfile.gateway
├── Dockerfile.web
├── Dockerfile.postgres
└── docker-compose.yml

• 🛡️ Apache 2.0: Open-source and enterprise-ready.
• ☁️ Zero Shell Dependencies: Unlike New API which requires Redis for high-concurrency rate limiting, Elygate is Redis-free. All logic is handled by Bun + PostgreSQL, simplifying your stack.
• 🔐 Secure Cookie Session: HttpOnly Cookie-based authentication with server-side session management. Supports multi-device login, server-side logout, and automatic session expiration.

Elygate 同时兼容 OpenAI 和 Anthropic (Claude) 的 API 标准，您可以无缝对接现有的各类客户端和 SDK。

适用于大多数工具（如 NextChat, ChatBox, OpenAI SDK 等）。

• Base URL: http://your-elygate/v1
• 密钥 (Key): 后台生成的 sk-... 令牌。

原生支持 Anthropic SDK 以及 Claude Code 命令行工具。

• Base URL: http://your-elygate/v1 (SDK 会自动拼接 /messages)
• 密钥 (Key): 后台生成的 sk-... 令牌。

Anthropic SDK (Node.js) 调用示例:

import Anthropic from '@anthropic-ai/sdk';

const anthropic = new Anthropic({
  apiKey: '您的-sk-令牌',
  baseURL: 'http://your-elygate/v1' 
});

const msg = await anthropic.messages.create({
  model: "claude-3-5-sonnet-20240620",
  max_tokens: 1024,
  messages: [{ role: "user", content: "你好" }],
});

export ANTHROPIC_BASE_URL=http://your-elygate/v1
export ANTHROPIC_API_KEY=您的-sk-令牌
claude

• 提供商: 选择 Anthropic (Messages API)
• Base URL: http://your-elygate/v1
• API Key: 您的-sk-令牌

高性能AI分发网关与计费系统。基于 Bun + PostgreSQL 18。

只需简单几步，即可一键启动全栈环境。

git clone https://github.com/zuohuadong/elygate.git && cd elygate
cp .env.example .env

得益于 GitHub Actions，您无需在服务器编译即可极速拉取并启动应用。

对于国内服务器（默认已开启南京大学 GHCR 镜像加速）：

# 下载专为线上优化的轻量级编排文件
curl -O https://raw.githubusercontent.com/zuohuadong/elygate/main/docker-compose.prod.yml

# 一键启动（享受国内镜像高速拉取）
docker compose -f docker-compose.prod.yml up -d

对于海外服务器（需要换回官方源）：

curl -O https://raw.githubusercontent.com/zuohuadong/elygate/main/docker-compose.prod.yml
sed -i 's/ghcr.nju.edu.cn/ghcr.io/g' docker-compose.prod.yml
docker compose -f docker-compose.prod.yml up -d

致敬 New-API，Elygate 在 Release 页面提供了包含了网关接口与 Svelte 后台的跨平台单体二进制文件。您不需要安装 Docker、Bun 或 Node.js 也能直接运行。

1. 下载: 访问 Releases 页面，下载对应您的操作系统的文件。
2. 配置: 准备好 PostgreSQL 并同级目录下创建 .env 配置 DATABASE_URL。
3. 运行:
   • Linux / Mac:

     chmod +x elygate-linux-amd64
     ./elygate-linux-amd64

   • Windows: 直接双击运行下载好的 .exe 软件，或通过 CMD 执行：

     elygate-bun-windows-x64.exe

Elygate 内置了针对 PostgreSQL 18.3 的性能优化配置：

# 运行自动优化脚本
chmod +x scripts/deploy-optimizations.sh
./scripts/deploy-optimizations.sh

• ✅ PostgreSQL 18.3 异步提交: 写入性能提升 30-50%
• ✅ 连接池优化: 20个连接，优化生命周期管理
• ✅ 性能索引: 20+ 个索引优化查询性能
• ✅ 语义缓存: 内置向量相似度缓存

详见 性能优化指南。

如果您希望在宿主机以最佳性能运行（非 Docker 环境）：

# 构建 Web 应用
bun run build

# 一键启动网关和管理后台
bun run start

这将启动：

• 网关 API - 端口 3000
• Web 管理后台 - 端口 3001

如果您希望在宿主机手动运行各项服务：

# 安装依赖
bun install

# 一键启动开发服务器
bun run dev

这将启动：

• 网关 API - 端口 3000（支持热重载）
• Web 管理后台 - 端口 5173（支持热重载）

1. 确保已安装 PostgreSQL 15+
2. 执行 packages/db/src/init.sql 初始化表结构
3. 在 .env 中正确配置 DATABASE_URL

选择 Bun + Elysia.js 是为了追求极致的吞吐量。虽然 Go (Gin) 已经非常高效，但 Elysia 利用 Bun 的原生异步 I/O 将 Web 性能提升到了新的高度。

Elysia  (Bun)  ███████████████████████████████████ 2,454,631  (🥇 3.6倍于 Gin)
Gin     (Go)   █████████                           676,019
Spring  (Java) ███████                             506,087
Fastify (JS)   ██████                              415,600
Express (JS)   █                                   113,117    (慢 21 倍)

elygate
├── apps
│   ├── gateway    # 网关核心引擎 (Elysia.js, 计费, 鉴权)
│   └── web        # 管理后台 (Svelte 5 + Tailwind 4)
├── packages
│   └── db         # 数据库 Schema, 初始化 SQL 及类型定义
├── Dockerfile.gateway
├── Dockerfile.web
├── Dockerfile.postgres
└── docker-compose.yml

• 🛡️ Apache 2.0: 协议友好，支持商业化二次开发。
• ☁️ 极简无依赖: 相比 New API 在高并发下必须依赖 Redis 进行限流和缓存，Elygate 实现了 Redis-free（无 Redis 依赖）。所有逻辑均由 Bun + PostgreSQL 承载，大幅简化了部署运维复杂度。
• 🔐 安全 Cookie 会话: 基于 HttpOnly Cookie 的服务端会话认证，支持多端登录、服务端注销和自动会话过期，有效防止 XSS 攻击。

语义缓存默认开启，支持在数据库 options 表中实时调整：

-- 调整相似度阈值 (默认 0.95，越高越严格)
INSERT INTO options (key, value) VALUES ('SemanticCacheThreshold', '0.96')
ON CONFLICT (key) DO UPDATE SET value = '0.96';

Deep gratitude to the [New-API] community for their pioneering exploration. 项目基于 Apache 2.0 协议开源，部分设计思路致敬 New-API 及其开源生态。