Skip to content
Change the repository type filter

All

    Repositories list

    • vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization
      Python
      Apache License 2.0
      393007Updated Apr 27, 2026Apr 27, 2026
    • frp

      Public
      A fast reverse proxy to help you expose a local server behind a NAT or firewall to the internet.
      Go
      Apache License 2.0
      15k0020Updated Apr 23, 2026Apr 23, 2026
    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      Apache License 2.0
      16k0015Updated Apr 21, 2026Apr 21, 2026
    • 根据MiniCPM4训练Eagle3的投机解码模型
      Python
      Apache License 2.0
      1005Updated Apr 8, 2026Apr 8, 2026
    • EAGLE

      Public
      Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3.
      Python
      Apache License 2.0
      272004Updated Apr 8, 2026Apr 8, 2026
    • dynamo

      Public
      A Datacenter Scale Distributed Inference Serving Framework
      Rust
      Apache License 2.0
      1.1k006Updated Apr 8, 2026Apr 8, 2026
    • Diting

      Public
      Python
      0000Updated Mar 26, 2026Mar 26, 2026
    • kaon_town

      Public
      0000Updated Mar 26, 2026Mar 26, 2026
    • aibrix

      Public
      Cost-efficient and pluggable Infrastructure components for GenAI inference
      Jupyter Notebook
      Apache License 2.0
      5660016Updated Feb 11, 2026Feb 11, 2026
    • ms-swift

      Public
      Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3, Qwen3-MoE, DeepSeek-R1, GLM4.5, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, I…
      Python
      Apache License 2.0
      1.4k000Updated Jan 22, 2026Jan 22, 2026
    • Cookbook

      Public
      MDX
      176133Updated Jan 13, 2026Jan 13, 2026
    • Shell
      MIT License
      2000Updated Sep 29, 2025Sep 29, 2025
    • Objective-C
      MIT License
      0000Updated Sep 18, 2025Sep 18, 2025
    • Python
      6000Updated Sep 16, 2025Sep 16, 2025
    • LMCache

      Public
      Redis for LLMs
      Python
      Apache License 2.0
      1.1k001Updated Jul 29, 2025Jul 29, 2025
    • Swift
      Other
      866000Updated Feb 12, 2025Feb 12, 2025
    • langfuse

      Public
      🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenA…
      TypeScript
      Other
      2.6k000Updated Dec 23, 2024Dec 23, 2024
    • A type-safe, Swift-language layer over SQLite3.
      C
      MIT License
      1.6k101Updated Oct 28, 2024Oct 28, 2024
    • A declarative library for application development using cloud services.
      Swift
      Apache License 2.0
      232006Updated Oct 19, 2024Oct 19, 2024
    • Swift SDK for Clickstream Analytics on AWS
      Swift
      Apache License 2.0
      2000Updated Jul 28, 2024Jul 28, 2024
    • TypeScript
      1302Updated Oct 25, 2023Oct 25, 2023
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.