A high-throughput and memory-efficient inference and serving engine for LLMs

Go ahead and axolotl questions

A framework for few-shot evaluation of language models.

A Python library for guardrail models evaluation with vLLM support.

Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.

DeepEP: an efficient expert-parallel communication library

The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—but scores >74% on SWE-bench verified!

SGLang is a fast serving framework for large language models and vision language models.