Deep Infra
- 135 followers
- United States of America
- https://deepinfra.com
- @DeepInfra
- company/deep-infra
- info@deepinfra.com
Popular repositories Loading
-
deepinfra-node
deepinfra-node PublicOfficial TypeScript wrapper for DeepInfra Inference API
-
text-generation-inference
text-generation-inference PublicForked from huggingface/text-generation-inference
Large Language Model Text Generation Inference
-
langchain
langchain PublicForked from langchain-ai/langchain
⚡ Building applications with LLMs through composability ⚡
Python 1
-
deepinfra-chat
deepinfra-chat PublicSample Next.js ai chat app using Deep Infra inference and Vercel ai sdk
Repositories
- dynamo Public Forked from ai-dynamo/dynamo
A Datacenter Scale Distributed Inference Serving Framework
deepinfra/dynamo’s past year of commit activity - TensorRT-LLM Public Forked from NVIDIA/TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
deepinfra/TensorRT-LLM’s past year of commit activity - vllm-omni Public Forked from vllm-project/vllm-omni
A framework for efficient model inference with omni-modality models
deepinfra/vllm-omni’s past year of commit activity - vllm Public Forked from vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
deepinfra/vllm’s past year of commit activity - tiktoken Public Forked from openai/tiktoken
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
deepinfra/tiktoken’s past year of commit activity - Model-Optimizer Public Forked from NVIDIA/Model-Optimizer
A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
deepinfra/Model-Optimizer’s past year of commit activity - cookbooks Public
A collection of cookbooks, tutorials, and examples for using AI models on DeepInfra. This repository provides practical guides, performance benchmarks, and production-ready code examples to help developers build with AI models efficiently. Each cookbook includes comprehensive Jupyter notebooks, benchmarking suites, and real-world use case examples.
deepinfra/cookbooks’s past year of commit activity
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Most used topics
Loading…