inference-sim
Popular repositories Loading
-
-
sdlc-plugins
sdlc-plugins PublicPlugins to accelerate the SDLC work for the ai-platform-opt team
-
vllm-data-collection
vllm-data-collection PublicBenchmark different parameter sweeps from vllm
Python 1
-
config-recommender
config-recommender PublicConfiguration exploration and recommendation for inference
Python 2
-
config-explorer-evaluation
config-explorer-evaluation PublicEvaluating different inference simulator engines
Python
Repositories
- sim-to-real-accuracy-validation Public
Validation of accuracy across multiple simulators and BLIS modes
inference-sim/sim-to-real-accuracy-validation’s past year of commit activity - planning Public
inference-sim/planning’s past year of commit activity - vllm Public Forked from vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
inference-sim/vllm’s past year of commit activity
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Top languages
Loading…
Most used topics
Loading…