Pinned Loading

1. nm-vllm-certs nm-vllm-certs Public

   General Information, model certifications, and benchmarks for nm-vllm enterprise distributions

   7 1

2. deepsparse deepsparse Public

   Sparsity-aware deep learning inference runtime for CPUs

   Python 3k 174

3. sparseml sparseml Public

   Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

   Python 2.1k 147

4. docs docs Public

   Top-level directory for documentation and general content

   MDX 120 7

5. sparsezoo sparsezoo Public

   Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes

   Python 370 25

6. guidellm guidellm Public

   Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

   Python 163 12