Popular repositories Loading

1. unmanic-documentation unmanic-documentation Public

   Forked from Unmanic/unmanic-documentation

   All documentation for Unmanic

   JavaScript

2. truss-examples truss-examples Public

   Forked from basetenlabs/truss-examples

   Examples of models deployable with Truss

   Python

3. unsloth unsloth Public

   Forked from unslothai/unsloth

   Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

   Python

4. TensorRT-LLM TensorRT-LLM Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++

5. test_70b test_70b Public

   Python

6. flux_fp8 flux_fp8 Public

   Forked from aredden/flux-fp8-api

   Flux diffusion model implementation using quantized fp8 matmul & remaining layers use faster half precision accumulate, which is ~2x faster on consumer devices.

   Python