v0.6.2.post1

What's Changed

• fix: kobold api for horde by @AlpinDale in #763
• Fix for a crash from token bans by @Pyroserenus in #764
• Modified throughput benchmark to allow --max-num-seqs by @Pyroserenus in #770
• Simplify construction of sampling_metadata by @50h100a in #766
• Add OLMoE by @fizzAI in #772
• feat: ministral support by @AlpinDale in #776
• Make amd usable by @Naomiusearch in #775
• docker: apply AMD patch in the dockerfile by @AlpinDale in #777
• fix: demote skip_special_tokens assertion to logger error by @AlpinDale in #778
• ci: bump version to 0.6.2.post1 by @AlpinDale in #779

New Contributors

• @fizzAI made their first contribution in #772

Full Changelog: v0.6.2...v0.6.2.post1