Auto convert transformers models to QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs.
Code based on QuaRot
-
Notifications
You must be signed in to change notification settings - Fork 1
Auto convert transformers models to QuaRot.
License
sgsdxzy/AutoQuarot
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Auto convert transformers models to QuaRot.
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published