-
Notifications
You must be signed in to change notification settings - Fork 184
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
mac m系列可以用吗 #100
Comments
根据报错信息,您需要安装pip install -U bitsandbytes |
我安装了,但是似乎遇到了numpy版本的问题。请问代码中用到的python是什么版本呢,我这边是3.12的,是不是这个的问题? |
python 3.12 好像确实有点问题,我用的python 3.10可以运行 |
理论上m系列芯片是可行的,但是GLM-4-voice好像 |
你好,我在python3.10中重新部署模型,安装依赖发现以下报错信息: × python setup.py bdist_wheel did not run successfully. note: This error originates from a subprocess, and is likely not a problem with pip. |
你这是哪个requirement.txt,voice依赖里面没有pynini啊 |
好奇怪。。。我检查了一下文件夹内的依赖,确实没发现这个。但是执行的时候下载了很多依赖。 |
在加载模型的时候内存不够了,于是用int4量化的命令,发现以下报错信息
(base) ~/PycharmProjects/GLM-4-Voice /GLM-4-Voice git:[main] python model_server.py --host localhost --model-path THUDM/glm-4-voice-9b --port 10000 --dtype int4 --device cpu:0 Traceback (most recent call last): File "/Users/chenyi/PycharmProjects/GLM-4-Voice /GLM-4-Voice/model_server.py", line 143, in <module> worker = ModelWorker(args.model_path, args.dtype, args.device) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/chenyi/PycharmProjects/GLM-4-Voice /GLM-4-Voice/model_server.py", line 74, in __init__ self.glm_model = AutoModel.from_pretrained( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/miniconda3/lib/python3.12/site-packages/transformers/models/auto/auto_factory.py", line 559, in from_pretrained return model_class.from_pretrained( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/miniconda3/lib/python3.12/site-packages/transformers/modeling_utils.py", line 3657, in from_pretrained hf_quantizer.validate_environment( File "/opt/miniconda3/lib/python3.12/site-packages/transformers/quantizers/quantizer_bnb_4bit.py", line 74, in validate_environment raise ImportError( ImportError: Using
bitsandbytes4-bit quantization requires the latest version of bitsandbytes:
pip install -U bitsandbytes``The text was updated successfully, but these errors were encountered: