安装后启动demo，执行submit后自动退出服务。

[fengchaobaby]

安装后启动demo，执行submit后自动退出服务。上传wav文件后demo web服务直接退出，页面打印Segmentation fault。看不到任何ERROR信息。

[sixsixcoder]

尝试安装

pip install gradio==4.44.1

[fengchaobaby]

谢谢回复，但是换你的版本问题依旧。我单步执行在执行speech_tokenizer/utils.py的extract_speech_token函数时，在执行47行torchaudio.load(utt)后就退出了。是什么原因呢。

[sixsixcoder]

你的torchaudio版本是多少，最好能看一下你的pip list还有操作步骤

[kssmmm]

我也是同样的问题，torchaudio 2.3.1，文本输入正常，音频一输入就报错退出服务。

[SteinsHead]

我这里是正常的，我的版本是下面这些，希望能给大家一些参考：

torch 2.5.1
torchaudio 2.5.1
torchmetrics 1.6.0
torchvision 0.20.1

[sixsixcoder]

这是我的开发环境可以完美运行，仅供参考，多余的依赖可以忽略，直接按照requirements.txt安装依赖应该是没问题的

absl-py                   2.1.0
accelerate                1.0.1
aiofiles                  23.2.1
aiohappyeyeballs          2.4.3
aiohttp                   3.10.10
aiosignal                 1.3.1
alembic                   1.13.3
altair                    5.4.1
annotated-types           0.7.0
antlr4-python3-runtime    4.9.3
anyio                     4.6.2.post1
argon2-cffi               23.1.0
argon2-cffi-bindings      21.2.0
arrow                     1.3.0
asttokens                 2.4.1
async-lru                 2.0.4
async-timeout             4.0.3
attrs                     24.2.0
audioread                 3.0.1
autopage                  0.5.2
babel                     2.16.0
beautifulsoup4            4.12.3
bibtexparser              2.0.0b7
bitsandbytes              0.44.1
bleach                    6.2.0
certifi                   2024.8.30
cffi                      1.17.1
cfgv                      3.4.0
charset-normalizer        3.4.0
click                     8.1.7
cliff                     4.7.0
clldutils                 3.23.1
cmaes                     0.11.1
cmd2                      2.5.0
colorama                  0.4.6
coloredlogs               15.0.1
colorlog                  6.9.0
comm                      0.2.2
conformer                 0.3.2
contourpy                 1.3.0
csvw                      3.5.1
cycler                    0.12.1
Cython                    3.0.11
debugpy                   1.8.7
decorator                 5.1.1
deepspeed                 0.15.3
defusedxml                0.7.1
diffusers                 0.31.0
distlib                   0.3.9
dlinfo                    1.2.1
einops                    0.8.0
exceptiongroup            1.2.2
executing                 2.1.0
fastapi                   0.115.4
fastjsonschema            2.20.0
ffmpy                     0.4.0
filelock                  3.16.1
flatbuffers               24.3.25
fonttools                 4.54.1
fqdn                      1.5.1
frozenlist                1.5.0
fsspec                    2024.10.0
gdown                     5.2.0
gradio                    4.44.1
gradio_client             1.3.0
greenlet                  3.1.1
grpcio                    1.67.1
h11                       0.14.0
hjson                     3.1.0
httpcore                  1.0.6
httpx                     0.27.2
huggingface-hub           0.26.2
humanfriendly             10.0
hydra-colorlog            1.2.0
hydra-core                1.3.2
hydra-optuna-sweeper      1.2.0
HyperPyYAML               1.2.2
identify                  2.6.1
idna                      3.10
importlib_metadata        8.5.0
importlib_resources       6.4.5
inflect                   7.4.0
iniconfig                 2.0.0
ipykernel                 6.29.5
ipython                   8.29.0
ipywidgets                8.1.5
isodate                   0.7.2
isoduration               20.11.0
jedi                      0.19.1
Jinja2                    3.1.4
joblib                    1.4.2
json5                     0.9.25
jsonpointer               3.0.0
jsonschema                4.23.0
jsonschema-specifications 2024.10.1
jupyter_client            8.6.3
jupyter_core              5.7.2
jupyter-events            0.10.0
jupyter-lsp               2.2.5
jupyter_server            2.14.2
jupyter_server_terminals  0.5.3
jupyterlab                4.2.5
jupyterlab_pygments       0.3.0
jupyterlab_server         2.27.3
jupyterlab_widgets        3.0.13
kiwisolver                1.4.7
language-tags             1.2.0
lazy_loader               0.4
librosa                   0.10.2.post1
lightning                 2.4.0
lightning-utilities       0.11.8
llvmlite                  0.43.0
lxml                      5.3.0
Mako                      1.3.6
Markdown                  3.7
markdown-it-py            3.0.0
MarkupSafe                2.1.5
matcha-tts                0.0.7.0
matplotlib                3.9.2
matplotlib-inline         0.1.7
mdurl                     0.1.2
mistune                   3.0.2
modelscope                1.19.2
more-itertools            10.5.0
mpmath                    1.3.0
msgpack                   1.1.0
multidict                 6.1.0
narwhals                  1.12.1
nbclient                  0.10.0
nbconvert                 7.16.4
nbformat                  5.10.4
nest-asyncio              1.6.0
networkx                  3.4.2
ninja                     1.11.1.1
nodeenv                   1.9.1
notebook                  7.2.2
notebook_shim             0.2.4
numba                     0.60.0
numpy                     1.26.4
nvidia-cublas-cu12        12.1.3.1
nvidia-cuda-cupti-cu12    12.1.105
nvidia-cuda-nvrtc-cu12    12.1.105
nvidia-cuda-runtime-cu12  12.1.105
nvidia-cudnn-cu12         9.1.0.70
nvidia-cufft-cu12         11.0.2.54
nvidia-curand-cu12        10.3.2.106
nvidia-cusolver-cu12      11.4.5.107
nvidia-cusparse-cu12      12.1.0.106
nvidia-nccl-cu12          2.20.5
nvidia-nvjitlink-cu12     12.4.127
nvidia-nvtx-cu12          12.1.105
omegaconf                 2.3.0
onnxruntime-gpu           1.19.2
openai-whisper            20240930
optuna                    2.10.1
orjson                    3.10.10
overrides                 7.7.0
packaging                 24.1
pandas                    2.2.3
pandocfilters             1.5.1
parso                     0.8.4
pbr                       6.1.0
peft                      0.13.2
pexpect                   4.9.0
phonemizer                3.3.0
pillow                    10.4.0
pip                       24.2
platformdirs              4.3.6
pluggy                    1.5.0
pooch                     1.8.2
pre_commit                4.0.1
prettytable               3.12.0
prometheus_client         0.21.0
prompt_toolkit            3.0.48
propcache                 0.2.0
protobuf                  5.28.3
psutil                    6.1.0
ptyprocess                0.7.0
pure_eval                 0.2.3
py-cpuinfo                9.0.0
pycparser                 2.22
pydantic                  2.9.2
pydantic_core             2.23.4
pydub                     0.25.1
Pygments                  2.18.0
pylatexenc                2.10
pyparsing                 3.2.0
pyperclip                 1.9.0
PySocks                   1.7.1
pytest                    8.3.3
python-dateutil           2.9.0.post0
python-dotenv             1.0.1
python-json-logger        2.0.7
python-multipart          0.0.16
pytorch-lightning         2.4.0
pytz                      2024.2
PyYAML                    6.0.2
pyzmq                     26.2.0
rdflib                    7.1.1
referencing               0.35.1
regex                     2024.9.11
requests                  2.32.3
rfc3339-validator         0.1.4
rfc3986                   1.5.0
rfc3986-validator         0.1.1
rich                      13.9.3
rootutils                 1.0.7
rpds-py                   0.20.0
ruamel.yaml               0.18.6
ruamel.yaml.clib          0.2.12
ruff                      0.7.1
safetensors               0.4.5
scikit-learn              1.5.2
scipy                     1.14.1
seaborn                   0.13.2
segments                  2.2.1
semantic-version          2.10.0
Send2Trash                1.8.3
setuptools                75.1.0
shellingham               1.5.4
six                       1.16.0
sniffio                   1.3.1
soundfile                 0.12.1
soupsieve                 2.6
soxr                      0.5.0.post1
SQLAlchemy                2.0.36
stack-data                0.6.3
starlette                 0.41.2
stevedore                 5.3.0
sympy                     1.13.1
tabulate                  0.9.0
tensorboard               2.18.0
tensorboard-data-server   0.7.2
terminado                 0.18.1
threadpoolctl             3.5.0
tiktoken                  0.8.0
tinycss2                  1.4.0
tokenizers                0.20.1
tomli                     2.0.2
tomlkit                   0.12.0
torch                     2.4.0
torchaudio                2.4.0
torchmetrics              1.5.1
torchvision               0.20.0
tornado                   6.4.1
tqdm                      4.66.6
traitlets                 5.14.3
transformers              4.45.2
triton                    3.0.0
typeguard                 4.4.0
typer                     0.12.5
types-python-dateutil     2.9.0.20241003
typing_extensions         4.12.2
tzdata                    2024.2
Unidecode                 1.3.8
uri-template              1.3.0
uritemplate               4.1.1
urllib3                   2.2.3
uvicorn                   0.32.0
virtualenv                20.27.1
wcwidth                   0.2.13
webcolors                 24.8.0
webencodings              0.5.1
websocket-client          1.8.0
websockets                11.0.3
Werkzeug                  3.0.6
wget                      3.2
wheel                     0.44.0
widgetsnbextension        4.0.13
yarl                      1.17.1
zipp                      3.20.2

[lin-xiaosheng]

这是我的开发环境可以完美运行，仅供参考，多余的依赖可以忽略，直接按照requirements.txt安装依赖应该是没问题的

absl-py                   2.1.0
accelerate                1.0.1
aiofiles                  23.2.1
aiohappyeyeballs          2.4.3
aiohttp                   3.10.10
aiosignal                 1.3.1
alembic                   1.13.3
altair                    5.4.1
annotated-types           0.7.0
antlr4-python3-runtime    4.9.3
anyio                     4.6.2.post1
argon2-cffi               23.1.0
argon2-cffi-bindings      21.2.0
arrow                     1.3.0
asttokens                 2.4.1
async-lru                 2.0.4
async-timeout             4.0.3
attrs                     24.2.0
audioread                 3.0.1
autopage                  0.5.2
babel                     2.16.0
beautifulsoup4            4.12.3
bibtexparser              2.0.0b7
bitsandbytes              0.44.1
bleach                    6.2.0
certifi                   2024.8.30
cffi                      1.17.1
cfgv                      3.4.0
charset-normalizer        3.4.0
click                     8.1.7
cliff                     4.7.0
clldutils                 3.23.1
cmaes                     0.11.1
cmd2                      2.5.0
colorama                  0.4.6
coloredlogs               15.0.1
colorlog                  6.9.0
comm                      0.2.2
conformer                 0.3.2
contourpy                 1.3.0
csvw                      3.5.1
cycler                    0.12.1
Cython                    3.0.11
debugpy                   1.8.7
decorator                 5.1.1
deepspeed                 0.15.3
defusedxml                0.7.1
diffusers                 0.31.0
distlib                   0.3.9
dlinfo                    1.2.1
einops                    0.8.0
exceptiongroup            1.2.2
executing                 2.1.0
fastapi                   0.115.4
fastjsonschema            2.20.0
ffmpy                     0.4.0
filelock                  3.16.1
flatbuffers               24.3.25
fonttools                 4.54.1
fqdn                      1.5.1
frozenlist                1.5.0
fsspec                    2024.10.0
gdown                     5.2.0
gradio                    4.44.1
gradio_client             1.3.0
greenlet                  3.1.1
grpcio                    1.67.1
h11                       0.14.0
hjson                     3.1.0
httpcore                  1.0.6
httpx                     0.27.2
huggingface-hub           0.26.2
humanfriendly             10.0
hydra-colorlog            1.2.0
hydra-core                1.3.2
hydra-optuna-sweeper      1.2.0
HyperPyYAML               1.2.2
identify                  2.6.1
idna                      3.10
importlib_metadata        8.5.0
importlib_resources       6.4.5
inflect                   7.4.0
iniconfig                 2.0.0
ipykernel                 6.29.5
ipython                   8.29.0
ipywidgets                8.1.5
isodate                   0.7.2
isoduration               20.11.0
jedi                      0.19.1
Jinja2                    3.1.4
joblib                    1.4.2
json5                     0.9.25
jsonpointer               3.0.0
jsonschema                4.23.0
jsonschema-specifications 2024.10.1
jupyter_client            8.6.3
jupyter_core              5.7.2
jupyter-events            0.10.0
jupyter-lsp               2.2.5
jupyter_server            2.14.2
jupyter_server_terminals  0.5.3
jupyterlab                4.2.5
jupyterlab_pygments       0.3.0
jupyterlab_server         2.27.3
jupyterlab_widgets        3.0.13
kiwisolver                1.4.7
language-tags             1.2.0
lazy_loader               0.4
librosa                   0.10.2.post1
lightning                 2.4.0
lightning-utilities       0.11.8
llvmlite                  0.43.0
lxml                      5.3.0
Mako                      1.3.6
Markdown                  3.7
markdown-it-py            3.0.0
MarkupSafe                2.1.5
matcha-tts                0.0.7.0
matplotlib                3.9.2
matplotlib-inline         0.1.7
mdurl                     0.1.2
mistune                   3.0.2
modelscope                1.19.2
more-itertools            10.5.0
mpmath                    1.3.0
msgpack                   1.1.0
multidict                 6.1.0
narwhals                  1.12.1
nbclient                  0.10.0
nbconvert                 7.16.4
nbformat                  5.10.4
nest-asyncio              1.6.0
networkx                  3.4.2
ninja                     1.11.1.1
nodeenv                   1.9.1
notebook                  7.2.2
notebook_shim             0.2.4
numba                     0.60.0
numpy                     1.26.4
nvidia-cublas-cu12        12.1.3.1
nvidia-cuda-cupti-cu12    12.1.105
nvidia-cuda-nvrtc-cu12    12.1.105
nvidia-cuda-runtime-cu12  12.1.105
nvidia-cudnn-cu12         9.1.0.70
nvidia-cufft-cu12         11.0.2.54
nvidia-curand-cu12        10.3.2.106
nvidia-cusolver-cu12      11.4.5.107
nvidia-cusparse-cu12      12.1.0.106
nvidia-nccl-cu12          2.20.5
nvidia-nvjitlink-cu12     12.4.127
nvidia-nvtx-cu12          12.1.105
omegaconf                 2.3.0
onnxruntime-gpu           1.19.2
openai-whisper            20240930
optuna                    2.10.1
orjson                    3.10.10
overrides                 7.7.0
packaging                 24.1
pandas                    2.2.3
pandocfilters             1.5.1
parso                     0.8.4
pbr                       6.1.0
peft                      0.13.2
pexpect                   4.9.0
phonemizer                3.3.0
pillow                    10.4.0
pip                       24.2
platformdirs              4.3.6
pluggy                    1.5.0
pooch                     1.8.2
pre_commit                4.0.1
prettytable               3.12.0
prometheus_client         0.21.0
prompt_toolkit            3.0.48
propcache                 0.2.0
protobuf                  5.28.3
psutil                    6.1.0
ptyprocess                0.7.0
pure_eval                 0.2.3
py-cpuinfo                9.0.0
pycparser                 2.22
pydantic                  2.9.2
pydantic_core             2.23.4
pydub                     0.25.1
Pygments                  2.18.0
pylatexenc                2.10
pyparsing                 3.2.0
pyperclip                 1.9.0
PySocks                   1.7.1
pytest                    8.3.3
python-dateutil           2.9.0.post0
python-dotenv             1.0.1
python-json-logger        2.0.7
python-multipart          0.0.16
pytorch-lightning         2.4.0
pytz                      2024.2
PyYAML                    6.0.2
pyzmq                     26.2.0
rdflib                    7.1.1
referencing               0.35.1
regex                     2024.9.11
requests                  2.32.3
rfc3339-validator         0.1.4
rfc3986                   1.5.0
rfc3986-validator         0.1.1
rich                      13.9.3
rootutils                 1.0.7
rpds-py                   0.20.0
ruamel.yaml               0.18.6
ruamel.yaml.clib          0.2.12
ruff                      0.7.1
safetensors               0.4.5
scikit-learn              1.5.2
scipy                     1.14.1
seaborn                   0.13.2
segments                  2.2.1
semantic-version          2.10.0
Send2Trash                1.8.3
setuptools                75.1.0
shellingham               1.5.4
six                       1.16.0
sniffio                   1.3.1
soundfile                 0.12.1
soupsieve                 2.6
soxr                      0.5.0.post1
SQLAlchemy                2.0.36
stack-data                0.6.3
starlette                 0.41.2
stevedore                 5.3.0
sympy                     1.13.1
tabulate                  0.9.0
tensorboard               2.18.0
tensorboard-data-server   0.7.2
terminado                 0.18.1
threadpoolctl             3.5.0
tiktoken                  0.8.0
tinycss2                  1.4.0
tokenizers                0.20.1
tomli                     2.0.2
tomlkit                   0.12.0
torch                     2.4.0
torchaudio                2.4.0
torchmetrics              1.5.1
torchvision               0.20.0
tornado                   6.4.1
tqdm                      4.66.6
traitlets                 5.14.3
transformers              4.45.2
triton                    3.0.0
typeguard                 4.4.0
typer                     0.12.5
types-python-dateutil     2.9.0.20241003
typing_extensions         4.12.2
tzdata                    2024.2
Unidecode                 1.3.8
uri-template              1.3.0
uritemplate               4.1.1
urllib3                   2.2.3
uvicorn                   0.32.0
virtualenv                20.27.1
wcwidth                   0.2.13
webcolors                 24.8.0
webencodings              0.5.1
websocket-client          1.8.0
websockets                11.0.3
Werkzeug                  3.0.6
wget                      3.2
wheel                     0.44.0
widgetsnbextension        4.0.13
yarl                      1.17.1
zipp                      3.20.2

遇到了一样的问题，新建conda环境，直接按照requirements.txt安装依赖，在gradio中submit音频后出现
Floating point exception (core dumped)
之后模型直接终止，可否麻烦您看一下

[sixsixcoder]

Floating point exception (core dumped)

可以给出更详细的报错信息吗

[lin-xiaosheng]

Floating point exception (core dumped)

可以给出更详细的报错信息吗

这是控制台从启动到结束的所有信息
(glm) root@autodl-container-9ef943a6c4-5e23a6d1:~/autodl-tmp/GLM-4-Voice# python model_server.py --host localhost --model-path THUDM/glm-4-voice-9b --port 10000 --dtype int4 --device cuda:0
Loading checkpoint shards: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:06<00:00, 1.69s/it]
INFO: Started server process [26168]
INFO: Waiting for application startup.
INFO: Application startup complete.
INFO: Uvicorn running on http://localhost:10000 (Press CTRL+C to quit)
INFO: 127.0.0.1:38002 - "POST /generate_stream HTTP/1.1" 200 OK
Floating point exception (core dumped)

[sixsixcoder]

Floating point exception (core dumped)

可以给出更详细的报错信息吗

这是控制台从启动到结束的所有信息 (glm) root@autodl-container-9ef943a6c4-5e23a6d1:~/autodl-tmp/GLM-4-Voice# python model_server.py --host localhost --model-path THUDM/glm-4-voice-9b --port 10000 --dtype int4 --device cuda:0 Loading checkpoint shards: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:06<00:00, 1.69s/it] INFO: Started server process [26168] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://localhost:10000 (Press CTRL+C to quit) INFO: 127.0.0.1:38002 - "POST /generate_stream HTTP/1.1" 200 OK Floating point exception (core dumped)

可以打印一下报错代码的位置，以及相关的变量吗

[lin-xiaosheng]

Floating point exception (core dumped)

可以给出更详细的报错信息吗

这是控制台从启动到结束的所有信息 (glm) root@autodl-container-9ef943a6c4-5e23a6d1:~/autodl-tmp/GLM-4-Voice# python model_server.py --host localhost --model-path THUDM/glm-4-voice-9b --port 10000 --dtype int4 --device cuda:0 Loading checkpoint shards: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:06<00:00, 1.69s/it] INFO: Started server process [26168] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://localhost:10000 (Press CTRL+C to quit) INFO: 127.0.0.1:38002 - "POST /generate_stream HTTP/1.1" 200 OK Floating point exception (core dumped)

可以打印一下报错代码的位置，以及相关的变量吗

详细地查找了一下资料，我这边的报错
Floating point exception (core dumped)
与glm4模型及项目无关，该报错是由于使用H20显卡引起的。
详细可参见vllm-project/vllm#4392
按照该地址的解决方案我已将其解决。
不好意思给开发人员们带来困扰

[sixsixcoder]

感谢您帮忙排查问题，看起来是H20显卡不支持bf16类型加载的问题，请有同样问题的开发者移步 vllm-project/vllm#4392 尝试解决该问题