From ccc14611524687282346073c773368e08482ca30 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?=E9=9B=81=E8=A1=8C?= Date: Tue, 5 Dec 2023 09:16:37 +0800 Subject: [PATCH] 4 thread --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 786c9cd0..60288355 100644 --- a/README.md +++ b/README.md @@ -76,7 +76,7 @@ llm模型导出onnx模型请使用[llm-export](https://github.com/wangzhaode/llm - 测试设备: PC - 处理器: Intel(R) Core(TM) i7-13700K @ 3.40 GHz - 内存大小: 32 GB -- 速度: prefill / decode `tok/s` +- CPU 4线程速度: prefill / decode `tok/s` ### 下载int4模型