Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Invalid model ids in config.ts for Qwen2.5? #578

Closed
johannesstricker opened this issue Sep 26, 2024 · 1 comment
Closed

Invalid model ids in config.ts for Qwen2.5? #578

johannesstricker opened this issue Sep 26, 2024 · 1 comment

Comments

@johannesstricker
Copy link

Hey, first of all thanks for the awesome work in this repository 🙌

I've just tried the new Qwen2.5 models, but looking through the config.ts I realized that some of the models seem to link to different versions on Huggingface. The one in the screenshot, for example, has the model id of Qwen2.5, but it seems to link to Qwen2.0.

CleanShot 2024-09-26 at 10 28 23

Now I'm wondering: is only the meta information incorrect, or am I actually using the older 2.0 model, when I choose this model id? 🤔

@CharlieFRuan
Copy link
Contributor

CharlieFRuan commented Sep 26, 2024

Ahh thanks for the catch! I took a pass and Qwen2.5-0.5B-Instruct-q0f16-MLC should be the only one mistaken here.

Note that model_id and model should match (i.e. the weights). But not necessarily the model_lib. In this case, Qwen2.5-0.5B can reuse the WASM for Qwen2-0.5B, since there is no architectural change, only weights change.

Fixed it here: d4af932

Reflected in 0.2.69: #579

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants