After the mm_vision_tower and mm_mlp_adapter of llava-onevision-qwen2-7b-ov were fine-tuned, the model parameter shape did not match after the fine-tuning

[zyf8818]

After the mm_vision_tower and mm_mlp_adapter of llava-onevision-qwen2-7b-ov were fine-tuned, the model parameter shape did not match after the fine-tuning.

This is my training setting:after fine-tuning, when I load the fine-tuned model there is an error:

[zyf8818]

I used zero2 and zero3 respectively, but the fine-tuned model would report errors during the loading process. Is this caused by improper parameter setting?

[zyf8818]

another information for this error: