New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ppo训练相关问题 #6419

Open

ccp123456789 opened this issue Dec 22, 2024 · 0 comments

Labels

pending

ccp123456789 commented Dec 22, 2024

PPO训练时候，--reward_model 指向的奖励模型是合并后的还是lora权重？如果想指向合并后的，怎么写？
合并reward模型后，可以怎么推理？想用来给答案打分

github-actions bot added the pending label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment