Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tesla-T4(16G)finetune修改batch_size时总是被Killed #40

Open
LuoFanA595 opened this issue Nov 7, 2022 · 0 comments
Open

Tesla-T4(16G)finetune修改batch_size时总是被Killed #40

LuoFanA595 opened this issue Nov 7, 2022 · 0 comments

Comments

@LuoFanA595
Copy link

image
实际显存占用率也不高,自身分词数据只有120M大小, 修改batch_size=16或者32时均被Killed,只能使用源码batch_size=8.
使用Tesla-T4训练1个Epoch都需要一周时间~~ 有没有大佬遇到这种问题该怎么解

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant