Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

权重衰减可以通过 torch.optim.lr_scheduler 的相关类完成，从而使权重衰减和训练逻辑分离 #44

Open
xiaoyuan0203 opened this issue Jun 19, 2022 · 0 comments
Open

权重衰减可以通过 torch.optim.lr_scheduler 的相关类完成，从而使权重衰减和训练逻辑分离 #44

xiaoyuan0203 opened this issue Jun 19, 2022 · 0 comments

Comments

@xiaoyuan0203
Copy link

@L1aoXingyu

作者你好，非常感谢您的分享。这里我提出一点小小的意见。

权重衰减可以通过 torch.optim.lr_scheduler 的相关类如 ExponentialLR完成，从而使权重衰减和训练逻辑分离。作权重衰减相关介绍的时候可以这么来介绍（实际使用也是这么使用比较广泛）。

https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@xiaoyuan0203