Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Change learning rate for segmentation configs to 0.002 #722

Merged
merged 3 commits into from
Dec 6, 2024
Merged

Change learning rate for segmentation configs to 0.002 #722

merged 3 commits into from
Dec 6, 2024

Conversation

nkaenzig
Copy link
Collaborator

@nkaenzig nkaenzig commented Dec 3, 2024

Turns out that 0.0001 is too low, leading to some evals not converging.
0.002 seems to work well across all current models.

@nkaenzig nkaenzig self-assigned this Dec 3, 2024
@nkaenzig nkaenzig marked this pull request as ready for review December 4, 2024 07:22
@nkaenzig nkaenzig requested a review from roman807 December 4, 2024 07:22
@nkaenzig nkaenzig enabled auto-merge (squash) December 6, 2024 09:08
@nkaenzig nkaenzig merged commit 9c1c29d into main Dec 6, 2024
6 checks passed
@nkaenzig nkaenzig deleted the update-segmentation-learning-rate branch December 6, 2024 09:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@roman807 roman807 roman807 approved these changes

Assignees

@nkaenzig nkaenzig

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@nkaenzig @roman807