You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Congratulations you guys make a big progress in deep learning nerual nets.
I found an interesting thing in the model initialization, the diff is so large when BN module initialized with normal distribution, as the weights is 1 and bias is zero.
There must be something I didn’t know.
Wish you guys can help me to figure this out.
The text was updated successfully, but these errors were encountered:
Congratulations you guys make a big progress in deep learning nerual nets.
I found an interesting thing in the model initialization, the diff is so large when BN module initialized with normal distribution, as the weights is 1 and bias is zero.
There must be something I didn’t know.
Wish you guys can help me to figure this out.
The text was updated successfully, but these errors were encountered: