Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Graph on page 219 has kernel sizes wrong. #3

Open
uzair789 opened this issue Feb 24, 2023 · 1 comment
Open

Graph on page 219 has kernel sizes wrong. #3

uzair789 opened this issue Feb 24, 2023 · 1 comment

Comments

@uzair789
Copy link

uzair789 commented Feb 24, 2023

Hi Chip and team, thank you for the excellent book on ML systems design. I was going through the book and found that there is a mistake (typo) in the Graph optimization figure on page 219. The original graph, and the optimized graphs have different kernel sizes which is incorrect. I checked the cited reference link here at nvidia and indeed the original graph has a mistake on the kernel sizes. Two of the 3x3 kernels taking input from the input node must be 1x1 and two of the three 3x3 kernels in the next layer must be 5x5 and 1x1. Because this is an optimization, I thought the kernel sizes are also being optimized but after thinking about it for a while, I figured the weight dimensions will change and the trained weights will not work if that is the case.

Just wanted to make a note here in case somebody else also notices this and also if you would like to fix it in the future editions. Thank you for the amazing work once again.

@uzair789
Copy link
Author

A small typo on page 218 as well in the code block. In the optimized code, A[i, i] should actually be A[i, 1]. Just adding here as a comment to make a note as this is trivial.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant