This repository has been archived by the owner on Mar 12, 2024. It is now read-only.

Why positional encoding is added to different role in encoder and decoder. #607

Open

Kami-chanw opened this issue Oct 9, 2023 · 1 comment

Kami-chanw commented Oct 9, 2023

In figure above, positional encoding is add to K Q, but why not add to V? Besides, positional encoding is add to K (but not include Q and V)?

psc1453 commented Nov 15, 2023

Same question

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.