elemennt_wise_web April 18, 2019 by Kate Koidan Element-wise product of query and key vectors, for query at position i and key at position j = i+1, for i = 2, 8, 14. Note that the active neurons differ in each case.
Leave a Reply
You must be logged in to post a comment.