Post
François Chollet @fchollet · Feb 13, 2023
  • From Twitter

New tutorial on [link] on Focal Modulation Networks: [link] Focal Modulation is a 1:1 replacement for Self-Attention, that has the considerable advantage of being highly interpretable. A must read :)

Recommended by 1 person
1 mention
Share on Twitter Repost
Replies
Reply
No replies yet