upcarta
Sign In
Sign Up
Explore
Search
Keras documentation: Focal Modulation: A replacement for Self-Attention
Article
Jan 25, 2023
#ComputerProgramming
Aritra Roy Gosthipaty
@ariG23498
(Author)
Follow
Ritwik Raha
@ritwik_raha
(Author)
Follow
keras.io
Read on keras.io
1
Recommender
1
Mention
Recommend
Post
Save
Complete
Collect
Mentions
See All
François Chollet
@fchollet
·
Feb 13, 2023
Post
From
Twitter
New tutorial on [link] on Focal Modulation Networks: [link] Focal Modulation is a 1:1 replacement for Self-Attention, that has the considerable advantage of being highly interpretable. A must read :)
