So you think you know distillation; it's easy, right? We thought so too with @XiaohuaZhai @__kolesnikov__ @_arohan_ and the amazing @royaleerieme and Larisa Markeeva. Until we didn't. But now we do again. Hop on for a ride (+the best ever ResNet50?

So you think you know distillation; it's easy, right?

We thought so too with @XiaohuaZhai @__kolesnikov__ @_arohan_ and the amazing @royaleerieme and Larisa Markeeva.

Until we didn't. But now we do again. Hop on for a ride (+the best ever ResNet50?)

🧵👇arxiv.org/abs/2106.05237

Mentions

See All

Pavel Izmailov @Pavel_Izmailov · Jun 11, 2021

Post
From Twitter

Also, see this nice tread on a paper by @giffmana @XiaohuaZhai @__kolesnikov__ @_arohan_ @royaleerieme and Larisa Markeeva: The paper came out just two days ago and is very related!

Tweet by Lucas Beyer

Tweet

Mentions