Sahaj.blogs

Day page

2 Nov 2023

AI updates

Transformers 4.35: safetensors by default, Distil-Whisper, Fuyu

Hugging Face Transformers v4.35 made safetensors the default serialization format and added models including Distil-Whisper (6× faster than Whisper) and Adept's Fuyu-8B.

  • Distil-Whisper keeps Whisper's whole encoder but only 2 decoder layers, making it 6× faster and 49% smaller.
  • Fuyu treats image patches like text tokens in a plain decoder, with no separate image encoder model.

Read the post →