Transformers

It is a library that defines and trains machine learning models for different types of data, such as text, images, audio, and video. It centralizes model definitions by working in harmony with various training frameworks and inference engines, such as PyTorch. It provides access to over a million model checkpoints hosted on the Hugging Face Hub.

TR

huggingface · Translation & NLP

STARS168.4K
FORKS35.1K
COMMITS—
CONTRIBUTORS4.0K
VERSIONv5.9.0
UPDATEDtoday
NLPtransformersbertllmApache-2.0

Common commercial products in this category: Google Translate, DeepL, Microsoft Translator

What can it do?
  • You can make inferences and training operations on text, images, audio and video data.
  • You can include over a million pre-trained models on the Hugging Face Hub in your projects.
  • You can create model definitions compatible with different training frameworks and inference engines.
Heads up
  • • High number of open issues (1,027)
User reviews
  • • NeutralHacker News

    Transformers Explained Visually

    “It isn't so much that "other setups didn't work". More like "the first thing we found that did work turned out to be the minimal thing that could work". Transformers are conventional feed-forward neural networks alternated with attention blocks. You can think of them as big huge…”

  • • NeutralHacker News

    Transformers Explained Visually

    “If I had to summarize this in with sentences then here is my attempt. Transformer training can be parallelized easily, making it possible to use brute force to train the neural network quickly (bitter lesson rewards compute friendly scalable architectures). Transformers have…”

Verified against README · Oct 26, 2026 · source

My note

Alternative pages

More in: Translation & NLP