Skip to content
Learn AI by building
← World of AI

Generative AI

BERT

An encoder trained by masking words — still the workhorse for classification and search.

BERT hides a fraction of the tokens and trains the model to fill them in, using context from both directions. That produces representations well suited to understanding rather than generation.

For classification, entity extraction and search relevance, a fine-tuned encoder of this kind is usually cheaper, faster and more accurate than prompting a large generative model.

Also in Generative AI

JOIN NOW

Begin the first module

It is free, it is the real curriculum, and if it is not for you, you have lost nothing but an evening.

Join any time · Build AI skills at your pace