Skip to content
AImpact
IT EN
Inference Intermediate

Softmax

A math function that turns a set of logits into probabilities that sum to 1, amplifying high values and squashing low ones.

ShareLinkedInX

In practice

It is the last step before picking the next token: it tells how strongly the model "believes" in each option. It also appears inside attention to weight context tokens. If you call APIs it is invisible; if you study models, it is one of the most recurring functions.

Related terms

Seen in the wild

0 entries mentioning it

No archive entry mentions it explicitly. Appears in broader contexts.

← All terms