Information theory
1948
Shannon's measure of information. Entropy, bits and cross-entropy, the loss that language models minimise.
Sources: AI4U editorial.
1948
Shannon's measure of information. Entropy, bits and cross-entropy, the loss that language models minimise.
Sources: AI4U editorial.