Claude Shannon

30 April 1916 – 24 February 2001

Founder of information theory. His 1948 paper defined the bit and entropy, the measure every language model is trained to reduce.

American mathematician and information theorist (1916–2001)