Attention
2014
Let the model weigh which inputs matter for each output. Bahdanau 2014 for translation. Self-attention made it the whole model in 2017.
Sources: AI4U editorial.
2014
Let the model weigh which inputs matter for each output. Bahdanau 2014 for translation. Self-attention made it the whole model in 2017.
Sources: AI4U editorial.