Residual connections
2015
Add the input of a block to its output. ResNet 2015. Makes very deep networks trainable. Inside every Transformer block.
Sources: AI4U editorial.
2015
Add the input of a block to its output. ResNet 2015. Makes very deep networks trainable. Inside every Transformer block.
Sources: AI4U editorial.