Attention

What is attention ？

Attention Mechanism is an attempt to implement the same action of selectively concentrating on a few relevant things while ignoring others in deep neural networks

Why is Attention needed in deep learning ？

Self-Attention

  • intra-attention
Table Of Contents
Attention
Self-Attention