Self-Attention

• Self-Attention

  Attention where query, key, and value vectors come from the same input sequence; enables capturing dependencies within a sequence.