self-attention

Questions

What does self-attention mean?

A form of attention (machine learning method) where input sequence is compared with itself, i.e. the keys and queries are the same.

Where does self-attention come from?

From self- + attention.

How to pronounce self-attention

1. Open the pronunciation page — Open the Speakur entry for “self-attention”.
2. Read the phonetic spelling — Read the IPA spelling () so you know which sounds to aim for.
3. Play the audio — Click Play to hear reference audio for “self-attention”.
4. Repeat and practice — Say “self-attention” aloud, matching stress and vowels until it feels natural.