英和和英

名詞

self-attention (uncountable)

1. (machine learning) A form of attention (machine learning method) where input sequence is compared with itself, i.e. the keys and queries are the same.

   Antonym: cross-attention

2. (psychology) Conscious attention to one's own physiological and emotional state and behavior.
   • 1986, Ralf Schwarzer, editor, Self-related Cognitions in Anxiety and Motivation‎, Psychology Press, →ISBN:

     According to self-attention theory in general, it can be predicted that heightened self-attention leads to a closer fit between observed behavior and some underlying salient standard.

   • 2012, C. S. Carver, M. F. Scheier, Attention and Self-Regulation, page 45:

     Interest in the consequences of self-attention spread fairly quickly from social to personality psychologists.

参考

• transformer

Further reading

• attention (machine learning) on Wikipedia.Wikipedia