JRY's digital garden
Search
Search
Dark mode
Light mode
Explorer
Tag: transformer
10 items with this tag.
Jul 09, 2026
MultiHeadAttention
attention
transformer
architecture
Jul 09, 2026
PositionalEncoding
transformer
position
encoding
Jul 09, 2026
RoPE
positional-encoding
transformer
relative-position
Jul 09, 2026
Transformer
transformer
architecture
deep-learning
Jul 09, 2026
ALiBi
transformer
position
attention
Jul 09, 2026
GQA
attention
memory-optimization
transformer
Jul 09, 2026
LinearTransformation
linear-algebra
transformer
math-foundation
Apr 10, 2026
Transformer中QKV矩阵分别代表什么
ai
transformer
nlp
attention
Apr 10, 2026
Transformer深入理解:从编解码到注意力机制
ai
transformer
nlp
attention
Apr 10, 2026
关于Transformer和MoE框架的一点思考
ai
transformer
moe
architecture