JRY's digital garden

Tag: transformer

10 items with this tag.

  • Jun 01, 2026

    RoPE

    • positional-encoding
    • transformer
    • relative-position
  • Jun 01, 2026

    Transformer

    • transformer
    • architecture
    • deep-learning
  • Jun 01, 2026

    GQA

    • attention
    • memory-optimization
    • transformer
  • Jun 01, 2026

    LinearTransformation

    • linear-algebra
    • transformer
    • math-foundation
  • Jun 01, 2026

    MultiHeadAttention

    • attention
    • transformer
    • architecture
  • Jun 01, 2026

    PositionalEncoding

    • transformer
    • position
    • encoding
  • Jun 01, 2026

    ALiBi

    • transformer
    • position
    • attention
  • Apr 10, 2026

    Transformer中QKV矩阵分别代表什么

    • ai
    • transformer
    • nlp
    • attention
  • Apr 10, 2026

    Transformer深入理解:从编解码到注意力机制

    • ai
    • transformer
    • nlp
    • attention
  • Apr 10, 2026

    关于Transformer和MoE框架的一点思考

    • ai
    • transformer
    • moe
    • architecture

Created with Quartz v4.5.1 © 2026

  • GitHub
  • Discord Community