Skip to content

Same transformation for query and key in APNB? #22

Description

@kaigelee

我在#16看到了相同的问题,但是没有解决我的困惑。
“Hi, the implementation of sharing the query and key branch follows Fig. 3 in the arxiv version.”
但是我在arxiv version fig. 3中看到的是key和value共享,而代码实现中是query和key共享,这有什么区别吗?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions