A list of new attention layers to be added
You can pick any of the following frameworks and implement your layers:




To contribute, please:
- Create a new issue, copy an available (not closed and not opened by someone else) subtask name and paste it in the title followed by the reference of the task. (ex. subtask_name #source_issue_number). Make sure the subtask is not already opened by someone else. Another way is to hover over the subtasks and click on the
Open convert to issue
- Copy and paste your new issue link here in the comments.
- Fork the repository
- Add your changes
- Create a pull request and mention your issue link
Please note that we use Numpy style for the docstrings and provide examples as much as possible!
Also please try to provide unit tests using Pytest
Whenever you need help with implementation or any other related issues you might be dealing with, please reach out to me via discussions or Discord server community @soran-ghaderi or @sigma1326
A list of new attention layers to be added
You can pick any of the following frameworks and implement your layers:




To contribute, please:
Open convert to issuePlease note that we use Numpy style for the docstrings and provide examples as much as possible!
Also please try to provide unit tests using Pytest
Whenever you need help with implementation or any other related issues you might be dealing with, please reach out to me via discussions or Discord server community @soran-ghaderi or @sigma1326