Skip to content

Fix: Removed errors for n-dimensional gradients.#65

Open
gslama12 wants to merge 2 commits into
jiaweizzhao:masterfrom
gslama12:master
Open

Fix: Removed errors for n-dimensional gradients.#65
gslama12 wants to merge 2 commits into
jiaweizzhao:masterfrom
gslama12:master

Conversation

@gslama12

Copy link
Copy Markdown

Example: For CNNs the gradient can have more than 2 dimensions. This pull request allows to use the GaloreProjector for n-dimensional gradients. This was tested on the ResNet and MobileNet architecture.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant