Open source implementation of google's nested learning paper
-
Updated
Dec 10, 2025 - Python
Open source implementation of google's nested learning paper
Google latest research paper "Nested Learning: The Illusion of Deep Learning Architectures" : Implemented in pytorch with handwritten notes. Do give a star if you find this valuable.
Independent implementation of memory-augmented prompt optimization
Exploring new trendencies in numerical optimization applied on PINNs. An example with the nonlinear TDSE.
This experiment was inspired by my (so far partial) lecture on Nested Learning: The Illusion of Deep Learning Architecture. The basic idea (at least what I understood) to motivate this experiment is that the Momentum optimizer mechanic is a long-term memory mechanism.
A CPU-only measurement instrument for the timescale spectrum and aging dynamics of a model's memory (continual learning / long-term memory). Is your memory really multi-timescale, or secretly single-speed? MIT.
Add a description, image, and links to the nested-learning topic page so that developers can more easily learn about it.
To associate your repository with the nested-learning topic, visit your repo's landing page and select "manage topics."