Describe the question you meet
I want to achieve a distillation method that may require the teacher and student gradients of certain modules in the current batch. Is it possible to create a recorder to record a backward hook? I just need a general idea if it is possible to modify or create a new recorder.
Also, I am using the mmdetection3.x detectors model, those models are supported in MMrazor 1.0, right?
Any thoughts will be helpful!
Describe the question you meet
I want to achieve a distillation method that may require the teacher and student gradients of certain modules in the current batch. Is it possible to create a recorder to record a backward hook? I just need a general idea if it is possible to modify or create a new recorder.
Also, I am using the mmdetection3.x detectors model, those models are supported in MMrazor 1.0, right?
Any thoughts will be helpful!