Dynamic weight multiloss

[bhack]

Is there any recommended approach to adjusting the dynamic weighting/scheduling of multiple losses to better fit the schedule-free logic?

I am currently decreasing an auxiliary loss weight over epochs but I don't know if this is going to negatively impact the scheduler free logic.

[adefazio]

I haven't experimented with anything along those lines. My guess is that it should work fine.