Benchmark ResidualMoE on real REDD data - #13
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What changed
ResidualMoEas a residual mixture-of-experts family0769d00893a178277d06e83ccd2e92c03a5ba9efT0 result
Protocol: corrected T1 REDD, building 1 fridge, 60 s sampling, sequence length 299, 3 epochs, 3960-sample limit, seeds 10/20/42, NVIDIA A100-SXM4-80GB.
ResidualMoE improves over its TimesNet anchor on this slice (53.54 MAE, 0.728 F1) and over the earlier unconstrained NILMMoE (56.90 MAE, 0.707 F1). It is not the overall winner: NILMFormer remains rank 1 at 48.09 MAE. The result is retained without post-hoc tuning.
Provenance and reproducibility
e33b94d44d07b098f774e8569298c9853dd714220769d00893a178277d06e83ccd2e92c03a5ba9efnilmbench:t0-e33b94d-cudasha256:3eb89c6d2bcdc8942426e359ed8b1b6ed74108060d86a293101a186844347c86757e694a420157aa035c8fd345915080c2396cb7a37bfeb5f925bcb84f9532b8Verification
srcandtestsuv lock --checkpassedleaderboard.jsonandleaderboard.csvare byte-identical to the committed artifactsgit diff --checkpassed