add spatial folding, matrix induction, and rule switching tasks - #48
Draft
sileod wants to merge 5 commits into
Draft
add spatial folding, matrix induction, and rule switching tasks#48sileod wants to merge 5 commits into
sileod wants to merge 5 commits into
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds three procedural tasks under
reasoning_core/tasks/generated/targeting cognitive factors not cleanly isolated by the existing gallery:spatial_folding: fold/unfold spatial transformation with canonical row-major hole coordinates.matrix_induction: multi-attribute 3x3 rule induction over an explicit finite rule family. Instances are accepted only when every rule consistent with the visible matrix agrees on the missing value, so answer uniqueness does not depend on uniqueness of the latent generating rule.rule_switching: symbolic state tracking under changing opcode semantics. Generated traces certify a minimum dependency depth and require the same opcode to have different meanings across modes along the queried value's actual backward lineage.Difficulty scales folds/punches, active matrix attributes/harder rule positions, and register width/update depth/mode count respectively.
Validation
Validated against the real repository environment with
task.validate(n_samples=20)for each task at every level 0 through 5. All 18 task/level combinations passed, including the serialize/deserialize scoring round trip.Additional generator stress checks used 100 instances per level to verify:
The temporary validation workflow pinned
xxhash<4because the repository's current unconstrainedxxhashdependency resolves to 4.0.0, whose string hashing API is incompatible with the existingtemplate.pycall. That compatibility issue predates and is outside this PR; the PR itself changes only the three generated task files.