Release 2.1.0 — modern complex-valued architectures - #14
Merged
Conversation
A large modern-architecture expansion of complextorch.nn / .models / .signal: - Positional encodings: RotaryEmbedding (RoPE), SinusoidalPositionalEncoding, CoPE; wired into MultiheadAttention (rotary=) and ViT (pos_encoding=). - Holographic (interference-aware) attention + HolographicReconstructionLoss and phase_smoothness anti-phase-collapse safeguards. - Diagonal-complex state-space models: S4D, DSS, S4DBlock, and a selective MambaBlock (FFT long-conv == exact recurrence, verified). - Unitary complex RNN (UnitaryRNN/Cell) via the Cayley transform. - Learnable time-frequency front-ends: STFT/InverseSTFT (tie windows for exact inversion) and ComplexGaborConv1d/MorletConv1d filterbanks. - Complex-valued KAN (CVKANLayer + CVKAN model). - Steinmetz & Analytic networks + AnalyticSignalLoss; analytic_signal/hilbert signal utilities. Also fixes wFMConvStrict2d to compute the phase mean as the circular (Fréchet) mean on SO(2) instead of an arithmetic mean of raw angles — correct across the ±π branch cut and exactly U(1)-equivariant. Lands with full tests (100% coverage maintained), rST/LaTeX docstrings, concept pages, getting-started examples, and a CHANGELOG entry. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Single-commit 2.1.0 release on top of the 2.0.1 line (now on
main). 734 tests / 100% coverage;ruff check,ruff format --check, andsphinx -Wall clean.Adds: complex positional encodings (RoPE/sinusoidal/CoPE), holographic (interference-aware) attention, diagonal-complex state-space models (S4D/DSS/S4DBlock/MambaBlock), unitary RNN, learnable STFT/Gabor/Morlet front-ends, complex KAN, and Steinmetz/Analytic networks (+
analytic_signal/hilbert).Also fixes
wFMConvStrict2dto use the circular (Fréchet) mean on SO(2) instead of an arithmetic mean of raw angles — correct across the ±π branch cut and exactly U(1)-equivariant (verified by a new branch-cut test).Supersedes the earlier #13 (which was mistakenly based on the
2.0.1branch). The 2.0.1 work it depended on is now merged intomainseparately.🤖 Generated with Claude Code