Skip to content
nfgalindez-aikoPublic

About

Debiased perturbational complexity (PCIst-XV) and reproducible dimensionality (R-dim) with built-in null controls

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

53 Commits

Folders and files

Repository files navigation

rdim — perturbational complexity that cannot flatter itself

Debiased perturbational complexity (PCIst-XV) and reproducible dimensionality (R-dim) for evoked responses — EEG, iEEG, LFP, MEA, simulations. A drop-in, bias-free alternative to standard PCIst, with null controls built in.

Why

The standard PCIst pipeline selects its SVD basis, its components and its thresholds on the same data it then quantifies. On high-dimensional low-SNR data this inflates the index in the complete absence of any response — up to values typical of wakeful human cortex (details, boundary conditions and human validation: Galindez 2026, doi:10.5281/zenodo.22100546). rdim makes every selection on half the trials and counts state transitions on the other half; the bias is gone by construction, at no cost in sensitivity (AUC ≥ standard in every regime tested).

On identical no-response data (32 channels, correlated noise, 40 trials):

standard PCIst rdim XV
sham (no response at all) 214.1 4.9

Install / use

pip install numpy
# copy the rdim/ folder (single dependency: numpy)
from rdim import perturbational_complexity, null_floor

r = perturbational_complexity(trials, times, baseline=(-400, -50), response=(0, 300))
null = null_floor(trials, times, baseline=(-400, -50), response=(0, 300))

print(r["xv"])                             # debiased complexity
print(r["rdim"])                           # reproducible dimensionality of the response
print((null["xv"]   >= r["xv"]).mean())    # p-value against the built-in null
print((null["rdim"] >= r["rdim"]).mean())  # ...and R-dim needs its own

trials: array (n_trials, n_channels, n_times). That's it.

Report rule we propose to the field: no perturbational-complexity value without its paired null. null_floor erases the time-locking by circular trial shifts while preserving every trial's spectrum — if your effect does not clear it, you have measured your pipeline.

R-dim needs its null for a second reason, and this one is a property of the quantity itself. R-dim sums per-component cross-half correlations clipped at zero, so the clip keeps only the positive half of the noise and R-dim has a strictly positive floor under the no-response null — a floor that grows with the number of retained components, i.e. with channel or unit count. Measured here: ≈0.2–0.5 at tens of channels, ≈2.5 for populations of several hundred units, and flat in trial count. Consequences, in one line each:

  • Rank statistics, growth with trials, and contrasts at matched coverage are safe — the floor is a common additive offset.
  • Absolute levels are not, and neither are comparisons of level across modalities or systems with different component counts. Report those against null_floor(...)["rdim"].

The known-truth bench in tests/ also calibrates the other direction: with k orthogonal coherent directions injected, R-dim recovers k when the signal is strong (k = 3/5/10 read as 3.13/5.11/10.10) and under-reads monotonically as per-component SNR falls (at SNR 0.5, k = 5 reads 1.76). A pure change of gain, with the repertoire untouched, therefore shows up as a change in R-dim. If two conditions differ in evoked amplitude, that must be reported alongside any R-dim difference between them.

Versions

v0.2.0 — null_floor now returns {"xv": ..., "rdim": ...} (it returned the xv array only, which made the R-dim floor unmeasurable with the published tool; pass quantity="xv" for the old shape). Adds the known-truth bench and the SNR calibration above. The estimator itself is byte-for-byte unchanged from v0.1.0, so every number in the papers that cite rdim v0.1.0 reproduces exactly under v0.2.0.

What R-dim means

R-dim counts how many principal directions of the evoked response replicate across independent halves of your trials — the response's reproducible dimensionality. In 366 core simulated recurrent networks it is the quantity that perturbational complexity actually tracks (ρ = 0.74), maximal at the edge of chaos and destroyed by both order and chaos (doi:10.5281/zenodo.22100826). It requires simultaneous sensitivity and stability — which may be why the brain only exhibits it awake.

Validation

tests/test_rdim.py — sham floor, rich-vs-stereotyped discrimination, null calibration, determinism. The independently written state-transition core (from the published equations) reproduces the reference PCIst implementation exactly (r = 1.0000 on 16 cases). Full validation battery: the 27-experiment suite in the project's reproducibility archive.

Cite

If you use rdim, cite the software (CITATION.cff) and the companion preprints. Always use the concept DOI below: it resolves to the latest version of each preprint.

  1. Galindez N (2026). Selection bias can inflate the Perturbational Complexity Index (PCIst) in high-dimensional low-SNR regimes. Zenodo. https://doi.org/10.5281/zenodo.22100546
  2. Galindez N (2026). Debiased perturbational complexity peaks at the edge of chaos. Zenodo. https://doi.org/10.5281/zenodo.22100826
  3. Galindez N (2026). A replicated, control-passing association between resting spectral slope and TMS-evoked complexity fails blind preregistered confirmation. Zenodo. https://doi.org/10.5281/zenodo.22101059
  4. Galindez N (2026). What must a theory of perturbational complexity explain? Zenodo. https://doi.org/10.5281/zenodo.22168190
  5. Galindez N (2026). The reproducible dimensionality of the human intracranial evoked response grows without detectable ceiling up to 480 trials. Zenodo. https://doi.org/10.5281/zenodo.22120069
  6. Galindez N (2026). Debiased reproducible dimensionality is lower under isoflurane than in wakefulness in the same mouse brain, at matched trial counts and stimulation currents. Zenodo. https://doi.org/10.5281/zenodo.22133403
  7. Galindez N (2026). Field-level perturbational complexity is not a proxy for neuronal reproducible dimensionality; its within-brain state changes co-vary in direction. Zenodo. https://doi.org/10.5281/zenodo.22168242
  8. Galindez N (2026). The mechanics of the inverted-U: an exact linear theory of reproducible dimensionality, and what governs its rise and fall. Zenodo. https://doi.org/10.5281/zenodo.22168299
  9. Galindez N (2026). The edge of chaos is the throne of time, not of richness. Zenodo. https://doi.org/10.5281/zenodo.22168818
  10. Galindez N (2026). The lifetime of the coherent response: sealed laws of its rise, its peak, and its fall. Zenodo. https://doi.org/10.5281/zenodo.22238034
  11. Galindez N (2026). What an adversarial audit of a preregistered program finds. Zenodo. https://doi.org/10.5281/zenodo.22240037

Authors

Nicolás Galindez (ORCID 0009-0000-8207-0536). Developed with substantial AI assistance (Claude, Anthropic) under the author's direction and review. MIT license (see LICENSE).

About

Debiased perturbational complexity (PCIst-XV) and reproducible dimensionality (R-dim) with built-in null controls

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages