Phase-aware LLM activation steering and linear probing. A memory-efficient, practical implementation of Representation Engineering (RepE) for safety research.
🏛️ Champollion cracked hieroglyphs in 1822. I applied the same logic to LLM internals. 95% accuracy, $0 cost, fully reproducible. Contributors welcome.
Layer-wise hidden-state probing for early detection of harmful intent in small instruction-tuned language models.
Do LLMs know when to say no? Extending Apple's ICLR 2025 instruction-following probes to agentic tool calling.
EECS E6895 final project measuring reward-gaming behavior in Gemma 2B with shell-game evals, LoRA SFT, and leakage-aware probes.
White-box detection of collusion in an untrusted monitor: model organisms, linear probes, and a control evaluation that prices what they buy.
Study 1 of the Hebbian Belief-State World Model: does a BDH core's plastic synapse state encode linearly readable beliefs? A preregistered negative result.
Open-source agent skills for Claude Code, Codex, GitHub Copilot, and other coding agents: GPT-5.6-style rigor, delegation, linear probes, and self-evolving workflows.
Research: can LLM internal activations predict reasoning failure before it's visible? Linear probe on DeepSeek-R1 hidden states at 150 tokens achieves AUC 0.612 vs 0.445 baseline (p=0.001) on AIME math problems. Signal emerges when surface-level features carry zero information.
Preregistered AI-safety study of sandbagging model organisms: trigger type sets the sign of cross-capability alignment (task-local locks dismantle it, situational locks amplify it) and cue-sharing sets its size. All five predictions failed, four reversed.
Inline safety probes on production LLM servers
Notebook-first layer-wise probes for physical variables in visual world models
Does a language model's self-explanation actually depend on the activation it explains? Pre-registered controls for introspective verbalization, building on Li et al. (arXiv:2511.08579). Apparatus and frozen pre-registration - no measurement yet.
Linear probes map where information lives in a network and predict where to spend precision when you quantize it. Probe-guided mixed precision beats uniform allocation, and a per-task probe estimates how far each task compresses. BERT, RoBERTa, DistilBERT, and a vision model, in Colab notebooks.
Linear classifier probes (Alain & Bengio, 2016) — trains independent logistic regression classifiers on frozen GPT-2 representations to measure how sentiment information emerges across layers.
Necessity tests for linear safety probes
Maritime Intent Probe is a Phase 1 research programme on construct validity in neural probing. It introduces BC1 and uses a preregistered maritime routing counterexample to establish the identifiability requirements that motivate a crossed-design Phase 2 validation.
A research tool for studying how deception emerges in multi-agent LLM systems and detecting it through activation analysis.
Trusted monitors emit an integer suspiciousness score that discards information they already computed; reading the logit distribution instead is free and better (+0.031 AUROC, 36x more usable audit depth). Plus a negative result: linear probes on monitor activations are confounded by dataset artefacts, and a control that catches it.
How fine-tuning breaks probe-based safety monitors
To associate your repository with the linear-probes topic, visit your repo's landing page and select "manage topics."