Experiments

The Prediction Architecture Program

Prediction → Integration?accuracy ≠ coupling (V9–V12)decomposability wallV91 target1 stepΦ = 0.097V103 targets1 stepΦ = 0.079V111 targetmulti-stepΦ = mixedV12MLP head(2-layer)Φ = 0.245all decomposable — any subset can satisfy the lossPrediction accuracy is necessary but not sufficient. Coupling is the mechanism.

established that embodied agents carry faint world- and self-model signals. A variant that added inner processing ticks, since removed, found no adaptive deliberation. ask a sharper question: what kind of learning signal couples hidden dimensions into a non-decomposable representation?

V9–V11: Prediction Is Not Integration

Each environment step the agent predicts its own energy change, observes the truth, and updates its phenotype by gradient descent, the computational version of minimizing surprise about your own persistence:

loss=(ΔE^−ΔEactual)2⇒phenotype−=lr⋅∇loss\text{loss} = (\hat{\Delta E} - \Delta E_{\text{actual}})^2 \quad \Rightarrow \quad \text{phenotype} \mathrel{-}= \text{lr} \cdot \nabla \text{loss}
StudyTargetMean Φ\intinfo (3 seeds)Note
Own energy0.097Prediction error falls 100 to 15,000× per lifetime
Energy, resources, neighbors0.079Weight columns specialize; specialization is more partitionable
Long-horizon value0.084Best robustness (1.012); discount evolves to about 0.75

Within-lifetime learning works, and better prediction does not become higher integration on any target. A single linear readout can be satisfied by a subset of hidden units, so it creates no pressure to coordinate. That is the decomposability problem: linear readouts are always factored.

Robustness and integration compared across V9, V10, V11
Mean robustness and mean Φ\intinfo across . The three overlap in the 0.06 to 0.10 range with high per-seed variance. Target does not move integration.

Study record: metadata, result path, seeds, source code, and key finding for .

V12 and V13: What the Two-Layer Head Did

A two-layer head couples gradients across hidden units through the chain rule, so no single unit can satisfy the objective alone:

∂L∂h=2(y^−y)⋅W2⊤⋅diag(1−tanh⁡2(W1h+b1))⋅W1\frac{\partial L}{\partial h} = 2(\hat{y} - y) \cdot W_2^\top \cdot \text{diag}(1 - \tanh^2(W_1 h + b_1)) \cdot W_1
SeedMean Φ\intinfoMax Φ\intinfoEffective rankSilhouette
420.0790.1288.240.325
1230.0710.0916.940.343
70.1190.24511.340.112

Here is what this shows, stated more carefully than I first stated it. The three-seed mean, 0.090, is below 's 0.097. The maximum in one seed, 0.245, is two and a half times anything a linear head produced, and behavioral modes appeared in hidden-state space for the first time. swept width and nonlinearity, linear at width 8 against tanh at widths 4 and 16, and found 0.074, 0.069, and 0.084: no difference among the three. So the two-layer head did not raise mean integration. It widened the tail. At fifty seeds () that tail is about a fifth of seeds above 0.10 and a maximum of 0.473. Nobody has run fifty seeds of the linear head, so whether the tail is a property of gradient coupling or of sample size is not known, and that control is the first experiment owed. What can be said: gradient coupling through composition is the only intervention that has produced high-integration seeds at all, and the prediction target makes no difference.

Gradient coupling through composition. A linear head sends independent gradients to each hidden unit. A two-layer head couples them through the shared intermediate layer. In the data this widened the distribution of outcomes without moving its center.

Study record: metadata, result path, seeds, source code, and key finding for .

Study record: metadata, result path, seeds, source code, and key finding for .

V14: The Social Target

A three-seed run that predicted neighbors' energy instead of the agent's own suggested a lift, and a dual-target run that combined self and social did worse, because the easy self target colonized the shared representation; both are removed from the catalog. ran ten seeds of the social target: mean Φ=0.091±0.028\intinfo = 0.091 \pm 0.028, against 0.090 for the self target, p=0.93p = 0.93. The three-seed lift was a fluke. What the ten seeds did show was the distribution, roughly thirty percent high, thirty moderate, forty low, and that it was trajectory that separated them.

Study record: metadata, result path, seeds, source code, and key finding for .

The Snapshot Bug

Retraction

The evolution loop, and the two removed environment variants built on it, reset hidden states to zero before saving snapshots, so every hidden-state analysis on those runs was on zero vectors. The "one-dimensional energy counter" finding was wrong. Corrected data give effective rank 5 to 7, energy decoding R2R^2 negative, and first-component variance 25 to 38 percent. Hidden states are moderately rich and do not encode energy linearly. When hidden states look degenerate, first check that you are analyzing post-cycle states and not reset buffers. This retraction is why the biographical claim below was held to a replication standard.

V15: Integration Is Biography

Fifty seeds, thirty cycles, five droughts each, 250 drought events, mean drought mortality 96.8 percent. Mean Φ=0.086±0.032\intinfo = 0.086 \pm 0.032; 22 percent high, 46 moderate, 32 low; maximum 0.473 in seed 23.

Integration Distribution (V15, 50 seeds)same architecture, same environment — only biography differs0.000.050.100.150.200.300.400.50Φ (late-phase integration)32% LOW(16 seeds)46% MOD(23 seeds)22% HIGH(11 seeds)

The first drought's bounce does not predict a seed's final category (r=−0.075r = -0.075, p=0.60p = 0.60). The mean bounce across all five droughts does (ρ=0.599\rho = 0.599, p=4.4×10−6p = 4.4 \times 10^{-6}). The slope of the Φ\intinfo trajectory separates the categories, every high seed positive and every low seed negative, though a slope fit to its own outcome is weak evidence on its own. Robustness, surviving droughts well, is orthogonal to integration (p=0.73p = 0.73), and effective rank does not differ across categories.

This had a null to beat. A fifth of seeds ending high, with the category set by trajectory, is also what a noisy quantity with sensitive dependence on path would look like. So the whole fifty-seed protocol was re-run from scratch on different hardware, an NVIDIA GB10 under a different JAX, with a pure-numpy re-implementation of the measure (). Per-seed late Φ\intinfo reproduced at r=0.951r = 0.951 across the fifty seeds, matched per-cycle trajectories agreed to about 10−810^{-8}, the category distribution reproduced, and every alive-bearing snapshot carried real signal, so the zeroed-buffer artifact is absent from this path. A noisy quantity with no stable latent cause would not reproduce per seed across independent runs. This one does, and it is predictable from features computed before the outcome, mean bounce and not first bounce. That is the one result in this program I would defend without qualification.

The furnace. 256 agents face five near-extinction events. Survivors rebuild each time, and in the high seeds each recovery integrates further than the last.
Seed 23. The highest-Φ\intinfo seed in fifty climbs from 0.058 to 0.473 across thirty cycles. Each drought drops it; each recovery bounces higher.

Study record: metadata, result path, seeds, source code, and key finding for .

V16–V19

predicted the difference between the actual and an alternative action's outcome, hoping to force counterfactual representation, and destabilized learning: mean Φ\intinfo 0.054, no high seeds, all three pre-registered predictions falsified. put Φ\intinfo directly in the fitness function and did not change the high fraction, with two of ten seeds Goodharting. Integration cannot be selected for directly. gave agents eight discrete symbols under partial observability and cooperative pressure; every seed used every symbol at 83 percent of maximum entropy, with resource mutual information of 0.001 to 0.005, and no integration lift, Φ\intinfo against symbol-use correlation 0.07. That is symbol use, cheap and universal under these conditions, and whether it refers to anything is not shown. is per-timestep trajectory data for one focal agent in the seed-23 lineage, the source for the visualizations, not an experiment.

Symbol use is cheap. Ten agents under partial observability use all eight symbols at high entropy, and Φ\intinfo stays flat. Reference was not established.
Integration (Phi) across all experiment conditions V9-V18
Integration across every condition, V9 to V18. Mean late-phase Φ\intinfo with error bars, and the seed-outcome distribution below. The split is stable across conditions. Nothing moves the mean.

Study record: metadata, result path, seeds, source code, and key finding for .