Steve HutchinsonBig Pines
·6 min read·Stage 24·Cognitive Substrate

Grounded Cognition

This article describes the grounding engine that connects internal predictions and memories to external telemetry and sensor-like signals.

The problem of detached cognition

Grounded cognition: external telemetry is compared against world predictions to produce a prediction error that corrects the world model and updates memory; uncertainty gaps trigger active inference probes.
Grounded cognition: external telemetry is compared against world predictions to produce a prediction error that corrects the world model and updates memory; uncertainty gaps trigger active inference probes.

An agent that operates only from internal memory, goals, and policy can become coherent internally while drifting away from the world it is meant to model. Memories, narratives, and goals can reinforce one another in a closed loop. The narrative engine can produce a fluent account of the system's behavior. The world model can produce confident predictions. The identity model can maintain stable traits. All of this can remain consistent internally while external conditions have changed in ways the system has not registered.

Grounding is the feedback path that prevents this. It connects external telemetry and sensor-like observations to the internal cognitive substrate, giving the system a way to test its predictions against observed reality and update accordingly.

Telemetry as experience

The grounding engine treats external observations (metric readings, sensor values, service health signals, environmental measurements) as experience events. These events enter the same experience index and the same reinforcement pipeline as agent actions and reasoning traces.

This is an architectural choice with significant implications. Grounding is not a separate "external sensor" system; it is an extension of the experience pipeline. A CPU utilization reading at 95% and an outage report from an agent action both become experience events, both receive importance scores, both can be consolidated into semantic memories, and both can feed the reinforcement system.

Experiment 26 demonstrated this with concrete sensor readings. A normal latency reading (45ms p95) produced an importance score of 0.450. An outage latency reading (1200ms p95) produced an importance score of 1.000 (clamped). An error rate reading at 78% produced 0.780. The importance formula |value| / 100 clamped to [0, 1] turns raw metric values into scores on the same scale the memory system uses for all other experience.

The clamping at 1200ms is worth noting. Any latency above 100ms saturates the importance score at 1.000. This is domain-specific: milliseconds are not a universal unit. For a system monitoring network packet round-trip times, 1200ms might be normal; for a web application's p95 latency, it is catastrophic. The importance formula encodes a domain assumption that must be configured appropriately for the deployment context.

Prediction-error feedback

Grounding does not just record observations; it compares them against predictions. The world model makes predictions before actions are taken. Grounding compares the observed outcome against the prediction and computes prediction error.

Experiment 26 illustrated this with a specific case: the world model predicted an expected latency of 50ms. The observed latency was 1200ms. The error was 1150ms. The accuracy score was 0.000: the prediction was completely wrong.

This prediction feedback record is the raw material for world-model calibration. A model that consistently predicts low latency before outage events is miscalibrated in a specific and important way. Grounding makes this miscalibration detectable by systematically comparing predictions against observations. Over time, the accumulation of prediction feedback records can identify which situation types are poorly predicted and guide adjustments to the world model's parameters, context usage, or confidence calibration.

World-model correction

Beyond recording errors, grounding routes observations back into the world model. When an observation contradicts a prediction with high confidence, the contradiction is not just recorded; it propagates as a correction signal that adjusts the world model's confidence estimates for similar situations.

This empirical anchoring is the difference between a world model that is well-calibrated on its training distribution and one that remains calibrated as the environment changes. Without grounding corrections, the world model's confidence estimates reflect past experience only. With grounding corrections, confidence is adjusted in response to ongoing divergence between predictions and reality.

The corrections also feed into memory. A grounded observation that contradicts an established memory can trigger contradiction assessment in the reinforcement engine, potentially retiring the contradicted memory and elevating the new observation to higher retrieval priority.

Active inference probes

The most active form of grounding is not passive observation but deliberate probing. An active inference probe is a small action or observation designed specifically to reduce uncertainty about a particular aspect of the environment, rather than to achieve a goal.

Experiment 26 showed probes proposed for three outage-phase metrics: the 1200ms latency reading, the 78% error rate, and the 95% CPU utilization each generated a probe proposal. The probes asked: what additional measurement or action would most efficiently resolve uncertainty about the cause and expected trajectory of each anomaly?

Active probes connect grounding to the curiosity engine. The curiosity engine identifies high-uncertainty states and generates exploration targets; grounding generates the observations that resolve that uncertainty. Together they implement a form of active learning: the system identifies what it does not know, proposes observations to close the gap, and updates its models when the observations arrive.

This is a more sophisticated relationship with the environment than passive monitoring. A passively monitored system learns only from events that happen to occur. An actively probing system can direct its own learning by choosing which uncertainties to resolve next.

Grounding and the social system

Grounding applies not only to physical telemetry but to social observations. Trust signals, cooperation patterns, and interaction outcomes are also forms of environmental feedback that ground the social model against observed behavior.

The social engine's trust scores, deception risk estimates, and intent classifications are all predictions about the external social environment. Grounding can compare these predictions against observed interaction outcomes: was the predicted intent correct? Did the estimated trust level match the reliability of the information received? Did cooperation signals predict actual cooperative outcomes?

This social grounding closes the same loop that telemetry grounding closes for the physical environment: internal predictions tested against external observations, with error fed back into calibration. The mechanism is the same; the domain is different.

Related Articles

This site collects anonymous usage data to understand how people read and navigate the blog. Accepting enables persistent reader preferences across visits.