01 THE SYSTEMS PROBLEM

HOW DOES A
LIVING SYSTEM
KEEP ITSELF ALIVE?

The world is uncertain. The organism cannot be.

Temperature changes. Resources disappear. Bodies become hungry. Threats emerge. Sensory information is incomplete.

Yet living systems continuously maintain themselves within a surprisingly narrow range of viable states.

FOLLOW THE SYSTEM ↓
A DYNAMIC PROBLEM

Life exists between uncertainty and stability.

To remain alive, an organism must continuously regulate its internal conditions while interacting with an environment it cannot completely control.

EXTERNAL ENVIRONMENT
temperature resources threat social signals change uncertainty
SYSTEM BOUNDARY
INTERNAL STATES VIABLE regulated • organized • alive
THE ORGANISM MUST REGULATE
01 Temperature
02 Energy
03 Hydration
04 Safety
05 Internal Balance
01
SYSTEMS INSIGHT

Survival requires more than reacting to the present.

A living system must somehow anticipate what its sensory signals mean, determine what states are likely to follow, and respond in ways that keep the organism within viable bounds.

01 SENSE What is happening?
→
02 ANTICIPATE What is likely?
→
03 REGULATE What must change?
→
04 PERSIST Remain viable
THE QUESTION

How can a system remain stable
in a world it cannot predict perfectly?

Karl Friston's Free Energy Principle provides a mathematical framework for approaching this problem.

NEXT THE FREE ENERGY PRINCIPLE 02 →
02 THE FREE ENERGY PRINCIPLE
KARL FRISTON

A SYSTEM CANNOT
ELIMINATE
UNCERTAINTY.

It can become better at living within it.

The Free Energy Principle describes living systems as maintaining themselves by limiting the states they occupy over time.

To do this, the system must continually reconcile what it expects with the sensory evidence it actually encounters.

THE CENTRAL IDEA
“

Living systems maintain their organization by minimizing a quantity called variational free energy.

IMPORTANT

In FEP, “free energy” is a mathematical quantity used to characterize the relationship between a system's model and its sensory observations.

THE ARCHITECTURE

The system does not have direct access to the world.

It encounters sensory observations and must infer the hidden causes that produced them.

INSIDE THE SYSTEM
01
GENERATIVE MODEL WHAT I EXPECT

An internal model represents possible causes of sensory input and generates expectations about what the system is likely to encounter.

PREDICTION
SENSORY BOUNDARY
SENSORY EVIDENCE
OUTSIDE THE SYSTEM
02
HIDDEN CAUSES THE WORLD

External causes generate sensory consequences, but those causes are not directly available to the system.

THE INFERENCE PROBLEM

The system must work backward from sensory effects to infer their probable causes.

WHEN EXPECTATION MEETS EVIDENCE

Sometimes the model gets it wrong.

01 PREDICTED
EXPECTED SENSORY STATE
≠
02 OBSERVED
ACTUAL SENSORY EVIDENCE
Δ
DISCREPANCY

PREDICTION ERROR

A mismatch provides information that the system's current expectations do not fully explain its sensory observations.

VARIATIONAL FREE ENERGY

A tractable measure of model–evidence mismatch.

F

Variational free energy provides an upper bound on sensory surprise, allowing the system to minimize something it can evaluate rather than directly calculating surprise itself.

POOR MODEL–EVIDENCE FIT BETTER MODEL–EVIDENCE FIT
F
HIGHER FREE ENERGY MINIMIZATION → LOWER FREE ENERGY
SYSTEMS INSIGHT

Minimizing free energy means bringing the system's internal model and its sensory encounters into better statistical alignment.

A CRITICAL DISTINCTION

Same word.
Different concept.

FEP

VARIATIONAL
FREE ENERGY

A mathematical quantity related to inference, probability, uncertainty and how well a model accounts for sensory observations.

INFORMATION / INFERENCE
≠
BIOLOGY

METABOLIC
ENERGY

Physical energy used by biological systems to maintain cellular activity, neural signaling, movement and other physiological processes.

PHYSICAL / METABOLIC
02
THE SYSTEM NOW HAS A PROBLEM

If sensory evidence is uncertain, how does the system determine what is out there?

It predicts.

NEXT THE PREDICTION LOOP 03 →
03 THE PREDICTION LOOP
FROM MODEL TO PROCESS

THE SYSTEM
DOESN'T JUST
RECEIVE.

It continually generates predictions.

A generative model produces expectations about the sensory signals that hidden causes in the world are likely to generate.

Incoming sensory evidence can then inform whether those expectations adequately explain what the system is encountering.

A RECURRENT SYSTEM

Prediction is not an event.
It is a loop.

The system continuously coordinates expectations with incoming sensory evidence.

01 GENERATIVE MODEL EXPECT What should I encounter?
02 PREDICTION PREDICT Generate expected sensory states
03 SENSORY OBSERVATION SENSE Encounter incoming evidence
04 DISCREPANCY COMPARE What was not adequately predicted?
RECURRENT INFERENCE model ↔ evidence
expectations predicted input prediction error belief updating
SYSTEMS VIEW

Each pass through the loop changes the conditions under which the next inference occurs. The system is continuously updating rather than solving the world once.

INFORMATION MOVES BOTH WAYS

Prediction descends.
Evidence constrains.

01 MODEL → SENSATION
↓

TOP-DOWN

PREDICTION

The generative model supplies expectations about the causes and structure of incoming sensory signals.

02 SENSATION → MODEL
↑

BOTTOM-UP

PREDICTION ERROR

Sensory discrepancies provide evidence that can constrain or revise the system's current expectations.

NOT EITHER / OR

Perception emerges from the continuing interaction between prior expectations and sensory evidence.

Δ
REFRAMING ERROR

Prediction error
is not simply failure.

It is information.

A discrepancy indicates that the current model does not completely account for the sensory evidence.

That discrepancy can drive inference and learning, helping the system form expectations that better account for future observations.

01 EXPECTATION model predicts
→
02 MISMATCH evidence differs
→
03 UPDATE beliefs can change
→
04 LEARN future inference changes
BUT NOT EVERY ERROR MATTERS EQUALLY

The system must estimate what to trust.

Predictive processing therefore depends not only on prediction error, but also on the estimated reliability—or precision—of that error.

LOW PRECISION 01

LESS RELIABLE

Noisy or uncertain sensory evidence may receive less influence over belief updating.

HIGH PRECISION 02

MORE RELIABLE

Prediction errors estimated to be more reliable can exert greater influence on updating.

π
PRECISION

In this framework, precision concerns the estimated reliability of a signal or prediction error—often described mathematically in terms related to inverse variance.

THE COGNITIVE QUESTION

What determines
which signals
matter?

Once predictions differ in confidence and sensory errors differ in estimated precision, the system must selectively allocate influence.

This is where the architecture begins to connect directly with questions studied throughout cognitive science.

PERCEPTION
ATTENTION
LEARNING
MEMORY
BELIEF
DECISION
NEXT THE COGNITIVE LAYER 04 →
04 THE COGNITIVE LAYER
INSIDE THE INFERENCE SYSTEM

THIS IS WHERE
COGNITION
ENTERS.

The loop is not cognitively neutral.

Predictions depend on what the system already expects. Sensory evidence differs in reliability. Experience changes future expectations.

These dynamics intersect with core questions in cognitive science: how organisms perceive, attend, learn, remember, form beliefs and select actions.

COGNITION WITHIN A PREDICTIVE SYSTEM

ONE SYSTEM · MULTIPLE OPERATIONS

Cognition changes
how the loop operates.

Rather than treating cognition as a separate layer floating above perception and action, predictive frameworks examine how cognitive processes influence inference throughout the system.

CONCEPTUAL INFERENCE ARCHITECTURE RELATIONSHIPS, NOT A PRESCRIPTIVE SEQUENCE
01 PRIOR
EXPECTATIONS
What is already expected?
↔
02 SENSORY
EVIDENCE
What signals arrive?
↔
03 PRECISION
WEIGHTING
How strongly should signals influence inference?
↔
04 UPDATED
INFERENCE
What is currently most probable?
↔
05 ACTION
SELECTION
What might happen next?
COGNITIVE SCIENCE COGNITIVE PROCESSES INFLUENCE THE INFERENCE CYCLE
01

PERCEPTION

Inferring the likely causes of sensory signals.

02

ATTENTION

Selectively weighting information according to estimated relevance and reliability.

03

LEARNING

Changing model parameters and expectations through experience.

04

MEMORY

Past experience contributes to expectations brought into present inference.

05

BELIEF

Probabilistic expectations about hidden states and their causes.

06

DECISION

Evaluating possible actions in relation to expected outcomes.

CONCEPTUAL MODEL

These processes overlap and interact. The diagram does not assign each cognitive function to one isolated stage of inference.

01
COGNITIVE PROCESS

PERCEPTION

Seeing is not simply receiving.

01 SENSORY
SIGNAL
incoming evidence
→
02 INFERENCE expectations × evidence
→
03 PERCEPTUAL
HYPOTHESIS
current best inference
THE PROBLEM

Sensory signals provide consequences of hidden causes, not direct access to those causes themselves.

THE INFERENCE

Prior expectations and sensory evidence jointly constrain what the system currently infers.

THE EXPERIENCE

Perception reflects the system's current hypothesis about what is most likely generating its signals.

COGNITIVE SCIENCE

Perception can therefore be examined as inference under uncertainty rather than passive recording of the external world.

COGNITIVE PROCESS

ATTENTION

The system cannot treat every signal equally.

Attention can be related to the selective weighting of information: some prediction errors exert greater influence on inference than others.

Within predictive frameworks, the concept of precision provides one way of modeling differences in estimated reliability or confidence.

π
PRECISION WEIGHTING SELECTIVE INFLUENCE
01 MANY SIGNALS

Multiple sources of sensory information are available.

02 ESTIMATE RELIABILITY

Signals differ in their estimated reliability and relevance.

03 WEIGHT INFLUENCE

Some signals consequently exert greater influence on inference.

ATTENTION × PRECISION

Attention can change the effective flow of information through the prediction loop by altering which signals most strongly influence ongoing inference.

EXPERIENCE CHANGES THE MODEL

The next prediction
carries the past.

01 EXPERIENCE sensory encounter
→
02 PREDICTION
ERROR
evidence of mismatch
→
03 LEARNING expectations can change
→
04 UPDATED
MODEL
future expectations
MEMORY EXPERIENCE DOES NOT DISAPPEAR.

Stored and learned regularities from prior experience help structure the expectations available to future inference.

PAST EXPERIENCE → PRESENT EXPECTATION → FUTURE INFERENCE
FROM INFERENCE TO BEHAVIOR

BELIEF
×
DECISION

What do I believe is happening— and what next?

In predictive frameworks, beliefs can be understood as probabilistic expectations about hidden states of the world and body.

Those expectations matter because organisms must eventually evaluate and select actions under uncertainty.

CURRENT INFERENCE WHAT STATE AM I IN?
→
POSSIBLE ACTION A
CANDIDATE ACTION B
POSSIBLE ACTION C
IMPORTANT

This does not mean cognition is reducible to a single prediction-error mechanism. FEP provides a formal systems framework within which these processes can be modeled and related.

THE COGNITIVE SYSTEM

Not six separate functions.
One interacting architecture.

PERCEPTION infers causes
ATTENTION weights information
LEARNING changes expectations
MEMORY carries experience
BELIEF represents possibilities
DECISION evaluates possible actions

From this perspective, cognitive processes operate within a system that continually integrates prior expectations, sensory evidence, uncertainty, learning and action.

04
BUT THERE IS ANOTHER POSSIBILITY

What if the system
doesn't change its belief?

It can act to change the sensory evidence instead.

NEXT ACTIVE INFERENCE
05 →
05 ACTIVE INFERENCE
THE CONCEPTUAL TURN

DON'T JUST
PREDICT
THE WORLD.
ACT ON IT.

Inference does not end with perception.

When expectations and sensory evidence diverge, the organism is not limited to revising its internal model.

It can also act—changing what it samples, where it moves, and the sensory consequences it encounters next.

ACTIVE INFERENCE

PERCEPTION AND ACTION BECOME COUPLED PARTS OF AN ONGOING PROCESS OF INFERENCE AND REGULATION.

WHEN EXPECTATION AND EVIDENCE DIVERGE

The system has more than
one way to respond.

Δ
DISCREPANCY PREDICTION ERROR expectation ≠ evidence
TWO RESPONSES
01 INTERNAL UPDATE
REVISE EXPECTATIONS

CHANGE
THE MODEL

Sensory evidence can revise beliefs or expectations so the internal model better accounts for what has been observed.

BELIEF UPDATING EVIDENCE → MODEL
02 ACTION
ALTER THE NEXT ENCOUNTER

CHANGE
THE SAMPLING

Action can change the organism's relationship with its body or environment, producing different sensory evidence.

ACTIVE INFERENCE ACTION → EVIDENCE
IMPORTANT

These are not mutually exclusive alternatives. Belief updating and action can unfold together within the same recurrent system.

ACTION CLOSES THE LOOP

The organism changes
the conditions of its
next inference.

Action alters bodily or environmental conditions, which changes the sensory evidence available to the system.

CONCEPTUAL RECURRENT MODEL RELATIONSHIPS, NOT A LITERAL NEURAL SEQUENCE
01 EXPECT generative model
→
02 SENSE sensory evidence
→
03 INFER update beliefs
→
04 ACT change sampling
ENVIRONMENTAL + BODILY FEEDBACK NEW SENSORY EVIDENCE
↩
RECURRENT COUPLING

Action is not simply downstream from cognition. It feeds back into the sensory conditions from which subsequent perception and inference proceed.

01
ACTIVE INFERENCE IN A SIMPLE ACTION

Reaching
for a cup.

Even an ordinary movement changes the sensory conditions available to the organism.

01 PREDICT

EXPECTED STATE

The system generates predictions about sensory and proprioceptive consequences associated with a possible movement.

02 ACT

MOVEMENT

Motor action changes the body's relationship to the environment and alters subsequent sensory input.

03 SENSE AGAIN

NEW EVIDENCE

Vision, touch and proprioception provide new evidence about the changing state of the movement.

BODY
PERCEPTION × ACTION

Movement changes sensory evidence. New evidence then informs subsequent inference.

BUT ACTION REQUIRES LOOKING FORWARD

What happens
if I do this?

The system can evaluate possible courses of action in relation to their expected consequences.

NOW CURRENT BELIEFS
→
POLICY A FUTURE A possible consequences
POLICY B FUTURE B possible consequences
POLICY C FUTURE C possible consequences
POLICY

In active inference, a policy refers broadly to a possible sequence of actions the system could pursue. The highlighted policy is a visual example—not an assumed optimal choice.

EXPECTED FREE ENERGY

The system evaluates
possible futures.

Active inference extends the framework from explaining present observations toward evaluating expected consequences of possible policies.

G(π)
EXPECTED FREE ENERGY FUTURE-ORIENTED EVALUATION

G(π) represents expected free energy associated with a possible policy π.

01 PRAGMATIC / INSTRUMENTAL

MOVE TOWARD
PREFERRED
OUTCOMES.

Policies can be evaluated in relation to outcomes the organism expects to be more consistent with preferred or characteristic states.

WHAT OUTCOME? VALUE
02 EPISTEMIC / INFORMATION-SEEKING

REDUCE
UNCERTAINTY.

Policies can also be valuable because they are expected to provide information about uncertain states of the world or body.

WHAT CAN I LEARN? INFORMATION
CRITICAL DISTINCTION

Minimizing expected free energy does not mean seeking only familiar or maximally predictable situations. Information-seeking actions can be valuable when they are expected to reduce uncertainty.

WHY SEEK SOMETHING UNKNOWN?

Sometimes uncertainty
is exactly where the
system goes.

Exploration can have epistemic value.

An organism may act specifically to obtain information that resolves uncertainty and improves subsequent inference.

01 LOOK AROUND A CORNER sample hidden information
02 INSPECT AN UNFAMILIAR OBJECT reduce uncertainty
03 ASK A QUESTION obtain new evidence
04 ENTER A NEW ENVIRONMENT learn new regularities
01 UNCERTAINTY
→
02 INFORMATION-SEEKING ACTION
→
03 NEW EVIDENCE
→
04 MODEL UPDATE
CONCEPTUAL RELATIONSHIP

New evidence does not guarantee learning. It provides information that can support subsequent belief or model updating.

RETURN TO THE ORIGINAL PROBLEM

Why does any of this
matter for life?

CONCEPTUAL REGULATORY LOOP RECIPROCAL RELATIONSHIPS ACROSS ORGANISM AND ENVIRONMENT
01 BODY INTERNAL CONDITION

Physiological states create ongoing regulatory demands.

↔
02 INFERENCE ESTIMATE / ANTICIPATE

The system estimates present conditions and possible future states.

↔
03 ACTION CHANGE CONDITIONS

Behavior alters the relationship between organism and environment.

↔
04 WORLD NEW CONSEQUENCES

Environmental interaction produces new sensory and bodily states.

RECURRENT COUPLING CONSEQUENCES RETURN TO THE ORGANISM
↩
ACTIVE INFERENCE

From this perspective, cognition and behavior participate in the broader regulatory processes through which living systems interact with and respond to changing conditions.

THE SYSTEM SO FAR

Inference becomes
interaction.

01 PREDICT anticipate sensory causes
02 SENSE encounter evidence
03 INFER update beliefs
04 ACT change sampling
05 LEARN change future inference
06 REGULATE support viable states

The organism does not merely construct an internal representation of the world. It participates in a continuous exchange in which prediction, perception, action and learning reshape one another.

05
THE BOUNDARY IS ABOUT TO EXPAND

THE BRAIN DOES
NOT INFER ALONE.

It predicts through a body, acts through a body, and encounters a world.

BRAIN × BODY × ENVIRONMENT
NEXT THE EMBODIED SYSTEM
06 →
06 THE EMBODIED SYSTEM
RETURN TO THE ORIGINAL QUESTION

HOW DOES A
LIVING SYSTEM
KEEP ITSELF
ALIVE?

We began with uncertainty.

A living organism exists in a changing environment while maintaining the internal conditions necessary for continued viability.

Across this model, we have examined sensing, prediction, inference, learning and action as interacting processes through which an organism responds to that uncertainty.

SECTION 01
UNCERTAINTY → REGULATION → VIABILITY
THE COMPLETE ARCHITECTURE

Brain. Body. Environment.
One coupled system.

The inferential processes described so far do not occur independently of the organism's body or the environment with which it interacts.

CONCEPTUAL SYSTEM MODEL FUNCTIONAL RELATIONSHIPS — NOT AN ANATOMICAL DIAGRAM
01 EXTERNAL STATES

ENVIRONMENT

Resources, threats, opportunities, social signals and changing external conditions.

RESOURCES THREATS SOCIAL CONTEXT
02 EMBODIED STATES

BODY

Interoception, movement, physiology and the regulatory conditions through which the organism remains viable.

INTEROCEPTION MOVEMENT PHYSIOLOGY REGULATION
03 INFERENTIAL STATES

GENERATIVE
MODEL

Expectations, inference and model updating contribute to estimates of bodily and environmental states.

PERCEPTION ATTENTION MEMORY LEARNING
RECURRENT COUPLING SENSE → INFER → ACT → SENSE AGAIN
↩
SYSTEMS PERSPECTIVE

Cognition can therefore be examined as participating in an ongoing organism–environment relationship rather than as an isolated computational layer.

BIOLOGICAL CONSTRAINT

The system must
keep some things
within bounds.

Life occupies a limited range of states.

Temperature, hydration, blood chemistry, energy availability and other physiological variables cannot vary without limit.

Organisms continually regulate themselves in relation to these biological constraints.

ENVIRONMENTAL VARIABILITY HIGH RANGE OF POSSIBLE CONDITIONS
VIABLE ORGANISM STATES
REGULATION
MAINTAIN CRITICAL VARIABLES WITHIN SURVIVABLE RANGES
IMPORTANT DISTINCTION

Variational free energy is not metabolic energy. The Free Energy Principle provides a formal account of inference and self-organization; physiological regulation remains a physical biological process.

REGULATION THROUGH TIME

Regulation is not
only correction.
It can anticipate.

01 REACTIVE REGULATION

HOMEOSTASIS

Regulatory responses can counter deviations after relevant changes have occurred.

DEVIATION → CORRECTION
02 ANTICIPATORY REGULATION

ALLOSTASIS

Organisms can also adjust in advance when changing conditions are anticipated.

ANTICIPATE → PREPARE
CONCEPTUAL CONNECTION

Predictive regulation provides a useful bridge between inference and biological regulation: organisms need not only respond to present conditions—they can prepare for expected ones.

This connection should not be read as an equation of the Free Energy Principle with homeostasis or allostasis.
EMBODIED COGNITION

COGNITION DOES
NOT OPERATE
IN ISOLATION.

01 BRAIN prediction · inference · learning
02 BODY sensation · physiology · action
03 ENVIRONMENT context · affordances · consequences
THE BODY MATTERS

The body changes what can be known and done.

Sensory organs determine what information can be sampled. Bodily states influence ongoing inference. Motor capacities shape the actions available to the organism.

THE ENVIRONMENT MATTERS

Cognition unfolds within a world.

The environment provides both uncertainty and structure. Action changes what the organism encounters and therefore changes the evidence available for future inference.

From this systems perspective, cognitive activity can be examined as part of an ongoing relationship among neural, bodily and environmental processes.

THE COMPLETE WORKING MODEL

From uncertainty
to adaptive interaction.

The model is best understood as a recurrent set of relationships rather than a sequence with a fixed beginning or end.

CONCEPTUAL RECURRENT MODEL EACH PROCESS CAN ALTER CONDITIONS FOR THE OTHERS
01 ENVIRONMENT changing conditions
→
02 SENSATION available evidence
→
03 INFERENCE estimate hidden causes
↓
06 FEEDBACK new consequences
←
05 ACTION change sampling
←
04 PREDICTION expected states
↩
RECURRENT UPDATE LEARN · UPDATE · REPEAT
BIOLOGICAL REGULATION maintaining viable states
COGNITIVE INFERENCE estimating and updating
BEHAVIORAL ACTION changing conditions
SYNTHESIS

These are not three independent systems. They describe interacting processes occurring across the same embodied organism–environment relationship.

ACADEMIC PERSPECTIVE

A powerful framework.
Not the final word.

The Free Energy Principle is unusually broad. That breadth is part of its theoretical appeal and also part of the continuing academic debate surrounding its interpretation and empirical use.

01 WHAT THE FRAMEWORK OFFERS

A formal perspective on perception as inference under uncertainty.

A way to relate learning to changes in generative models.

A framework in which action and perception can be modeled together.

A systems perspective linking brain, body and environment.

A formal approach to questions about self-organization and adaptive persistence.

02 WHAT REMAINS DEBATED

How broadly the principle should be interpreted across cognition and biology.

How specific and testable particular predictions derived from the framework are.

How FEP-based explanations relate to competing cognitive and neuroscientific models.

Which claims follow from the mathematics and which require additional empirical assumptions.

The empirical scope within which particular active-inference models provide useful explanations.

IMPORTANT

The Free Energy Principle is a theoretical and formal framework. Its breadth should not be taken as evidence that every feature of cognition or biology has been explained by a single mechanism.

06
FREE ENERGY PRINCIPLE × COGNITIVE SCIENCE

COGNITION IS
PART OF A
LIVING SYSTEM.

It unfolds through an organism's ongoing relationship with its body and environment— predicting, sensing, acting, learning and regulating under uncertainty.

01 PREDICT
→
02 SENSE
→
03 INFER
→
04 ACT
→
05 LEARN
→
06 ADAPT
NO FIXED ENDPOINT THE CONSEQUENCES BECOME CONDITIONS FOR WHAT HAPPENS NEXT.
↩

The Free Energy Principle offers one way to understand this continuous relationship: a living system attempting to remain viable while navigating a world it can never know with complete certainty.

THE PROBLEM → THE PRINCIPLE → THE LOOP → COGNITION → ACTION → THE SYSTEM
WORKING CONCEPTUAL MODEL FREE ENERGY PRINCIPLE