Integrated Information in the Active Inference Framework

2026-08-14

AI Summary

This study addresses the lack of quantitative measures for conscious information integration within the active inference framework by integrating Integrated Information Theory with generative models. We propose a novel metric for integrated information grounded in structural hypotheses. Through generative modeling and simulation experiments, we demonstrate a significant positive correlation between this metric and free energy, which strengthens as model scale increases. This work bridges a critical gap in quantifying consciousness within active inference, revealing intrinsic relationships among model complexity, information integration, and free energy. Consequently, it provides new theoretical foundations and quantitative tools for understanding the emergence of consciousness in intelligent agents, thereby advancing the computational characterization of conscious processing in artificial systems.

Abstract

The active inference framework provides a principled approach to modeling sentient behavior. In this framework perception and action selection are treated in a unified way. The resulting agents form an internal generative model of the relevant dynamics of the world in order to infer their future observations, their internal states and to select actions. We combine this modeling framework with the Integrated Information Theory of consciousness and are therefore able to analyze the active inference agents from the perspective of integrated information. The Integrated Information Theory aims at quantifying the level of consciousness of a system by assessing its capability to integrate information. Here, we define a measure of integrated information for the generative model by making an additional structural assumption. Experiments with simulated agents reveal a correlation between integrated information measures and the free energy of the active inference agents that increases with the size of the generative model.

Problem

• Active Inference
• Integrated Information Theory
• Generative Model
• Consciousness
• Free Energy

Innovation

• Active Inference
• Integrated Information Theory
• Generative Model
• Free Energy