🤖 AI Summary
This paper addresses adaptive decision-making for autonomous agents in unknown environments. Methodologically, it introduces a unified framework integrating model-based planning and model-free reactive control: (1) Meta-Interpretive Learning (MIL) induces interpretable, plannable logical rules from task trajectories to construct a symbolic model-based solver; (2) this solver serves as a supervisory signal to train a model-agnostic controller that requires no prior environmental knowledge. The core contribution is the first demonstration of strict equivalence in navigation-solving capability between the two paradigms: across randomized mazes and open-water lake environments, the controller perfectly replicates all tasks solved by the symbolic solver. This establishes the feasibility of synergistically combining symbolic reasoning with end-to-end learning, thereby providing a novel pathway toward explainable, highly adaptive intelligent agents.
📝 Abstract
A "model" is a theory that describes the state of an environment and the effects of an agent's decisions on the environment. A model-based agent can use its model to predict the effects of its future actions and so plan ahead, but must know the state of the environment. A model-free agent cannot plan, but can act without a model and without completely observing the environment. An autonomous agent capable of acting independently in novel environments must combine both sets of capabilities. We show how to create such an agent with Meta-Interpretive Learning used to learn a model-based Solver used to train a model-free Controller that can solve the same planning problems as the Solver. We demonstrate the equivalence in problem-solving ability of the two agents on grid navigation problems in two kinds of environment: randomly generated mazes, and lake maps with wide open areas. We find that all navigation problems solved by the Solver are also solved by the Controller, indicating the two are equivalent.