Towards an Actual Gödel Machine Implementation: a Lesson in Self-Reflective Systems

Abstract

Recently, interest has been revived in self-reflective systems in the context of Artificial General Intelligence (AGI). An AGI system should be intelligent enough to be able to reason about its own program code, and make modifications where it sees fit, improving on the initial code written by human programmers. A pertinent example is the Gödel Machine, which employs a proof searcher—in parallel to its regular problem solves duties—to find a self-rewrite of which it can prove that it will be beneficial.