|
13 | 13 | "id": "ac7aaa3a-2bb3-4cea-b921-d6f178ec8e71", |
14 | 14 | "metadata": {}, |
15 | 15 | "source": [ |
16 | | - "This notebook is a reproduction of the insightful [A Message Passing Realization of Expected Free Energy Minimization](https://arxiv.org/abs/2508.02197). The paper reformulates Expected Free Energy minimization as Variational Free Energy minimization with epistemic priors, turning a combinatorial search problem into a tractable inference problem solvable through standard message passing on factor graphs. \n", |
| 16 | + "This notebook reproduces the methodology from the paper [A Message Passing Realization of Expected Free Energy Minimization](https://arxiv.org/abs/2508.02197), which shows how Expected Free Energy minimization can be recast as Variational Free Energy minimization on factor graphs augmented with some epistemic priors, making it tractable via message passing.\n", |
17 | 17 | "\n", |
18 | | - "The goal of this notebook is to build intuition for the core implementation ideas from the ground up. We only cover the `stochastic maze` environment here; the paper covers two more worth exploring. Since the code has been mostly rewritten for didactic purposes, it doesn't always follow the [accompanying code repo](https://github.com/biaslab/EFEasVFE) conventions." |
| 18 | + "The goal of this notebook is to build intuition for the core implementation ideas from the ground up. We only cover the `stochastic maze` environment here; the paper covers two additional ones. Since the code has been mostly rewritten for didactic purposes, it doesn't always follow the [accompanying code repo](https://github.com/biaslab/EFEasVFE) conventions." |
19 | 19 | ] |
20 | 20 | }, |
21 | 21 | { |
|
1827 | 1827 | "\n", |
1828 | 1828 | "which is why the paper writes:\n", |
1829 | 1829 | "\n", |
1830 | | - "$$u_t = \\text{Cat}(u_t |\\sigma(H[q(x_t,x_{t-1}|u_t)] - H[q(x_{t-1}|u_t)]))$$\n", |
| 1830 | + "$$u_t \\sim \\text{Cat}(u_t |\\sigma(H[q(x_t,x_{t-1}|u_t)] - H[q(x_{t-1}|u_t)]))$$\n", |
1831 | 1831 | "\n", |
1832 | 1832 | "where the $\\sigma$ function (softmax) normalizes the distribution. \n", |
1833 | 1833 | "\n", |
|
1838 | 1838 | "\n", |
1839 | 1839 | "which the paper writes as:\n", |
1840 | 1840 | "\n", |
1841 | | - "$$x_t = \\text{Cat}(x_t | \\sigma(-H[q(y_t|x_t)]))$$" |
| 1841 | + "$$x_t \\sim \\text{Cat}(x_t | \\sigma(-H[q(y_t|x_t)]))$$" |
1842 | 1842 | ] |
1843 | 1843 | }, |
1844 | 1844 | { |
|
1881 | 1881 | "metadata": {}, |
1882 | 1882 | "source": [ |
1883 | 1883 | "The figure below shows the factor graph for the state inference part and the first planning step (the planning structure repeats for each subsequent step):\n", |
1884 | | - "\n", |
| 1884 | + "\n", |
1885 | 1885 | "\n", |
1886 | 1886 | "Two aspects of this implementation deserve clarification.\n", |
1887 | 1887 | "\n", |
|
0 commit comments