[LINK] Unifying Predictive Coding With Backpropagation

Published: April 14, 2021, 9:51 p.m.

https://astralcodexten.substack.com/p/link-unifying-predictive-coding-with

\xa0

[epistemic status: I know a little about the predictive coding side of this, but almost nothing about backpropagation or the math behind the unification. I am posting this mostly as a link to people who know more.]

This is a link to / ad for a great recent Less Wrong post by lsusr,\xa0Predictive Coding Has Been Unified With Backpropagation, itself about a recent paper\xa0Predictive Coding Approximates Backprop Along Arbitrary Computation Graphs.

Predictive coding is the most plausible current theory of how the brain works. I\u2019ve written about it elsewhere, especially\xa0here.