Feedback loops

Systems whose output changes what they do next.

These sources turn on feedback. They cover agent loops, queues, competing programs and an essay on attention. Ask of each one what signal closes the loop.

Part of Automation. 8 sources from 4 subjects. A source can carry several themes. These tags are this wiki's own reading, not claims the sources make.

Digital Red Queen: Adversarial Program Evolution in Core War with LLMs

Sakana AI, in collaboration with MIT. From Harnesses and agent loops.

A research blog post on evolving competing programs in Core War with language models.

Harness Engineering for Self-Improvement

Lilian Weng. From Harnesses and agent loops.

A long survey of research on agent harnesses that improve themselves.

Structural Backpressure Beats Smarter Agents

reuben brooks. From Harnesses and agent loops.

A blog post arguing that machine-checked gates in coding loops matter more than smarter models.

The Coming Loop

Armin Ronacher. From Harnesses and agent loops.

A blog post on harness-level loops around coding agents and the unease they cause.

Viable Systems: How To Build a Fully Autonomous Agent

Tim Kellogg. From Harnesses and agent loops.

A blog post applying Stafford Beer's Viable System Model to building autonomous AI agents.

Reinforcement learning, explained with a minimum of math and jargon

Timothy B. Lee, Understanding AI. From Language models and training.

A plain-language newsletter article on how reinforcement learning helped make agentic AI models possible.

Waiting time, load factor, and queueing theory: why you need to cut your systems a bit of slack

Erik Bernhardsson (at the mortgage startup Better when writing). From Mathematics and optimization.

A blog post explaining why waiting time climbs sharply as a system gets busier.

Almost anything you give sustained attention to will begin to loop on itself and bloom

Henrik Karlsson (Escaping Flatland). From Mind, attention and practice.

An essay arguing that sustained attention makes experiences feed back on themselves and deepen.