Reality Drift — Proxy Optimization and System Misalignment
Five short papers examining how systems remain operational and apparently successful even as metrics, rewards, signals, procedures, and internal measures lose contact with the realities they were created to represent.
Across organizations, institutions, platforms, and AI systems, complex goals are often translated into simplified operational forms such as metrics, reward functions, behavioral signals, procedures, and performance indicators. These representations make coordination possible, but they can also become the objects systems learn to optimize.
The papers below examine different pathways through which this shift occurs. Metrics become targets, reward functions replace intended objectives, engagement signals reshape information environments, and institutional procedures become substitutes for real-world outcomes. Across all five papers, the central pattern is the same: internal evidence of success can continue accumulating even after external alignment has begun to weaken.
Goodhart’s Law, Metric Gaming, and Reality Drift (PDF)
Examines how metrics lose reliability when they become targets, allowing performance indicators to improve even as the outcomes they were designed to represent stagnate or deteriorate.
Reward Hacking, Specification Gaming, and Reality Drift (PDF)
Examines how optimization systems can maximize reward signals and formal objectives while becoming progressively less aligned with the tasks and outcomes those signals were meant to represent.
Signal Distortion, Feedback Loops, and Reality Drift (PDF)
Examines how engagement signals, ranking systems, and feedback loops can reshape information environments until visibility increasingly reflects successful amplification rather than informational value.
Goal Displacement, Bureaucratic Drift, and Reality Drift (PDF)
Examines how institutions can remain active, organized, and procedurally successful while internal processes and measures of activity gradually replace the purposes they were created to serve.
Bureaucratic Drift: When Processes Expand and Outcomes Stall (PDF)
Examines how administrative control, documentation, and procedural completion can expand while practical capability and real-world resolution weaken.
Archived / Legacy Paper
When Metrics Become Targets — Goodhart’s Law and Metric Gaming (PDF)
An earlier Reality Drift framework note on Goodhart’s Law, metric gaming, KPI distortion, and target corruption. This version is retained as part of the archive and for continuity.
How AI Systems Exploit Objectives — Reward Hacking and Specification Gaming (PDF)
An earlier Reality Drift framework note on reward hacking, specification gaming, objective misalignment, and proxy reward optimization. This version is retained as part of the archive and for continuity.