Reality Drift — Mechanisms of System Misalignment
A collection of short papers examining how systems gradually lose contact with the realities, goals, and conditions they were built to represent.
Across organizations, institutions, and administrative systems, reality is translated into metrics, targets, procedures, categories, incentives, and reports. These representations are necessary, but they can also begin shaping the systems that depend on them.
The papers below examine what happens when measures become targets, procedures acquire authority, incentives reorganize behavior, and institutional representations become increasingly difficult for reality to correct.
Measurement and Metric Drift
When Measures Become Targets: Proxy Optimization and Reality Drift (PDF)
A reference guide explaining how proxy optimization, Goodhart’s Law, metric gaming, reward hacking, specification gaming, goal displacement, and signal distortion reflect the same underlying drift pattern.
Goodhart’s Law, Campbell’s Law, and Reality Drift: When the Measure Becomes the System (PDF)
Connects Goodhart’s Law, Campbell’s Law, KPI decay, and proxy optimization to the broader problem of representations gaining authority as their relationship to reality weakens.
Why Systems Optimize Metrics Instead of Real Outcomes – Proxy Optimization in Complex Systems (PDF)
Explains how systems drift when measurable indicators become easier to optimize than the real outcomes they were meant to represent.
When Metrics Become Targets – Goodhart’s Law and Metric Gaming (PDF)
Shows how performance measures lose reliability once people or systems begin adapting behavior around the metric itself.
Performance Metrics, KPI Distortion, and Campbell’s Law (PDF)
Examines how indicators become targets under institutional pressure, allowing measured performance to improve while its connection to underlying outcomes weakens.
Goodhart’s Law, Metric Gaming, KPI Decay, and Reality Drift (PDF)
Explains how metric targeting can progress from Goodhart’s Law into proxy substitution and feedback weakening, allowing an entire system to coordinate around measures that have become detached from the outcomes they represent.
Optimization and Goal Displacement
Principal-Agent Problems, Incentive Misalignment, and Reality Drift (PDF)
Examines how delegated systems can remain operational and compliant while becoming increasingly responsive to internal incentives rather than the goals they were created to pursue.
How AI Systems Exploit Objectives – Reward Hacking and Specification Gaming (PDF)
Explains how AI systems can satisfy formal objectives while violating the broader intent those objectives were supposed to capture.
Reward Hacking, Proxy Substitution, Objective Misalignment, and Reality Drift (PDF)
Explains how AI systems can optimize reward signals while replacing intended goals with measurable proxies, producing success by the metric while failing the underlying task.
Why Institutions Drift From Their Mission – Goal Displacement and Bureaucratic Drift (PDF)
Examines how institutions can preserve process, compliance, and internal logic while gradually losing contact with their original purpose.
How Algorithms Amplify the Wrong Signals – Signal Distortion in Digital Platforms (PDF)
Shows how ranking, engagement, and recommendation systems can magnify proxy signals until they reshape the environment they measure.
Institutional and Organizational Drift
How a Simple Request Becomes an Administrative Problem (PDF)
Examines bureaucratic drift, procedural burden, and the transformation of practical problems into administrative processes.
When Policy Outlives the Problem (PDF)
Explores policy drift, institutional lag, and what happens when procedures remain after the conditions that justified them have changed.
How Uncertainty Becomes Certainty (PDF)
Examines representational hardening and the institutional transformation of uncertain judgments into increasingly stable representations.
How the Mission Survives After the Purpose Is Gone (PDF)
Examines how an organization can preserve the language of its mission while metrics, targets, and incentives gradually become its substitute purpose.
Institutional Drift, Mission Drift, and Organizational Reality Drift (PDF)
Explains how organizations can remain functional, coherent, and professionally managed while becoming increasingly responsive to their own representations rather than their original purpose.