Constraints

The system must be inexpensive enough that access does not create inequality. If state-assisted control is a luxury good, it creates agency stratification where resourced people get high agency and unresourced people stay exploitable. This is load-bearing, not incidental.

An understanding-capable AI with state estimation and without caring governance creates four specific, architecturally predictable threat vectors. The caring constraints are not optional -- they prevent these threats.

Wrong understanding is asymmetrically more dangerous than no understanding. A confidently wrong value model deployed during a degraded state could produce worse outcomes than no model at all, because the person's capacity to catch and correct errors is reduced.