The nurses watching AI watch them have a message: your optimization metrics are killing people.

The Summary

The Signal

Kaiser nurses are living inside the agent economy's first major contradiction. AI was supposed to handle the grunt work so humans could focus on what humans do best. Instead, these healthcare workers report spending more time managing the AI's demands than caring for patients. The surveillance layer compounds it. Every movement tracked, every minute accounted for, every deviation from the optimal path flagged.

This isn't a technology problem. It's a deployment problem. The AI doesn't understand that a five-minute conversation preventing a fall is worth more than three perfectly documented vital sign checks. The surveillance system doesn't know that the nurse who takes an extra minute to calm an anxious patient just prevented a code blue tomorrow.

"What optimizes for throughput doesn't optimize for outcomes."

The nurses' complaints cluster around three themes:

  • AI-generated alerts creating alarm fatigue and cognitive overload
  • Surveillance metrics rewarding speed over judgment
  • Documentation requirements designed for algorithms, not care continuity

Here's what makes this story bigger than one hospital system: Kaiser is enormous, well-funded, and has every incentive to get this right. If they're failing at human-AI collaboration in a domain as critical as healthcare, what does that say about the rest of the rollout? The HN thread exploded to 310 comments because engineers recognized the pattern. They've seen this movie. Measure what's easy, not what matters. Optimize locally, break globally. Ship the dashboard, ignore the users.

The agents-first future requires that AI makes human work better, not just faster. These nurses are the canary. When the people closest to the actual outcome say the tools are failing, belief in the dashboard becomes liability. You can have perfect metrics and dying patients. You can have total visibility and zero insight.

The Implication

If you're building AI tools for knowledge workers, Kaiser's nurses just handed you a playbook for what not to do. Don't optimize for metrics you can measure. Optimize for outcomes that matter. Don't surveil to enforce compliance. Build feedback loops that surface judgment calls your AI can't make. The best AI tools disappear into the workflow. The worst ones become the workflow.

For workers in surveilled roles: document everything. When the AI flags you for taking too long, note what you were doing and why. The data will eventually show that human judgment has a signature the algorithms miss. That signature is your value in the agent economy. Protect it.

Sources

Hacker News Best