Maintaining Human Verification Capacity under Automation

Human verification depends on expertise that must be maintained before it is needed. This paper links reliance on automated checks, investment in human checking ability, and performance during an interruption. Better checking lowers the error reduction gained from an extra unit of human skill while the checker works. It can therefore reduce the incentive to preserve independent expertise, even when it lowers the best achievable expected cost of maintenance and errors. In an illustration, a more informative checker raises detection while it works from \hoPowWorkA{} to \hoPowWorkC{} percent, but the organization then keeps no routine practice and detects \hoPowOnsetC{} percent of errors when the checker first fails, against \hoPowOnsetA{} percent with a less informative checker. A detection requirement therefore concerns both current capability and its survival until new training becomes effective. Evidence from colonoscopy and aviation documents weaker unaided performance under routine automation, without isolating the mechanism. The framework connects a detection target to an explicit reserve of expertise and a training pipeline. Standard detection tests estimate each quantity and reveal automation bias and silent checker failures. The framework distinguishes the requirement from minimizing expected loss and proposes a longitudinal test.

Source: arXiv:2609.38459v1 - http://arxiv.org/abs/2609.38459v1 PDF: https://arxiv.org/pdf/2609.38459v1 Original Link: http://arxiv.org/abs/2609.38459v1