Canonical instabilities of autonomous weapons under fog-of-war constraints: extending the Data Rate Theorem to cognitive systems
Résumé
Under fog-of-war conditions, skilled human operators of complex man-machine cockpit weapon systems have repeatedly been unable to avoid fratricide incidents and violations of the laws of land warfare. In spite of these continuing catastrophic failures, autonomous weapons have been proposed that entirely remove the man from the command loop. Formal analysis, via an extension of the Data Rate Theorem, shows that fully autonomous weapons under constraints on incoming environmental information will be subject to sudden, highly punctuated collapse to a dysfunctional ground state in which 'all possible targets are enemies'.
Origine : Fichiers produits par l'(les) auteur(s)
Loading...