Trust Between Humans and Intelligent Machines and Induced Cognitive Biases

Curator note

The strategic field of crisis management is based both on knowledge of the most complete information possible, confidence in the best technologies that deliver them, and the decision-making ability of the commander who relies on a strong organization and effective.
In the context of massive information, these three dimensions require the evelopment of so-called “intelligent” software agents capable of selecting, merging, and representing relevant information and of delivering decision-making solutions at high speed. These agents are developed by large industrialists; they are progressing steadily towards greater autonomy. Despite this progress and faced with an increasing complexity of the criticality of the situations, the project of purely autonomous systems is moving away from realistic prospects in the short and medium term. Experts in crisis management and these artificial systems must increasingly work in a collaborative manner, each bringing the best of their skills to the human-system duo. The notion of trust is therefore central for the I2HM (Human-System Interaction/Integration), and the collaboration between humans and machines. The strength or weakness of this collaborative relationship is a key security issue, and therefore one of the targets of cognitive warfare (Cyber Warfare).