Risk Determination versus Risk Perception: History
Please note this is an old version of this entry, which may differ significantly from the current revision.
Contributor:

Researchers review the progress in developing a science of interdependence applied to the determinations and perceptions of risk for autonomous human–machine systems based on a case study of the Department of Defense’s (DoD) faulty determination of risk in a drone strike in Afghanistan; the DoD’s assessment was rushed, suppressing alternative risk perceptions.

  • interdependence
  • autonomy
  • human–machine systems

1. Introduction

The research tested in the open for complex and uncertain environments is critical to advance the science of autonomy and artificial intelligence (AI) for interdependent human-machine teams (AHMTs) and systems (the National Academy of Sciences, in Endsley et al., 2021; e.g., for an example, see Doctor and colleagues, 2022). But to date, social science’s contributions to autonomy have been marginal. Researchers speculate that disembodied cognition used in the laboratory is at the root of the replication crisis in social science (e.g., Nosek, 2015). Researchers believe that including interdependence, as difficult as it is to manage in the laboratory (Jones, 1998, p. 33), should begin to remedy the problem.

First, one barrier to an AHMT, noted by the National Academy of Sciences (Endsley et al., 2021), was that most proposals for the design and operation of AHMTs are based on laboratory results that do not work well if at all in the real world. In agreement with the Academy, Pearl (viz., causality; in Pearl, 2002; Pearl & Mackenzie, 2018) has long demanded that AI researchers include contact with reality in their models.

Second, for humans working with AI, however, embodied thoughts derived while operating in reality cannot be decomposed from each other (Schapiro & Spaulding, 2021; see also how the body is and has been used across cultures in mathematics, in Kaaronen et al., 2023; also, see its perspective, in Chrisomalis, 2023). This accounts for Chomsky’s (2023) conclusion that ChatGPT cannot capture reality. And it makes satisfying Pearl’s demands more difficult in the laboratory alone.

Third, Lawless and colleagues (2023) add that team science has been hindered by relying on observing how ”independent” individuals act and communicate (i.e., using Shannon information theory, in Shannon, 1948), but independent data cannot reproduce the interdependence observed in teams (e.g., the National Academy of Sciences report in 2015 on human teams; in Cooke & Hilton, 2015).

Digital communication is based on Shannon’s (1948) information theory (e.g., entropy, channels, errors). While the information communicated between individuals works well based on Shannon, that information is factorable (i.e., i.i.d. data; see Sch¨olkopf et al., 2021); early on, it was recognized that interdependence in teams working together under laboratory conditions was not rational, leading to the recommendation that it be reduced (e.g., with information theory, in Conant, 1976; also, in social psychology, see Kenny and colleagues, 1998). Surprisingly, disembodied, factorable, and rational beliefs fail outside of the laboratory, even for simple concepts like “self-esteem” (i.e., Baumeister and colleagues, 2005; or “implicit racism,” by Blanton et al., 2009), creating the replication crisis existing in social science today (see Nosek, 2015), along with the enormous waste that has occurred in the effort to “treat” biases (e.g., see the review by Paluck and colleagues, 2021).

By being disembodied (Whang, 2023), chatbot is not connected to reality (see the New York Times, Chomsky, 2023). From the interview of Joshua Bongard, a roboticist, “The body, in a very simple way, is the foundation for intelligent and cautious action” (in Whang, 2023). Unless these activities are walled off, restricted or bounded (i.e., Simon’s (1989) bounded rationality; e.g., see how Doctor and her colleagues succeeded in the field by applying a box around a robot to reduce its degrees of freedom, in Doctor et al., 2022), these failures extend to disembodied, factorable, separable and rational beliefs, especially when confronted in the open by uncertainty or conflict (viz., Mann, 2018).

Let us draw a comparison with quantum effects. From Aspect, Clauser and Zeilinger (2022, p.1), winners of the 2022 Nobel prize in physics, “That a pure quantum state is entangled means that it is not separable . . . being separable means that the wave function ψ(x, y) can be written ψ(x)ψ(y).” From the Wikipedia article on quantum entanglement, An entangled system is defined to be one whose quantum state cannot be factored as a product of states of its local constituents.” However, these quantum effects seem to be equally valid for the interdependence among teammates. Since the contributions of individual members of a team cannot be decomposed (e.g., the National Academy of Sciences report on AI teams; see p. 11, in Endsley et al., 2021), they are not separable nor factorable but similarly dependent.

Thus, researchers conclude with the sketch of “a new framework” for embodied cognition (e.g., Shapiro & Spaulding, 2021) that is remarkably analogous to quantum entanglement. Researchers know that constraints reduce information (e.g., Brillouin, 1956). By reducing the degrees of freedom among agents in a social field (i.e., Lewin, 1951), interdependence is a constraint. Interestingly, researchers know that open-ended “knowledge” reflects the absence of “surprise” (Conant, 1976). Researchers also know that embodied beliefs constructed in reality work very well, with humans making rational “dynamic adjustments” to fit reality as it changes (Lucas, 1995, p. 253). Reflecting the non-factorable nature of embodied cognition, researchers know that teams cannot be decomposed (i.e., the NAS, in Endsley et al., 2021), forming something like a no-copy principle for constituting teams that is similar to quantum’s no-cloning principle (Wooters and Zurek, 2009, p. 77). In the open field where embodied cognition reigns, a state of maximum interdependence was found to be critical to the best performing scientific teams (i.e., Cummings, 2015); and researchers have found that oppressive societies significantly reduced interdependence and the freedom to pursue education and innovation (Lawless, 2022c). In every society, freedom allows a society to marshal its available free energy against the problems it has targeted (e.g., Moskowitz, 2022).

Researchers close with the speculation that interdependence, which is embodied cognition and cannot be factored (e.g.,Endsley et al., 2021; Cooke & Hilton, 2015), is the reason why debate is central to the open and free societies that evolve compared to those societies that stagnate, regress or de-evolve (e.g., Lawless et al., 2023). Debate tests ideas and concepts, whether embodied or not; it helps to prevent or mitigate tragedies (e.g., DoD, 2021); its power arises from being the primary path to innovation (e.g., Israel is the innovation leader in Middle Eastern and North African countries; in Lawless, 2022c). For those authoritarian regimes or big businesses that censor, suppress or impede interdependence, a secondary path to innovation is the theft of the secrets or fruits of innovation (e.g., by China, in Baker, 2015; by Russia and Iran, in DoJ, 2023; by large businesses, such as Amazon, in Mattioli, 2020). But for future research, to advance autonomous human-machine teams and systems, researchers leave open for ourselves and others this question: how do we create a new statistics based on the reduction or absence of Shannon information that signifies a well-run team or system?

2. Summary

First, embodied cognition, like interdependence, arises as researchers move and interact in reality (Shapiro & Spaulding, 2021). However, it cannot be factored into its constituent parts of cognition and action (Endsley et al., 2021).

Second, the factoring of embodied cognition is prevented by a reduction in the degrees of freedom, causing a loss of Shannon information (Lawless, 2022c).

Third, Shannon’s (1948) mutual information works well to communicate among members of a team, but embodied cognition requires cognitive dissonance, debate, checks and balances, or a red team to seek cause and effect (Lawless et al., 2023).

Fourth, although interdependence cannot be factored, stress in the form of de- bate can test the strength of the claims made by embodied cognition sufficient for an audience (e.g., a jury; a voting body; a collective decision) to judge whether its claims are sufficient or adequate. Whether truth is found or not, debate serves as the means for a society to innovate and evolve.

This entry is adapted from the peer-reviewed paper 10.3390/informatics9020030

References

  1. Alain Aspect, J.F. Clauser & A. Zeilinger (2022). Entanglement, Einstein, Podolsky and Rosen paradox. The Nobel Committee for Physics.
  2. G. Baker (2015). Interview of the former central intelligence agency (CIA) and national security administration (NSA) chief. Wall Street Journal.
  3. R. F. Baumeister, J. Campbell, J. Krueger, and K. Vohs (2005). Exploding the self-esteem myth. Scientific American, 292(1):84–91.
  4. H. Blanton, J. Klick, G. Mitchell, J. Jaccard, B. Mellers, and P. Tetlock. (2009), Strong claims and weak evidence: Reassessing the predictive validity of the IAT. Journal of Applied Psychology, 94(3):567–582.
  5. L. Brillouin (1956). Science and Information Theory. Academic Press.
  6. N. Chomsky (2023). The false promise of ChatGPT. New York Times.
  7. S. Chrisomalis (2023). Embodying measurement. measuring with body parts is a handy and persistent cross-cultural phenomenon. Science, 380(6648):894– 895.
  8. R. C. Conant (1976). Laws of information which govern systems. IEEE Transac- tion on Systems, Man, and Cybernetics, 6:240–255.
  9. N. Cooke and M. E. Hilton (2015). Enhancing the effectiveness of team science. National Research Council, National Academies Press, Washington (DC).
  10. J. Cummings (2015). Team science successes and challenges. In NSF Workshop Fundamentals of Team Science and the Science of Team Science, Bethesda MD.
  11. K. Doctor, C. Task, M. Kejriwal and colleagues (2022). Toward defining a domain complexity measure across domains. AAAI.
  12. DoD (2021). Pentagon press secretary John F. Kirby and air force Lt. Gen. Sami d. Said hold a press briefing. Department of Defense.
  13. DOJ (2023). Justice department announces five cases as part of recently launched disruptive technology strike force. cases mark strike force’s first enforcement actions since established, department of justice. Department of Justice.
  14. M. Endsley and colleagues (2021). Human-ai teaming: State of the art and re- search needs. National Research Council, National Academies Press, Washington (DC)..
  15. E. Jones. (1998). Major developments in five decades of social psychology. In D.T. Gilbert, S.T. Fiske and G. Lindzey, The Handbook of Social Psychology, volume 1: 3-57. McGraw-Hill.
  16. D. Kenny and colleagues (1998). Data analyses in social psychology, In D.T. Gilbert, S.T. Fiske and G. Lindzey, Handbook of Social Psychology (4th Ed.), volume 1: 233-65. McGraw-Hill.
  17. W.F. Lawless (2022c). Interdependent autonomous human-machine systems: The complementarity of fitness, vulnerability evolution, entropy. Entropy, 24(9):1308.
  18. W.F. Lawless, D. A. Sofge, D. Lofaro, and R. Mittu. Editorial. interdisciplinary approaches to the structure and performance of interdependent autonomous human machine teams and systems. Frontiers in Physics, 2023.
  19. W. F. Lawless, M. Bergman, and N. Feltovich (2005). Consensus-seeking versus truth-seeking. ASCE Practice Periodical of Hazardous, Toxic and Radioactive Waste Management, 9(1):59–70.
  20. K. Lewin (1951). Field theory in social science. Selected theoretical papers. Harper and Brothers.
  21. R. Lucas (1995). Monetary neutrality. Nobel Prize Lecture.
  22. R. Mann (2018). Collective decision making by rational individuals. PNAS, 115(44):E10387–E10396.
  23. D. Mattioli (2020). Amazon scooped up data from its own sellers to launch competing products. contrary to assertions to congress, employees often consulted sales information on third-party vendors when developing private- label merchandise. Wall Street Journal.
  24. I. Moskowitz (2022). A cost metric for team efficiency. Frontiers in Physics.
  25. B. Nosek (2015). Estimating the reproducibility of psychological science. Science, 349(6251):943.
  26. E. Paluck, R. Porat, C. Clark, and D. Green (2021). Prejudice reduction: Progress and challenges. Annual Review of Psychology, 72:533–60.
  27. J. Pearl (2002). Reasoning with cause and effect. AI Magazine, 23(1):95–111.
  28. J. Pearl and D. Mackenzie (2018). Ai can’t reason why. the current data-crunching approach to machine learning misses an essential element of human intelligence. Wall Street Journal.
  29. R.O. Kaaronen and J. Eronen (2023). Body-based units of measure in cultural evolution. Science, 380(6648):948–954.
  30. B. Sch¨olkopf, F. Locatello, S. Bauer, and colleagues (2021). Towards causal representation learning. arXiv.
  31. C. Shannon (1948). A mathematical theory of communication. The Bell System Technical Journal, 27:379–423 and 623–656.
  32. L. Shapiro and S. Spaulding (2021). Embodied cognition. The Stanford Encyclopedia of Philosophy, Edward N. Zalta (ed.).
  33. H. Simon (1989). Bounded rationality and organizational learning. Technical Report AIP 107, CMU, Pittsburgh, PA.
  34. O. Whang (2023). Can intelligence be separated from the body? some researchers question whether a.i. can be truly intelligent without a body to interact with and learn from the physical world. New York Times.
  35. W. Wooters and W. Zurek (2009). The no-cloning theorem. Physics Today, pages 76–77.
More
This entry is offline, you can click here to edit this entry!
Video Production Service