Optic Flow and Goal-Directed Displacements in Insects: History
Please note this is an old version of this entry, which may differ significantly from the current revision.
Subjects: Entomology
Contributor:

Optic flow was first introduced by Gibson as part of their ecological approach to perception and action. While this theoretical approach (as a whole) has been demonstrated to be particularly suitable for the study of goal-directed displacements in humans, its usefulness in carrying out entomological field studies remains to be established.

  • optic flow
  • ecological approach
  • perception and action
  • insects
  • flight
  • visual neuroscience

1. Perceptual Information Used in Flight Control in Insects

Over the last eighty years, it has often been shown that flying insects rely on optic flow to perform various locomotion tasks [1][2][3][4][5]. Optic flow can be defined as a vector field of the apparent motion of objects, surfaces, and edges in a visual scene caused by the relative motion between an agent and the scene while being independent of the scene’s texture (see Figure 1 and [6][7][8]). Insects seem to be masters of spacial navigation due to their ability to extract perceptual information from optic flow in order to finely control their everyday locomotion tasks: terrain-following, centering, wall-following, speed adjustment, and landing (see review articles [3][4][5][9]).
Insects 12 01075 g001
Figure 1. Non exhaustive optic flow variables perceived by a flying agent. Objects sliding on the optical sensor of an agent bear an optical velocity (OV) depending on the distance agent-object, and on the agent’s speed; focus of expansion (FOE) at the center of the visual field is the only point providing no OV; splay angle (σ
) is the angle formed by the direction vector of the agent and one of the lines parallel to the movement joining the horizon.
  • Terrain-following task: The ventral part of the optic flow is useful to follow the ground [3][10][11][12][13][14][15][16][17]. Srinivasan et al. [11] proposed “the image velocity of the ground is held approximately constant” to achieve a terrain-following behavior. Portelli et al. [13] proposed: “(1) honeybees reacted to a ventral optic flow perturbation by gradually restoring their ventral optic flow to the value they had previously perceived, (2) honeybees restored their ventral optic flow mainly by adjusting their flight height while keeping their airspeed relatively constant”. However, Straw et al. [18] “found that flies do not regulate altitude by maintaining a fixed value of optic flow beneath them”, but “Drosophila flies establish an altitude set point on the basis of nearby horizontal edges and tend to fly at the same height as such features”. A similar conclusion was drawn by David [10] about altitude regulation: “flies did not adjust the angular velocity of image movement that they held constant” for speed control purposes.
  • Centering and wall-following tasks: The lateral/frontal parts of the optic flow are useful to center in a narrow corridor by balancing the lateral parts of the optic flow (in honeybees [3][19][20], in bumblebees [15][21], in flies [10][22], in hawkmoths [23]), or to follow a wall along a wide corridor by restoring the optic flow pattern from one side (in honeybees [19][20][24], in bumblebees [25]). Kirchner and Srinivasan [24] suggested “bees maintained equidistance by balancing the apparent angular velocities of the two walls, or, equivalently, the velocities of the retinal images in the two eyes”. Dyhr et al. [25] found a similar conclusion in bumblebees: “the centering response relies on a direct comparison of the optic flow from each eye providing a more accurate measure of the perceived differences”. Lecoeur et al. [15] found that “lateral position is controlled by balancing the maximum optic flow in the frontal visual field”. Stöckl et al. [23] found that “hawkmoths use a similar strategy for lateral position control to bees and flies in balancing the magnitude of translational optic flow perceived in both eyes”. Serres et al. [20] found that “bee follows the right or left wall by regulating whichever lateral optic flow (right or left) is greater”.
  • Speed adjustment task: The bilateral (or bi-vertical) part of the optic flow is useful to adjust flight speed [3][21][26][27] (or [28]). Srinivasan et al. [26] showed that honeybees decrease their flight speed in a narrowing tunnel, and increase it as the tunnel widens. The authors of this study suggested that the visuomotor strategy consists of “holding constant the average image velocity as seen by the two eyes” without specifying any part of the visual field. A similar conclusion was drawn in flies [10][29]. Baird et al. [27] confirmed these results by manipulating the bilateral part of the optic flow and concluded that “honeybees regulate their flight speed by keeping the velocity of the image of the environment in their eye constant” by taking into account both the lateral and the ventral part of the optic flow. Portelli et al. [28] found in honeybees “that the ground speed decreased so as to maintain the larger of the two optic flow sums (”left plus right“ optic flows or ”ventral plus dorsal“ optic flows) constant according to whether the minimum cross-section was in the horizontal or vertical plane”.
  • Landing task: The ventral part of the optic flow can also be regulated by honeybees to land [11][26]. Srinivasan et al. [11] concluded that honeybees “tend to hold the angular velocity of the image of the surface constant as they approach it” in order to adjust their height above a flat surface. Srinivasan et al. [11] also concluded that “the bee decelerates continuously and in such a way as to keep the projected time to touchdown constant as the surface is approached”. This “projected time” stringently means a time-to-contact (TTC). This procedure ensures the agent’s speed decreases proportionally with the distance to the ground, reaching a value near zero at touchdown [3][5][9].
As stated previously, most of the studies cited in this first section highlight the central role played by optic flow in the control of navigation tasks in insects. A close inspection of these studies demonstrates significant disparities between the terms used when referring to the same concepts or entities (see Table 1). It also reveals, in some cases, confusions between the perceptual support used by insects in the control process and the property of the environment to which it gives access. We would like to argue that these disparities and confusions reveal a need for some theoretical clarifications. To be fully useful by the entomologist community, the optic flow concept must be used in the same way as in its original theoretical framework, i.e., the ecological approach of perception action proposed by Gibson in the last century [6]. Gibson’s framework has already proved to be relevant in addressing issues related to the control of human displacement [30][31] and by offering the robotics community a framework for carrying out new generations of studies [32][33]. We would like to argue in this contribution that the ecological approach to perception and action, taken as a whole, provides powerful theoretical and methodological tools allowing the entomologist community to: (i) take a critical look at the research carried out to date, (ii) develop more rigorous and innovative experimental protocols, and (iii) define new scientific issues pushing the boundaries of the current research field.
Table 1. Variability of denominations used in the entomologist community to describe perceptual information.
Task Denomination of the Perceptual Information in Entomology Species
Centering and wall following (lateral) “image angular velocity” in [34]
“horizontal optic flow cues” in [34]
“speed of retinal image motion” in [26]
“apparent angular speed” in [26]
“lateral optic flow” in [20]
“the magnitude of translational optic flow perceived in both eyes” in [23]
“translational optic flow cues” in [35]
Apis mellifera, Bombus terrestris, Megalopta genalis, Macroglossum stellatarum
Speed adjustment (lateral) “image angular velocity” in [11][27]
“optic flow cues in the lateral visual field” in [27]
“velocity of the perceived image motion” in [27]
“rate of optic flow” in [21][27]
“image motion signal” in [27]
“optic flow cues” in [27] “apparent velocity of the surrounding environment” in [26]
“apparent movement of the surrounding patterns relative to themselves” in [10]
“retinal slip speed” in [29]
Apis mellifera, Bombus terrestris, Drosophila hydei, Drosophila melanogaster
Terrain following “ventral optic flow” in [13]
“apparent (ventral) speed of image” in [26]
“image angular velocity” in [27]
“optic flow cues in the ventral region of the visual speed” in [27]
“rate of optic flow” in [27]
“perceived image velocity of motion of the image” in [27]
Apis mellifera
Landing on vertical surface “tau: apparent rate of expansion of the image” in [11]
“magnitude of optic flow” in [36]
“speed of image motion on the retina” in [36]
Apis mellifera
Landing on horizontal surface “angular velocity of the image” in [11][26] Apis mellifera
Heading “apparent movement” in [1]
“retinal image displacement” in [1]
Aëdes aegipty

2. How the Ecological Approach Allows a Better Understanding of the Processes Underlying Trajectory Control in Insects

2.1. The Ecological Framework as a Transversal Framework

One of the cornerstones of the ecological approach proposed by Gibson lies in the fact that it applies indifferently, whether we are interested in the behavior of humans, insects, or robots. It is this idea that appears in the background when Gibson refers to the concept of agents and considers that the perceptual information used to control a given displacement is available in the perceptual flows in which agents are immersed, not in the head of an agent after a cognitive post treatment. If we push this reasoning to the extreme, despite having different sensory modalities, humans or insects could detect the same high order variable(s) in the perceptual flows when they perform similar tasks.

2.2. New Reading of the Data from the Literature

While the literature contains numerous results which demonstrate the major role played by optic flow in the control of displacement in insects, the conceptual framework provided by Gibson (see Section 2) allows a more detailed analysis of the perceptual-motor processes implemented. As an example, when reviewing the different tasks mentioned in Section 1, several clarifications can be made.
  • Terrain-following tasks: The studies mentioned [3][10][11][12][13][14][15][16][17] indicate that honeybees rely on the value of optic flow velocity (sometimes called global optic flow rate), a low order variable, to maintain their height. The key point in this particular task is that the high order variable is the OVRC (Optical Velocity Rate of Change), and not the value of the OV (Optical Velocity) per se. Indeed, as OV is a ratio of speed over distance to the ground, further combinations of height and speed can provide the same OV value. In the case of forward displacement speed being constant, any variation in the OVRC “tells” the insect that the height is changing and requires a change in altitude. A close coupling between a high order variable and an action parameter allows the terrain-following task to be performed.
  • Centering task: The centering behavior observed in many insect species [3][10][15][19][20][21][22][26] arises, in all probability, from the detection of a high order variable: motion parallax. Motion parallax corresponds to the OV gradient following a displacement of the agent in the environment [37]. This gradient makes it possible to locate the objects of the environment in relation to each other. When the two side walls have the same OV, they are equidistant from the observation point, i.e., the agent is moving along the center of the corridor. Equalizing the OV of the two walls guarantees the production of a centered displacement.
  • Speed adjustment task: The studies reviewed in Section 1 seem to indicate that OVRC could be used as part of a safety principle. When a flight tunnel narrows or widens for a given displacement of the agent, the OV increases or decreases, respectively. CanOcelling any change in OV despite changes in tunnel section gives rises to a safe behavior, i.e., a decrease in forward displacement speed when the tunnel narrows, and an increase in displacement speed when the tunnel widens.
  • Landing task: Regardless of the fact that several high order variables can be used to control landing tasks, the study by Srinivasan [11] is interesting because it allows us to distinguish, as part of the control of a landing task, between a high order variable (tau: Τ), the PAES (Property of the Agent-Environment System) it specifies (first order TTC) and how the high order variable can be used as part of a control strategy. Within the framework of the strategy described, maintaining the value constant is a sufficient condition for zeroing velocity displacement as the surface is approached.  τ

3. Conclusions and Perspectives

Herein is to promote the conceptual framework provided by Gibson [38] to address issues related to the perceptual control of goal-directed displacements in insects. Herein has shown how the use of this framework could allow the entomologist community to have a more precise idea of the different perceptual degrees of freedom available, potentially useful for insects, in perceptual visual flows. The difference in the status of these perceptual degrees of freedom (low order vs. high order variables) would be worth considering in future studies. The ecological approach of perception and action also provides a very convenient methodological framework with a clear experimental agenda which would help to guide the researcher’s approach. Last but not the least, this approach would allow a renewal of questions and guide future research towards new scientific challenges.

This entry is adapted from the peer-reviewed paper 10.3390/insects12121075

References

  1. Kennedy, J.S. The visual responses of flying mosquitoes. Proc. Zool. Soc. Lond. 1940, 109, 221–242.
  2. Kennedy, J.S. The migration of the desert locust (schistocerca gregaria forsk.). i. the behaviour of swarms. ii. a theory of long-range migrations. Philos. Trans. R. Soc. Lond. Ser. B Biol. Sci. 1951, 235, 163–290.
  3. Srinivasan, M.V. Honeybees as a model for the study of visually guided flight, navigation, and biologically inspired robotics. Physiol. Rev. 2011, 91, 413–460.
  4. Egelhaaf, M.; Boeddeker, N.; Kern, R.; Kurtz, R.; Lindemann, J.P. Spatial vision in insects is facilitated by shaping the dynamics of visual input through behavioral action. Front. Neural Circuits 2012, 6, 108.
  5. Serres, J.R.; Ruffier, F. Optic flow-based collision-free strategies: From insects to robots. Arthropod Struct. Dev. 2017, 46, 703–717.
  6. Gibson, J.J. The Perception of the Visual World; Houghton, Mifflin and Company: Boston, MA, USA, 1950.
  7. Nakayama, K.; Loomis, J.M. Optical velocity patterns, velocity-sensitive neurons, and space perception: A hypothesis. Perception 1974, 3, 63–80.
  8. Koenderink, J.J.; van Doorn, A.J. Facts on optic flow. Biol. Cybern. 1987, 56, 247–254.
  9. Srinivasan, M.V. Vision, perception, navigation and ‘cognition’in honeybees and applications to aerial robotics. Biochem. Biophys. Res. Commun. 2021, 564, 4–17.
  10. David, C.T. Compensation for height in the control of groundspeed by Drosophila in a new ‘Barber’s Pole’ wind tunnel. J. Comp. Physiol. A 1982, 147, 485–493.
  11. Srinivasan, M.V.; Zhang, S.; Chahl, J.S.; Barth, E.; Venkatesh, S. How honeybees make grazing landings on flat surfaces. Biol. Cybern. 2000, 83, 171–183.
  12. Franceschini, N.; Ruffier, F.; Serres, J. A bio-inspired flying robot sheds light on insect piloting abilities. Curr. Biol. 2007, 17, 329–335.
  13. Portelli, G.; Ruffier, F.; Franceschini, N. Honeybees change their height to restore their optic flow. J. Comp. Physiol. A 2010, 196, 307–313.
  14. Portelli, G.; Serres, J.R.; Ruffier, F. Altitude control in honeybees: Joint vision-based learning and guidance. Sci. Rep. 2017, 7, 1–10.
  15. Lecoeur, J.; Dacke, M.; Floreano, D.; Baird, E. The role of optic flow pooling in insect flight control in cluttered environments. Sci. Rep. 2019, 9, 1–13.
  16. Serres, J.R.; Morice, A.H.P.; Blary, C.; Montagne, G.; Ruffier, F. Honeybees flying over a mirror crash irremediably. In Proceedings of the 4th International Conference on Invertebrate Vision (ICIV), Bäckaskog, Sweden, 5–12 August 2019; p. 260. Available online: https://www.youtube.com/watch?v=KH9z8eqOBbU (accessed on 26 November 2021).
  17. Serres, J.R.; Morice, A.H.; Blary, C.; Miot, R.; Montagne, G.; Ruffier, F. An innovative optical context to make honeybees crash repeatedly. bioRxiv 2021.
  18. Straw, A.D.; Lee, S.; Dickinson, M.H. Visual control of altitude in flying drosophila. Curr. Biol. 2010, 20, 1550–1556.
  19. Srinivasan, M.; Lehrer, M.; Kirchner, W.; Zhang, S. Range perception through apparent image speed in freely flying honeybees. Vis. Neurosci. 1991, 6, 519–535.
  20. Serres, J.R.; Masson, G.P.; Ruffier, F.; Franceschini, N. A bee in the corridor: Centering and wall-following. Naturwissenschaften 2008, 95, 1181.
  21. Baird, E.; Kornfeldt, T.; Dacke, M. Minimum viewing angle for visually guided ground speed control in bumblebees. J. Exp. Biol. 2010, 213, 1625–1632.
  22. Kern, R.; Boeddeker, N.; Dittmar, L.; Egelhaaf, M. Blowfly flight characteristics are shaped by environmental features and controlled by optic flow information. J. Exp. Biol. 2012, 215, 2501–2514.
  23. Stöckl, A.; Grittner, R.; Pfeiffer, K. The role of lateral optic flow cues in hawkmoth flight control. J. Exp. Biol. 2019, 222, jeb199406.
  24. Kirchner, W.; Srinivasan, M. Freely flying honeybees use image motion to estimate object distance. Naturwissenschaften 1989, 76, 281–282.
  25. Dyhr, J.P.; Higgins, C.M. The spatial frequency tuning of optic-flow-dependent behaviors in the bumblebee Bombus impatiens. J. Exp. Biol. 2010, 213, 1643–1650.
  26. Srinivasan, M.; Zhang, S.; Lehrer, M.; Collett, T. Honeybee navigation en route to the goal: Visual flight control and odometry. J. Exp. Biol. 1996, 199, 237–244.
  27. Baird, E.; Srinivasan, M.V.; Zhang, S.; Lamont, R.; Cowling, A. Visual control of flight speed and height in the honeybee. From Animals to Animats 9. In Proceedings of the 9th International Conference on Simulation of Adaptive Behavior, Rome, Italy, 25–29 September 2006; pp. 40–51.
  28. Portelli, G.; Ruffier, F.; Roubieu, F.L.; Franceschini, N. Honeybees’ speed depends on dorsal as well as lateral, ventral and frontal optic flows. PLoS ONE 2011, 6, e19486.
  29. Fry, S.N.; Rohrseitz, N.; Straw, A.D.; Dickinson, M.H. Visual control of flight speed in Drosophila melanogaster. J. Exp. Biol. 2009, 212, 1120–1130.
  30. Warren, W.H.; Kay, B.A.; Zosh, W.D.; Duchon, A.P.; Sahuc, S. Optic flow is used to control human walking. Nat. Neurosci. 2001, 4, 213–216.
  31. Chardenon, A.; Montagne, G.; Laurent, M.; Bootsma, R. A robust solution for dealing with environmental changes in intercepting moving balls. J. Mot. Behav. 2005, 37, 52–62.
  32. Duchon, A.P.; Kaelbling, L.P.; Warren, W.H. Ecological robotics. Adapt. Behav. 1998, 6, 473–507.
  33. Ibáñez-Gijón, J.; Díaz, A.; Lobo, L.; Jacobs, D.M. On the ecological approach to information and control for roboticists. Int. J. Adv. Robot. Syst. 2013, 10, 265.
  34. Baird, E.; Kreiss, E.; Wcislo, W.; Warrant, E.; Dacke, M. Nocturnal insects use optic flow for flight control. Biol. Lett. 2011, 7, 499–501.
  35. Bigge, R.; Pfefferle, M.; Pfeiffer, K.; Stöckl, A. Natural image statistics in the dorsal and ventral visual field match a switch in flight behaviour of a hawkmoth. Curr. Biol. 2021, 31, R280–R281.
  36. Baird, E.; Boeddeker, N.; Ibbotson, M.; Srinivasan, M. A universal strategy for visually guided landing. Proc. Natl. Acad. Sci. USA 2013, 110, 18686–18691.
  37. Koenderink, J.; van Doorn, A. Local structure of movement parallax of the plane. J. Opt. Soc. Am. 1976, 66, 717–723.
  38. Gibson, J.J. The Ecological Approach to Visual Perception; Houghton, Mifflin and Company: Boston, MA, USA, 1979.
More
This entry is offline, you can click here to edit this entry!