1. UAV Remote Sensing: An Emerging Tool in Forest Health Monitoring
To assess the severity and the spatial extent of the consequences of tree stress, FHM is necessary. Timely knowledge of forest health decline might enable forest management to mitigate or reduce the damage to the forest (e.g., pest treatment, fire prevention) as well as to the ecosystem services attached to it (e.g., timber production, drinking water purification)
[3,4][1][2].
Long-term in situ monitoring of forest health has been carried out already for several decades at local, regional, and global scales in which standardized forest health indicators have been included
[5][3]. In the process, typically ground-truth information is collected by trained forestry staff that indicates an external state of health or damage. A common procedure is the estimation of the loss of needles and leaves, which is recorded in 5% intervals based on site-specific example trees
[6,7][4][5]. The ICP Forest program is a European collaboration of 42 participating countries and provides a standardized framework for the assessment and monitoring of forests in Europe and beyond
[8][6]. They act on two different intensity levels, namely, level-1 monitoring, which includes 5714 inventory plots (as of 2020) based on a systematic grid throughout Europe to assess temporal variations of the forest condition, and the level-2 monitoring, which investigates 623 plots (as of 2018) to identify cross-correlations between environmental factors and the responses of forests in selected ecosystems
[9][7]. For a detailed overview of other national and international in situ FHM programs, please refer to
[5][3].
A high degree of uncertainty is to be expected of in situ ground surveys as the quality depends on the experience and the subjective individual perception of the observers. Given that these are logistically complex, time-consuming, cost and labor-intensive ground surveys, only feasible at the plot-scale
[10][8], it is not surprising that remote sensing (RS) has established itself as a part of FHM and its research and has made major contributions to this application field
[5,11,12,13,14][3][9][10][11][12]. RS enables the acquisition of forest health indicators based on spectral or structural features derived from sensor data in an objective, quantitative, and repetitive manner at multiple spatial scales
[12][10].
Unmanned aerial vehicles (UAVs), sometimes referred to as drones or unmanned aircraft (UA), are remotely piloted carrier platforms and are increasingly being used as RS tools in various forestry applications
[15,16][13][14]. The terms unmanned aircraft system (UAS) and, less frequently, remotely piloted aircraft system (RPAS), considering the UAV as part of an entire operating system, including the equipment needed to control it remotely, have been widely adopted
[17][15]. Important to note is that the Department of National Defence and Canadian Armed Forces (DND/CAF) has exchanged the term “unmanned air vehicle” to “uncrewed air vehicle” to ensure a gender neutral terminology
[18][16]. Other nations should consider a similar approach.
Satellite-based RS still dominates forest health research. The most frequently used data are publicly accessible imagery such as Landsat, MODIS, and Sentinel
[19][17]. The large area coverage makes satellites valuable tools at multiple scales. Nevertheless, both the temporal and spatial resolution of satellite RS for monitoring forest ecosystems are sometimes insufficient and reach the limits of feasibility
[20][18]. This is particularly the case when biotic or abiotic factors trigger responses that lead to rapidly changing processes in forests and thus detrimentally affect forest health
[21,22][19][20]. In such cases, up-to-date and regularly acquired information becomes a key requirement
[23][21]. Besides timeliness, a very high spatial resolution is also critical in sustainable forest management
[24][22].
In theory, crewed aircraft can meet these requirements. In practice, though, safety issues, logistical limitations and very high costs make them viable only for relatively large areas
[25][23]. It is precisely in this niche in forestry where drones are increasingly used and are therefore seen less as a competitor than as a complementary technology to existing traditional Earth observation platforms
[26][24]. While inferior to satellites and crewed RS platforms in terms of area coverage, they are unrivaled in spatial resolution, cost-efficiency, flexibility, and frequent revisit times, provided the area of interest is relatively small in size
[27][25]. Common area coverage ranges from one hectare to several square kilometers in a single flight. The exact area coverage depends on the UAV type, propulsion technology (electricity/fuel), camera type, and other circumstances, such as rugged terrain (mountainous regions) or accessibility. A comparison of crewed aircraft and UAVs distributed by spatial resolution, costs per m
2 and area coverage can be seen in
Figure 1. In addition, the regulations of UAV operation of the respective country need to be considered, which can limit the maximum allowed flight height above ground level and thus also may influence the possible area coverage.
Figure 1. Abstraction of the distribution of potentially beneficial use cases of crewed aircraft and different UAV types used for remote sensing in forestry: (a) by scale and spatial resolution, (b) by scale and costs per m2. Note: within the overlap area in the top graph, UAVs often have a significant cost advantage over crewed aircraft and are faster and more frequently deployable. Multirotor drones are easier to handle compared to fixed-wing aircraft, but are only suitable for relatively small areas.
2. UAV Types and Sensors for Forest Health Monitoring
UAVs can generally be controlled manually and perform predetermined flight missions autonomously. For a general UAV workflow for data acquisition see Figure 2.
Figure 2.
General workflow of UAV-based data acquisition and processing procedures.
The platforms themselves come in various sizes (small, mini, and micro) and shapes, with maximum take-off weights (MTOW) most likely below 30 kg
[28][26] due to legal requirements that make operation above the MTOW complicated and cumbersome
[29][27]. Flight times vary depending on weather conditions, payload, battery power or engine fuel, and UAV type and vary from a few minutes to several hours
[30][28]. With typical ranges not greater than 10 km
[17][15], the legally possible capacity can usually be exhausted, as flying beyond the visual line of sight (BVLOS) is not permitted in many countries. Fixed-wing, rotary-wing, and hybrid solutions represent the major platform types that have prevailed for recent forestry applications
[16][14]. The former has the shape of an ordinary airplane with rigid wings and benefits from its aerodynamic shape to optimize cruise efficiency. This allows it to maximize flight duration and, thus, larger areas can be covered
[31][29]. The main drawback is that fixed-wing models require large and flat take-off and landing locations without higher obstacles
[32][30], which can pose problems, especially in forested terrain. Moreover, operators must consider that this platform type needs a constant forward motion with a minimum speed to get sufficient air buoyancy. This could lead to motion blur, which adversely affects image quality
[33][31].
Rotary-wing drones are most frequently embodied by multirotor models propelled by four, six, or up to eight rotors
[17][15]. Single-rotor models (helicopters) are still being used in a few cases
[34][32]. Multirotor UAVs are capable of vertical take-off and landing (VTOL) are much more maneuverable and responsive, allowing operators to launch even in locations with constrained space. They are easier to handle and are generally more versatile in their applications
[35][33]. The ability to fly slowly around objects or hover in place opens up additional applications such as data capturing for fine three-dimensional modeling where detailed multiview side images are necessary
[15,36,37][13][34][35]. However, all of this comes at the expense of higher energy consumption
[38][36]. Hence, only small areas are feasible with a multirotor drone compared to its fixed-wing equivalent. Even if more expensive, hybrid VTOL fixed-wing solutions alleviate the problem of the need for large take-off and landing areas
[30][28], which makes them particularly interesting for forestry applications. These platforms combine rigid wings and multiple rotors that enable VTOL operation and typically transition from hover to cruise mode and back at safe altitudes. Once in the cruise mode, these UAV types benefit from the same advantages as ordinary fixed-wing models.
Figure 3 shows UAV types commonly used in the forestry sector.
Figure 3. Different UAV types, commonly used for civilian applications: (a) rotary-wing (quadcopter), (b) rotary-wing (octocopter), (c) Hybrid VTOL solution, and (d) fixed-wing.
Technological innovations and developments have led to the increased use of UAV-RS. Contributing factors include (1) cheap, light, and miniaturized off-the-shelve UAVs and payloads
[27][25], (2) the development of sophisticated image-matching algorithms such as semi-global matching (SGM)
[39][37], which have paved the way for faster and more robust structure from motion (SfM)-based photogrammetry software
[40][38], and (3) continued increases in computer capacity that made image matching feasible
[41][39]. The emergence of SfM has enabled practitioners to produce their own georeferenced data products by using simple digital cameras
[42][40]. In combination with UAVs, they become a powerful RS tool as a scale-appropriate application. In drone-based FHM, SfM photogrammetry provides 2D spectral data of tree crowns and corresponding 3D information that help to quantify biochemical leave compositions and structural attributes to draw conclusions about the tree’s health status
[21][19].
Typical payloads are mainly represented by optical sensors
[43][41]. They range from consumer-grade RGB cameras to professional multispectral, hyperspectral, and thermal cameras, which all belong to the category of passive sensors. Less frequent but by no means less important, active sensors such as light detection and ranging (LiDAR) are also being applied.
Figure 4 shows examples of typical sensors for UAV application for FHM.
Figure 4. Different sensors for remote sensing applications that can be attached to UAVs: (a) RGB camera, (b) multispectral camera, (c) thermal camera, (d) hyperspectral camera, and (e) LiDAR sensor.
RGB cameras capture visible light approximately within the 400–700 nm band of the electromagnetic spectrum. Depending on the sensor and focal length, subdecimeter spatial resolutions can be achieved even from relatively high altitudes above ground when attached to drones
[44][42]. It is common practice in RS to separate color channels to work with the individual bandwidths
[45][43], for example, using different types of filters
[46][44]. This allows the mathematical combination of color channels to derive band ratios that improve feature detection and provide foresters with valuable information
[27][25]. Regarding vegetation analysis, additional bandwidths that reach beyond the visible light, such as near-infrared (NIR), are increasingly favored due to their higher sensitivity to plant pigmentation (e.g., chlorophyll and carotenoid content). Multispectral sensors consist of several separated bands (e.g., blue, green, red, red edge, NIR), usually covering the 400–1000 nm band of the electromagnetic spectrum. This allows the calculation of advanced vegetation indices that contribute to stress analysis and the evaluation of forest health
[26][24]. Hyperspectral sensors can take the analysis of vegetation properties to a whole new level. They can cover similar spectra as multispectral sensors but significantly differ in band numbers and widths. Some consist of hundreds of narrow bands representing the electromagnetic spectrum in a much more detailed manner
[47][45]. Thermal imaging sensors perceive emitted radiance typically between 7500 and 13,500 nm. Assuming an accurate calibration, pixel values can reliably be converted into temperature
[25][23]. Due to technical limitations of optical sensors, the number of narrow bands of multispectral and hyperspectral cameras is coming at the expense of a lower spatial resolution
[48,49][46][47]. To overcome this problem, pansharpening has become a widely used technique in RS with a variety of different pansharpening algorithms
[48,49,50][46][47][48]. In the process, multispectral or hyperspectral imagery is merged with higher spatial resolution panchromatic imagery while preserving the multispectral/hyperspectral sensors’ spectral information and the geometrical detail of the panchromatic imagery
[51,52,53][49][50][51]. Today, UAV-based imagery is also used to enhance the spatial resolution of satellite imagery
[54,55][52][53]. Manufacturers that build specialized cameras for drones even started to supplement their multispectral cameras with panchromatic bands to enhance the spatial resolution using pansharpening techniques
[56][54].
The group of active sensors includes, e.g., LiDAR systems. LiDAR detectors send active laser pulses in the NIR spectrum to scan the environment. The signals are backscattered by the objects (e.g., canopy and/or ground), and part of the transmitted energy returns to the sensor. The elapsed time between transmission and reception is recorded and combined with positional information, resulting in detailed point clouds containing intensity and elevation measurements
[32][30]. Important forest health indicators such as tree crown density, pattern distribution, or structural changes over time can be derived from LiDAR-based point clouds and indicate defoliation
[57,58,59][55][56][57] or changes in crown architecture
[60][58]. Besides FHM, these sensors are used in various other forestry applications using drones. The 3D reconstruction of trees using RGB imagery
[15][13] or LiDAR-based solutions
[61][59] allow estimations of inventory parameters such as diameter measurements
[62][60] and tree heights
[63][61] and tree species
[64][62], which in turn enable above-ground biomass calculations
[65,66][63][64]. Furthermore, other structural information such as forest canopy gaps can be retrieved
[67][65]. Instead, multispectral and hyperspectral sensors’ broad spectral resolution is rather used for complex vegetation properties such as chlorophyll content
[47][45] or tree species recognition
[68[66][67],
69], but they are also useful tools for applications similar to those mentioned for RGB cameras. Thermal sensors are often used for wildlife
[70][68] and forest fire
[71,72][69][70] detection.
3. The Importance of Forest Health
According to the United Nations (UN), more than 80% of all land mammals, birds, insects, and plants inhabit forests. It is estimated that about one-third of humanity directly depends on forests and their products
[73][71]. Forests provide essential ecosystem services and ecological functions, e.g., to meet social needs such as recreation, education, and conservation, as a source of fuel and wood, for water purification, for erosion control, and climate regulation through carbon storage
[23,74,75][21][72][73]. Besides anthropogenic pressures from timber harvesting, land use, and pollution, forests are also exposed to an array of abiotic (extreme temperatures, droughts, fire, storms, snow, and ice) and biotic (e.g., pests and diseases) stressors. Moreover, some of these stress agents are likely to interact and are further exacerbated by ongoing climate change
[76][74]. Seidl et al.
[77][75] concluded that warmer and drier climate leads to a favorable environment for fire, droughts, and insects, whereas warmer and wetter conditions foster storms and pathogens. As healthy forests are more robust and resilient to disturbances, it is critical to maintain and bolster their key functions
[1,11][9][76].
The term forest health cannot be defined unambiguously, as it reflects values from social, economic and ecological considerations
[78][77]. Lausch et al.
[11][9] provide an overview of a range of definitions of forest health. Forest health is defined as the absence or presence of symptoms caused by biotic and/or abiotic stressors at the individual tree scale. Hence, the severity of tree damage is measured by quantitatively collected crown features attributable to biotic and/or abiotic stress agents. Regardless of the causative factor, trees may show different internal and/or external symptoms. They are caused by stress-induced physiological and morphological responses of trees as a process of acclimation to environmental changes in an attempt to compensate for the loss of productivity
[79][78]. These phenomena can be observed spectrally and structurally at different levels. In the early stages of stress, indistinct (previsual) changes in pigmentation composition of leaves (e.g., chlorophyll and carotenoid) are caused by a change of activity of biochemical processes. For example, less activity in photosynthesis may occur
[80][79]. These subtle symptoms are typically not visible to the human eye
[81][80]. In advanced stages, prolonged exposure to stress can cause irreversible damage, including discoloration, wilting, defoliation, and eventually lead to the tree’s death (see, e.g.,
[82,83,84][81][82][83]).