Accurate detection and delineation of individual trees and their crowns in dense forest environments are essential for forest management and ecological applications. This research explores the potential of combining leaf-off and leaf-on structure from motion (SfM) data products from unoccupied aerial vehicles (UAVs) equipped with RGB cameras.
Accurate detection and delineation of individual trees and their crowns in dense forest environments are essential for forest management and ecological applications. This research explores the potential of combining leaf-off and leaf-on structure from motion (SfM) data products from unoccupied aerial vehicles (UAVs) equipped with RGB cameras.
Paper | Forest Characteristics |
UAV Imagery Type | Camera Angle |
Tree Detection Algorithm |
Crown Delineation Algorithm |
Description | |
---|---|---|---|---|---|---|---|
[28] | [42] | Dry conifer forest, low tree density | DJI Phantom 4 Pro (RGB) | Nadir & oblique | Local maxima on CHM | - | Various flight altitudes, patterns, and camera angles were tested, and better accuracy values were achieved by combining crosshatch flight patterns with nadir camera angles. The maximum F-score values ranged between 0.429 and 0.771. |
[29] | [43] | Broadleaf forest, test sites with different stand densities | DJI Phantom 4 Pro (RGB) | Nadir | Local maxima on CHM | Region growing + inverse watershed segmentation |
The highest overall accuracy (F-score = 0.79) was obtained for the low-density stand by applying a region growing algorithm on the CHM. Accuracy also varied among different tree species, with the best results obtained for Caspian poplar and the lowest for Persian ironwood. In high-density stands, the crown delineation results could be improved by applying weak gaussian filtering to the CHM. |
[30] | [44] | Mixed conifer forest, open canopy | DJI Phantom 3 (RGB) | Nadir | Local maxima on CHM | - | Fixed window sizes were used in the local maxima filter, and it was observed that accuracy decreased as the filter sizes exceeded 1 × 1 m. Challenges in tree detection were specifically noted in steep areas and regions with high canopy closure. DTMs obtained through SfM tended to overestimate height in dense vegetation in comparison to DTMs derived from airborne laser scanning. |
[31] | [45] | Mixed-conifer forest, moderate density | DJI Phantom 4 (RGB) | Nadir, oblique & composite | Variable window filter (VWF), 3D point cloud-based algorithms |
- | Different flight parameters (altitude, camera angle, and image overlap), SfM processing settings (depth filtering, alignment, and dense cloud quality), and tree detection algorithms (CHM smoothing, VWF parameters, and point-cloud-based methods) were investigated. Higher accuracies were achieved at high flight altitudes (120 m) and with high image overlap (90%). The combination of nadir and oblique imagery resulted in detection rates worse than using only nadir data. CHM-based VWF methods produced the most accurate results, with F-scores up to 0.664 (trees > 10 m) and 0.826 (trees > 20 m). |
[32] | [46] | Pine tree plantations | DJI Mavic Pro (RGB) | Oblique | Local maxima on CHM | - | Prior to tree detection using local maxima, the CHM was mean-filtered with a user-defined filter size. Accuracy of up to 0.78 (F-score) was achieved. |
[33] | [47] | Spruce-pine forest | DJI Phantom 4 Pro, Parrot Disco-Pro Ag & DJI Matrice 210 (RGB & multispectral) | Nadir | Local maxima on CHM | Watershed segmentation | Using consumer-grade cameras yielded higher tree detection rates and more accurate crown diameters compared to multispectral cameras. Cameras with higher spatial resolution performed better at higher flight altitudes, whereas the opposite was observed for cameras with lower resolution. The best results were achieved with the DJI Phantom 4 RGB drone, detecting 84% of the trees correctly. The mean absolute error of crown diameters derived was 0.79–0.99 m (Phantom 4, RGB) and 0.88–1.16 m (Zenmuse X5S). |
[34] | [48] | Mixed conifer forest, open canopy | DJI Phantom 3 (RGB) | Nadir | Local maxima on CHM | - | Different window sizes for local maxima detection were tested, and the performance of smoothed and non-smoothed CHM was compared. Lower window sizes for local maxima and smoothing proved to be more successful in detecting trees. The overall F-score value was 0.86. |
[35] | [49] | Forest plantations, high canopy density | DJI M600 Pro (5-lens oblique) | Oblique | Adaptive-/fixed-kernel bandwidth mean-shift (AMS/FMS), region growing on CHM | AMS, FMS, region growing on CHM | Kernel bandwidth was defined based on canopy properties and applied to the mean-shift tree detection and delineation algorithm. The AMS method outperformed FMS and seed-based region growing methods, achieving an overall accuracy of ≥0.72 for tree detection and a relative RMSE of ≤0.13 for crown width. |
[36] | [50] | Orchard yard/naturally wooded pasture/urban trees, low tree density | DJI Phantom 4 (RGB) | Single shot detector (SSD) deep learning model on raster data (returning bounding boxes around tree position) | Several additional datasets were derived from the RGB and DSM and were used for training purpose. SSD was used for tree detection and species classification. Ensembled models with different input datasets generally demonstrated higher performance compared to models based on only one type of input data. | ||
[37] | [51] | Conifer and mixed regenerating forest stands, low tree density | DJI Phantom 4 Pro (RGB) | Nadir | - | Mask R-CNN on raster data | Mask R-CNN were trained using manually delineated crowns; pretrained networks were also incorporated. An average F1-score of 0.91 was achieved. ITCD remained more challenging for heterogeneous and denser forest stands, as well as for smaller crowns. |
[20] | [35] | Conifer plantation, moderate tree densities | DJI Phantom 4 (multispectral) | Local maxima on RGB and CHM | Marker-controlled watershed segmentation, Mask R-CNN on raster data |
The performance of local maxima, marker-controlled watershed segmentation and Mask R-CNN were compared. Local maxima and watershed algorithms scored the best results when applied to the CHM. Overall, Mask R-CNN outperformed the classic algorithms. | |
[38] | [52] | Subtropical broadleaf forest, moderate tree density | DJI Matrice 600 (RGB & hyperspectral) | - | Watershed-spectral-texture-controlled normalized cut | An extension was made to the CHM-based watershed segmentation to reduce over-segmentation. Objects segmented by the watershed algorithm were clustered based on the normalized cut criterion, considering both spectral and textural information. |