2. Eyes on the Sky: A Transforming Skyline
2.1. UAV Remote Sensing Perspective of Urban Planning
Remote sensing uses sensors to gather data about an object or phenomenon while avoiding direct physical contact
[18][19]. Typically, satellite or aerial imagery is used for this, which can offer helpful information on various variables such as land-use patterns, vegetation coverage, and environmental changes. In disciplines such as geography, environmental science, agriculture, and urban planning, remote sensing is frequently used to gather and evaluate data from vast areas that would be challenging or time-consuming to survey on the ground
[20]. New sensors and methods are constantly being created to deliver more precise and detailed data, which is how remote sensing technology continuously improves. Remote sensing was first practiced in the 1840s when aerial photos of towns and landscapes were taken using balloons. In their paper, the authors of
[21], describe that aerial photography spread throughout the decades, and the military started utilizing it for surveillance during World War I. After the Soviet Union launched Sputnik 1, the first satellite, in 1957, individuals quickly realized the potential of employing satellites to gather data from orbit.
Since the launch of the first remote sensing satellite for earth’s resources and environmental monitoring, i.e., Landsat-1, in 1972, the data received have been used in various applications, including urban planning
[22]. The spectral, spatial, radiometric, and temporal resolutions are the limiting factors to a wide range of applications. Since the launch of Satellite Pour l’Observation de la Terre (SPOT-1) in 1986, with better spatial resolution and stereo capability, it has been possible to enhance applications in areas such as topographical mapping. Since then, many satellites have been launched with better spatial and spectral resolutions, broadening the data’s applications
[21]. Acquiring data frequently makes it easier to track changes over time and spot trends and anomalies. Many platforms, such as satellites, aircraft, UAVs, and ground-based sensors, can be used for remote sensing. Each platform has pros and cons depending on the application and preferred resolution. They can be used to monitor natural resources, track changes in how land is used, and identify environmental risks. Remote sensing data are frequently processed using image processing techniques such as classification, augmentation, and analysis to extract useful information from the imagery. Automated data processing and analysis can also be done using machine learning methods. Applications that utilize remote sensing technology may move towards using UAVs that can operate at higher altitudes. These UAVs can be larger and can accommodate more safety and security features. With new sensors and platforms such as UAVs, remote sensing technology has evolved dramatically in recent years, making collecting data from locations more straightforward and affordable
[23]. Today, a wide range of applications use remote sensing data, from studying the effects of climate change to monitoring natural catastrophes and mapping land use and vegetation cover.
Advancements in UAV remote sensing have brought many benefits, making them an amazing technology with many advantages over traditional data collection methods
[24]. UAVs are highly maneuverable and can access difficult or dangerous areas, allowing for greater flexibility in data collection. They can capture high-resolution imagery, providing more detailed information about the target object or environment. UAV remote sensing can be quickly deployed and provide rapid data collection, useful for time-sensitive applications such as disaster response or monitoring rapidly changing conditions. It can also be more cost-effective than traditional methods, especially for smaller areas. It requires fewer resources and can provide real-time data collection and analysis, allowing immediate decision-making and response
[25]. This technology captures data across multiple spectral bands, which can provide insights into different properties of the object or environment being studied. Overall, remote sensing offers a powerful data collection, research, and monitoring tool, with many advantages over traditional methods. They are an outstanding and highly advantageous technology because their improvements keep opening new possibilities for various applications in many sectors
[26][27]. A systematic literature review by
[28] analyzed 186 articles to evaluate the integration of remote sensing, ecology, and urban planning. The study found that only 12% of the articles fully integrated all three disciplines, with the majority of studies focused on contributing to the knowledge base or monitoring the impacts of policies. The accessibility of scientific findings remains limited; most articles are not open access and proprietary software, and data are frequently used. The study suggests future avenues for science and potential entry points for remote sensing to become a vital tool in urban planning.
Remote sensing has been used in urban areas since the early days of aerial photography. Aerial photographs were used to create maps and plans of cities and later to monitor urban growth and development
[29]. Satellite remote sensing has been particularly useful for monitoring urban areas because it can cover large areas quickly and cost-effectively. In recent years, advances in satellite technology have made it possible to collect even more detailed and accurate data, enabling urban planners and policymakers to make more informed decisions about managing and developing cities
[28]. Large-scale, high-resolution datasets on urban environments, such as land use and land cover, urban expansion, and developments in the built environment through time, are gathered by satellites
[30]. The authors of
[31] utilize remote sensing data, including land-cover and imperviousness data from the National Land Cover Database (NLCD) 2001–2016, to investigate urban expansion in the Texas Triangle megaregion. Results reveal decreasing urban expansion trends driven by population and economic growth, with pro-sustainability initiatives by anchor cities and metropolitan planning agencies attributed to the changing trend. The study also uses transportation and socio-demographic data from the Texas Department of Transportation (TxDOT) and the U.S. Census Bureau, respectively. Monitoring substantial urban areas and spotting changes that could be challenging to spot on the ground is made possible significantly by satellite data. Lasers are used in the remote sensing technique known as “LiDAR”, which measures the separation between such a sensor and a target
[32]. According to
[33], LiDAR data can produce accurate 3D models of urban settings, which benefit disaster management, architecture, and urban planning. There are negative impacts of urban sprawl, such as climate change, energy and water resource depletion, pollution, and loss of wildlife and agricultural land, among others. The author of
[34] emphasizes the importance of remote sensing techniques, particularly satellite remote sensing, for effective planning and policy support in monitoring urban growth and minimizing urban sprawl and also outlines various methods for monitoring urban changes and the challenges of urban mapping. The benefits of using remote sensing to monitor urban areas include timely and accurate change detection to develop strategies for minimizing urban poverty and related environmental effects. Due to their high spatial resolution data collection capabilities and ease of deployment to targeted regions of interest, UAVs are increasingly employed in urban applications
[35]. UAVs are used for various tasks, including mapping urban infrastructure, checking air quality, and determining the extent of natural catastrophe damage
[36]. The classification process uses remote sensing data to identify and classify various forms of land cover or land use in metropolitan areas. Area evaluation entails measuring and quantifying several elements of the urban environment using remote sensing data
[37]. Examples of this are assessing the size of buildings, roads, and other infrastructure, as well as the amount of open space and water bodies in an urban region. The distribution of resources and infrastructure in metropolitan areas and the location of regions vulnerable to environmental risks can be understood through area assessment. To identify and map the boundaries between various land-use or land-cover categories in urban settings, border estimation uses remote sensing data. Techniques such as image segmentation can be used to separate an image into segments based on similarities in color, texture, or other properties. Many applications, including urban planning, emergency management, and environmental monitoring, might benefit from border estimation
[38]. Recent research has indicated that urban planning necessitates two spatial scales, each with unique remote sensing requirements: the local and strategic scales. The local scale focuses on monitoring specific site planning and identifying objects such as building facades. As explained by the authors in
[39], the strategic scale is centered on planning and monitoring overall land use (zoning) in cities, which encompasses various categories of urban land-use functions such as residential, industrial, and commercial areas, but at a larger city block scale. A remote sensing task performed can be categorized into classifications: object-based and pixel-based
[40][41], urban analysis
[42], land-use/land-cover (LULC) change
[43], urbanization monitoring
[44], monitoring urban heat island
[45], and the societal impacts of using UAVs for urban informal settlements by
[46]. Pertaining to urban growth, the authors of
[47] use night-time light data to analyze urban growth in the Indian-Gangetic planes, proposing a new method for urban area extraction and using machine learning algorithms to predict future growth. The results suggest a methodology for understanding urban areas at the regional scale. A study by
[48] highlights the use of remote sensing and GIS to identify the most suitable sites for urban expansion in Haridwar City, Uttarakhand, by analyzing multiple thematic layers, including land use, slope, elevation, NDVI, and ULD. Urban planning is a multifaceted and intricate process that strives to predict and prepare for future situations. Thus, it must balance the advantages and disadvantages concerning all aspects of the urban system
[49].
Gallacher et al.
[50] pointed out, UAVs have recently demonstrated their potential for usage in a wide range of activities, many of which take place in urban areas. Applications for monitoring in low-risk urban settings include flights over unpopulated locations such as water bodies or steep hills or flights that involve vertical flying.
2.2. Background of UAVs
A UAV can be either a remotely piloted flying robot or an Unmanned Aerial Vehicle that can fly itself using a predetermined flight plane stored in its onboard processor
[51][52]. The First World War contributed to the creation of UAVs. The concept of autonomous aerial vehicles is attributed to the Dayton-Wright Airplane Company, which developed a torpedo that would explode at a predetermined time. The Hewitt-Sperry Automatic Airplane project later created another aerial torpedo, which was designed to deliver explosives to enemy territory
[53]. As a result, the first UAVs were created in massive amounts during World War II, and their numbers kept increasing as the Cold War started. Although the military sector was the sole focus of UAV development in the early decades, more recent technological advances in the fields of robotics, image processing, machine learning algorithms, artificial intelligence, and global navigation satellite systems (GNSS), as well as an increase in accessibility due to price reductions and production rates, have expanded the uses of UAVs to civilian (non-military) purposes
[54].
2.3. UAV Categories
There are numerous categories that UAVs might fall under depending on their uses: size, weight, number of propellers, aerodynamic flight principles, range, equipment, cameras used, and other factors. In activities related to the urban planning industry, rotary-wing and fixed-wing UAVs are the most applied, with the distinction between them being based on variances in their aerodynamic flight principles
[55]. Motors that use rotary-wing technology are more commonly used because they are more accessible, simple to operate, provide reasonable camera control, can operate in limited places, and support hover and vertical take-off and landing (VTOL). The rotary-wing UAVs can be further divided into tri-copters, quadcopters, and hexacopters, depending on the rotor configurations. However, in their study on rotary-wing UAVs, González-Jorge et al.
[56] stated that the flying times of all these UAVs are constrained to no more than 30 min, and they have a small payload capacity (mostly below 8 kg; USI). Fixed-wing UAVs, on the other hand, have a long endurance and can cover a large area quickly. In this instance, the costs associated with the equipment, the amount of space needed for take-off and landing, and the difficulty of flying—which necessitates sufficient training—are the restraints
[57]. Hybrid UAVs, which combine the advantages of fixed-wing UAVs with the capacity to hover and take off and land vertically, have also begun to enter the UAV markets more recently
[58]. Irrespective of the UAV’s category, its key components and subsystems include the frame, propeller, brushless motors, motor mount, landing gear, flight controller, batteries, payload (which could be a remote sensing camera, spraying system, or applications that pertain to logistics), and sensors
[59].
UAVs of the quadcopter/multirotor and fixed-wing varieties have distinctive design elements and flight characteristics (
Figure 2). As the name implies, quadcopter/multirotor UAVs contain several rotors, typically four or more, placed symmetrically. The flight controller controls the electric motors that usually power the rotors. Quadcopters are incredibly agile and can fly in any direction, hover in place, and engage in aerial tricks. They are frequently used for leisure activities, including racing and freestyle flying, aerial photography, and filming. On the other hand, fixed-wing UAVs have a solid, fixed wing that produces lift and enables the UAV to fly ahead. They have a propeller to help them go ahead and are propelled by a motor. Fixed-wing UAVs can travel great distances quickly and are built for more extended flight periods. They are frequently used for military and search and rescue operations and other applications such as monitoring, mapping, and surveying. Based on their capabilities, both types of UAVs are utilized for various applications, each with unique advantages and limitations
[60].
Figure 2. A high-quality image of (a) quadcopter/multi-rotor and (b) fixed-wing UAVs.
Yunus et al.
[61] clarified several interdependent parts that allow for autonomous flight and precise control (
Figure 3). The frame serves as the supporting structure for the rest of the machine. UAVs rely on motors, which are electric motors that turn the UAV’s propellers. Aerodynamic lift is created by rotating the propeller’s blades, which also steer the aircraft. A UAV’s flight path is determined by its flight controller, a miniature computer that receives data from the UAV’s sensors. The UAV’s sensors include an accelerometer, a gyroscope, a barometer, and a Global Positioning System (GPS). The lithium polymer (LiPo) battery can be recharged and supplies energy for electronics and motors. An optional extra, a camera records high-altitude video and stills. The pilot’s ability to direct the UAV’s flight and actions is realized through a transmitter. These parts cooperate to ensure the UAV can take off, fly, and land without incident and gather helpful information or images
[61][62].
Figure 3. Overview of UAV components.
2.4. UAV Data
Aerial images and 3D point clouds are the two main datum types that UAVs gather for remote sensing and analytic applications. With advancements in UAV technology, 2D aerial imagery acquired via UAV is becoming increasingly accessible and cost-effective, making it a popular tool for various industries and applications
[63]. In addition, Latha et al.
[64] referred 2D aerial imagery taken by UAVs to two-dimensional (2D) images of the earth’s surface acquired using UAVs. The images captured by these UAVs can give valuable data and insights for various industries, including agriculture, construction, real estate, and environmental monitoring. Using cameras mounted to UAVs, 2D aerial imagery may be taken from multiple angles and heights, offering a full view of the target area. The images are then processed to provide a versatile 2D aerial map or ortho photo. As they offer a precise perspective of the landscape and features, these photos are frequently utilized for mapping, surveying, and monitoring reasons
[65]. The author of
[66] defines 3D aerial imagery captured by UAVs as aerial photos taken by UAVs that offer a three-dimensional (3D) representation of the earth’s surface. This type of imagery is capable of providing a more detailed view of a location compared to 2D aerial imaging, enabling more precise measurements and analysis (
Figure 4). UAVs can take 3D airborne images utilizing various techniques, such as photogrammetry and LiDAR technology
[65]. On the other hand, LiDAR technology uses laser sensors to produce a 3D point cloud that may be utilized to build a 3D model. Applications for 3D airborne imaging include geological surveys, monitoring of building sites, and urban planning
[67]. It can also be used to create 3D models and maps of structures, infrastructure, and other things and to visualize and analyze topography, such as mountains and valleys. UAV technological advancements have made recording 3D aerial imagery of a particular location more accessible and more affordable than ever, making it a method many businesses utilize.
Figure 4. Type of imagery (a) 2D aerial imagery acquired via UAV; (b) 3D model built from UAV imagery.
2.5. UAV-as-a-Service Sector
Researchers have been studying UAVs’ advantages through other remote sensing methods since the early 2000s. Their findings support the conclusion that UAVs are superior because of their high-resolution imagery, accessibility, ease of functionality, applicability in confined spaces, and frequency of operations. Furthermore, all the required tasks could be carried out without compromising the safety of anyone involved
[68]. The development of robotic systems, artificial intelligence, data science, and software engineering has facilitated machine learning of flights and workflows associated with data analysis. This includes the implementation of different algorithms for machine learning and classification techniques, as well as the faster processing of software. These advancements have greatly benefited the UAV industry. As a result, when UAVs first appeared on the market, businesses were eager to take advantage of their advantages and frequently decided to replace expensive LiDAR data and low-resolution satellite data with the “newly discovered panacea”. The Federal Aviation Administration (FAA) has become more lenient concerning UAV regulations in the United States, which is one factor in expanding commercial UAVs. As noted by the author of
[69], the dominant position of Chinese company Da-Jiang Innovations (DJI) in the consumer-UAV market is an important factor that affects jockeying start-ups in the UAV market. However, the commercial UAV market has changed significantly in recent years, and we have seen a shift in the primary focus from UAV services and software solutions to UAV services and robotics research, which was previously focused on hardware components and robotics research
[70]. This heralds the beginning of the drone-as-a-service industry and says a lot about the usefulness of the data collected by UAVs (
Figure 5).
Figure 5. Pictures showing UAVs being used for (a) delivery/first aid; (b) construction purposes.
Companies specializing in UAV operations, such as Measure and Cyberhawk in the United States, Hemav in Spain, and Aonic in Malaysia, focus on areas such as inspection, mapping, and surveying that are essential for urban planning. These companies aim to provide services that revolutionize the way decision-makers handle their organizations’ time, energy, efficiency, and safety needs
[71]. Moreover, the UAV industry has been successful in generating job opportunities for tens of thousands of people within a short span of time and is expected to maintain its dominance in the years ahead. A recent study by the Association for Unmanned Vehicle Systems International (AUVSI) attests to this fact
[72], which revealed that the UAV industry is predicted to generate more than 100,000 jobs in the United States alone over the next ten years, contributing USD 13.7 billion to the country’s economy. The author of
[73] highlights a major concern arising from the greater automation and adaptability of machines, which is the replacement of human jobs. This is especially worrying for those in the unskilled labor sector.
2.6. Applications of UAVs
UAV use has increased dramatically over the past few years, expanding into new arenas and gaining momentum regularly. Lutkevich et al.
[74] emphasized that UAVs are becoming increasingly important to our daily lives as they open new avenues for advancement in various fields. Precision agriculture, forestry, construction, survey, disaster relief, humanitarian aid, anti-poaching, security and surveillance, and education are just a few of these applications’ most important use cases. Farmers can determine environmental indicators such as the Normalized Difference Vegetation Index (NDVI) using multi-spectral cameras mounted on UAVs
[75]. Recently, UAVs have also been used for planting trees, and it was discovered that the rate at which they planted trees was ten times faster than that of human labor. This not only enables us to save time but also provides an alternative that can be used to combat deforestation more practically
[76]. Apvrille et al.
[77] analyzed whether UAVs could be useful in the aftermath of natural disasters and proclaimed the potential of UAVs for use in tasks related to safety and security verification.
To push the boundaries of remote sensing research, UAVs have been modified to acquire LiDAR and Synthetic Aperture Radar (SAR) data
[78]. Wallace et al.
[79] produced 3D point clouds using a low-cost UAV-LiDAR framework and reported improved spatial accuracy when conducting forest inventory operations. Another study, led by
[80], compared this same spatial accuracy of a UAV-LiDAR system compared to Structure from Motion (SfM) remote sensing data and found that UAV-LiDAR offers advantages over SfM photogrammetry for estimating vegetation height and surface elevation. UAV technology is continuously developing and improving in ground-breaking ways, and it has become an essential part of how many businesses and governmental organizations operate. Their applications are anticipated to increase tenfold in the upcoming decades as they cut through sectors that are either static or falling behind
[81].
2.7. Policies, Rules, Regulations, and Limitations
A significant hurdle to commercial UAV industries was and is still the regulation and policies associated with UAV flying that are put forward by each country or continent’s aviation administration systems. The rules are very lenient in some countries, such as Sweden and Norway. They have enacted relatively unrestricted legislation on commercial UAV use, whereas in countries in East Asia such as Thailand and South Korea, a visual line of sight is required, thus limiting their potential range. Meanwhile, in certain countries such as India and Chile, there still exists an effective ban on the commercial use of UAVs
[82]. In Malaysia, a private pilot’s license and an operating permit are needed to fly commercial UAVs that weigh more than 20 kg. The use of aerial mapping is sometimes limited, particularly from a precision agriculture standpoint, because carrying some UAV types, such as those with multiple sensors, is prohibited in some nations. These sensors are regarded as a possible threat to national security. Unfortunately, these disparate regulations and the absence of unified guidelines for using UAVs have hindered opportunities for the exchange and mobility of research in several instances
[83].
UAVs are becoming increasingly popular in various industries, including agriculture, construction, surveying, and aerial photography. However, due to their potential impact on the environment, there are some environmental restrictions that apply to their use. Weather UAVs are not built to function in severe weather conditions because such conditions may negatively affect their performance and safety. According to Thibbotuwawa et al.
[84], in heavy rain, water could damage the UAV’s electronics and engines, making it prone to malfunction or even a crash. Strong winds may cause the UAV to become unstable and challenging to handle, increasing the risk of accidents. Additionally, high humidity and cold weather may obstruct the UAV’s sensors and cameras, making it difficult to fly and navigate. As per the information presented in
[85], it is crucial to verify the weather forecast before flying a UAV to ensure that the operation is safe and effective. If there is a possibility of adverse weather conditions, it is best to avoid operating the UAV entirely or hold off until the conditions improve. Additionally, UAV pilots must know the restrictions and specifications of their UAV, including the manufacturer’s instructions concerning weather conditions. Many areas are designated as protected under national or international laws to conserve wildlife, ecosystems, and cultural heritage sites. UAVs may not be permitted to fly in these areas or may require special permits to do so. Lopez et al.
[86], in their study, stated that the use of small UAVs is increasing, but their impact on local fauna has not been systematically evaluated. The authors reviewed existing literature and conducted a pooled analysis, finding that wildlife reactions depend on the attributes of the UAV and the characteristics of the animal. They suggest guidelines to minimize the impact of UAVs on wildlife and proposed that a legal framework needs to be adopted to protect wildlife from negative effects. Duffy et al.
[87] indicated that multi-rotors can create more noise pollution than fixed-wing UAVs since they have more rotors and engines, and therefore can cause disturbance to wildlife, which may undermine the purpose of a survey. As the author of CASA et al.
[88] points out, there are typically few regulations in place for flying UAVs for recreational or experimental purposes, and in many cases, a pilot’s license is not needed. However, it is important to recognize that the regulations for recreational or experimental UAV use differ significantly from those for commercial UAV use. There are some legal requirements that apply to UAV usage regardless of the purpose or country, such as not flying near airports, government buildings, or monuments; maintaining a line of sight; following height restrictions; and obtaining the necessary licenses and certifications for the pilot. These regulations exist to ensure the safety, security, and privacy of individuals. The allowable proximity to the no-fly zones can vary depending on failure to adhere to the rules, and the requirements for the permit can result in significant financial penalties for the civilian offender. Nevertheless, this obstacle that UAV users must overcome has been a boon to many software companies.
Various mobile applications have been created in this regard to assist UAV users in identifying airspace areas and avoiding non-designated zones. These applications are intended to guide UAV users in these activities
[89]. There are several mobile apps available that display UAV-flying zones and policies and regulations related to UAV usage (
Figure 6), and these apps are designed to help UAV pilots fly safely and legally within the regulations and policies set forth by governing authorities.
Figure 6. Mobile app displaying UAV-flying zones.
The process of obtaining permits can be time-consuming and may limit the flexibility of UAV operators. In Malaysia, the use of UAVs is regulated by the Civil Aviation Authority of Malaysia (CAAM). According to
[89], operators must obtain permits and follow strict guidelines to ensure the safe and responsible use of UAVs. UAV operators in Malaysia must obtain a Permit to Fly from CAAM. The permit specifies the type of UAV, the pilot’s qualifications, and the purpose of the flight. All UAVs weighing more than 20 kg must be registered with CAAM. Operators must provide the UAV’s specifications, serial number, and other information to register the UAV. There are several no-fly zones in Malaysia where UAVs are prohibited. These include airports, military bases, and other sensitive areas. UAVs must not fly higher than 400 feet (121.92 m) above ground level and must maintain a distance of at least 50 m from people, vehicles, and buildings. UAV operators in Malaysia must have liability insurance to cover any damage or injury that may occur during UAV flights. Night flights are prohibited for UAVs in Malaysia unless the operator obtains special permission from CAAM. Operators using drones for commercial purposes must obtain a special permit from CAAM, and the UAV must meet specific requirements for commercial operations. It is critical to understand that the rules and regulations governing UAV usage in Malaysia are subject to change. It is equally necessary to ensure that one is constantly updated on any modifications or updates to the rules and standards
[89]. In addition, the individuals who operate UAVs must ensure that they comply with all applicable legislation and applicable guidelines.
Another limitation is the cost associated with high-profile UAVs, mostly fixed-wing, and the processing and analyzing expenses attached to the data analysis procedures. A commercial UAV’s usefulness level is measured by the satisfaction obtained after extracting needed information from the data collected. For that, understanding flight plan settings and values for parameters used while applying an algorithm is important; for example, even when using a UAV for mapping and modeling a study site and taking a colossal number of pictures, if the minimum overlap is very low, then the algorithm cannot build 3D models from it. Since there is not yet an anyone-for-all methodology or parameter threshold that can be applied to UAV data, finding ways to optimize flight and UAV configurations, determining parameter values, and algorithm selection can be demanding for amateur UAV users
[90]. External factors such as wind, rain, and level of sunlight may also present additional challenges, affecting the accuracy of the data gathered. The lack of sophisticated hardware in several available UAVs also limits their usage; UAVs that do not feature obstacle detection and collision avoidance features run a high risk of getting damaged fast
[91]. However, in the case of fixed-wing UAVs, it is still complicated for an inexperienced operator to pilot the aircraft safely, as noted by Dollesh et al.
[92]. When a UAV flies beyond a certain height (or radius) or the battery level drops, it can lose control; this is especially true for rotor-wing UAVs, which have a short battery life and are unsuitable for large-scale studies
[57].