The term autonomous vehicle (AV) has become ubiquitous in our lives, owing to the extensive research and development that frequently make headlines. Nonetheless, the flourishing of AVs hinges on many factors due to the extremely stringent demands for safety, security, and reliability. Besides lingering technical problems, the complexity of the AV infrastructure makes it vulnerable to security and privacy attacks that can endanger the lives of passengers and commuters. Surpassing traditional centralized security systems, blockchain has emerged as the best solution to provide the much-needed security shield to AVs with its data transparency, immutability, and decentralized approach. Therefore, enriching and enmeshing technologies like AI, edge computing, IoT, 5G and Blockchain into a robust system will lead to the realization of our much-yearned AV dream into reality.
1. Introduction
Despite the current accelerated and intensive research into the field of autonomous vehicles (AVs) to bring them to the roads, the field is still riddled with technical
[1], legal, and moral challenges. Unless the following obstacles are eliminated or reduced to a considerable extent, it would not be safe or ethical to launch AVs in the market.
2. Infeasible Sensing
For the safe journey of an AV, the sub-task of object detection is one of the most important prerequisites, as it allows the car controller to account for various obstacles while considering possible future trajectories. Sensing the surroundings of the AV heavily depends on the intrinsic properties of the embedded sensors and their quality of perception.
Figure 1 shows the multiple sensors present in an AV to efficiently sense their surroundings. The four main types of sensors are
[2]:
Figure 1. The main set of sensors present in an AV, utilized in sensor fusion.
-
GNSS/IMU: global navigation satellite system and the inertial measurement unit are used for the localization of the AV. GNSS reports the global position estimate accurately, but its update rate is too slow to match real-time requirements. IMU reports the inertial updates of a body at high frequency (at or higher than 200 Hz) but its accuracy degrades with time. Kalman filtering is used to obtain the best advantages of the two, which gives the vehicle a dead reckoning capability and the ability to gather accurate data for real-time localization
[3].
-
LiDAR: Light detection and ranging (LiDAR) can be used for scanning, localization, obstacle detection, and accurate depth perception. It works by calculating how long it takes for a beam of light to hit surfaces and bounce back to the laser scanner. The distance is computed using the velocity of light. This approach is known as “time of flight” measurements. The higher the number of layers used in the scanner, the better the perception of the wide range of environmental contours
[4]. They generate a "shape" of the surrounding environment in the form of point clouds. Consequently, a particle filter is used to filter out and compare the observed shape against a map of known objects to reduce ambiguity.
-
Cameras: Monocular cameras are the most common and widely used sensors in an AV, capturing the 2D RGB images of the surroundings, used for object recognition, tracking, traffic light detection, etc. AVs usually mount between eight and ten cameras, running at approximately 60 Hz and together generating a high amount of data per second. To add depth perception, many systems use double-lens (binocular) cameras called stereo cameras
[5]. Both the single lens and the stereo cameras are cheap, allowing them to be used and depended upon extensively.
-
RaDAR: RaDAR measures distances, movements, and velocity by sending out Radio waves that reflect back from obstacles and detect short- and long-range depth. Short-range Radars have a range of 20–50 m, whereas long-range radars can extend up to 250 m. Radio waves can penetrate objects and are unaffected by bad weather conditions, unlike LiDAR and cameras. They report the distance of the nearest obstacle and the data generated by them do not require a lot of processing. Hence, they are typically fed as input to the control processor for realizing adaptive cruise control (ACC), blind-spot monitoring (BSM) and predictive emergency braking systems (PEBS)
[6].
Table 1 lists the various disadvantages associated with each type of sensor used in AV. Besides those, vehicle computing systems are heavily constrained by memory
[7]. Hence, it is not possible to store and run detectors with large volumes of input images which constrain the depth of neural network approaches. There is also the requirement that the entire detection process be fast, which usually leaves no room for image pre-processing to boost detection performance. Maintaining a high level of accuracy with a quick response time is key. One currently used solution is sensor fusion
[8], which combines various sensing modalities for perception, such as combining data from LiDAR sensors, radar, sensors atop traffic lights, and sensors in other vehicles. Thus, it improves the accuracy and quality of sensing, in addition to reducing the ambiguities that may come from the use of various sensors. The vehicle positioning and orientation will be calculated by combining data from separate sensors. The fusion of data from different sensors and AI-based intelligent sensing are also extensively discussed in
[9]. The types of multi-sensor fusion discussed in various literature
[10][11][12] involve camera-radar (CR), camera-LiDAR (CL), and camera-LiDAR-radar (CLR). The paper
[13] extensively reviews the sensors used, their pros and cons, and the various sensor fusion technology approaches adopted in AVs.
Table 1. Disadvantages of sensors used in autonomous vehicles.
3. Clash between Reliability and Latency
Latency refers to the time for a data packet to be transmitted and processed through multiple intermediate devices and eventually arrive at the destination and be decoded. Besides considering the inference accuracy, we should also pay some attention to another important aspect, namely inference delay. It is obvious that the quality of data and shallow neural networks can significantly hamper the inference accuracy in a pre-trained deep learning model. For the data captured by the sensors on the AV to be reliable and worthy of the decisions based on them, there should be some room for the preprocessing of data to accentuate its quality and hence, allow the vehicle to make correct and ethical decisions at the right moments. However, an additional communication delay is introduced to account for the time taken for data offloading from the mobile devices to a more powerful edge server. Sometimes it may become hampered by the channel dynamics. Nevertheless, the delay introduced by all these vastly endangers the reliability of autonomous vehicles, since even a delay of a few milliseconds can turn out to be fatal while sensing and deciding how to overcome an obstacle on road, which can even cost the lives of pedestrians and other commuters. Therefore, to achieve a comfortable balance between reliability and incurred latency, it is of utmost importance to cut down the wireless transmission delay between the devices on-board and the edge server.
4. Limited Resources
Unlike the cloud servers which have a large number of powerful graphics processing units (GPUs) and central processing units (CPUs), the edge servers are not as heavily equipped
[20] in consideration of the economic benefits and scalability of deployment. For instance, there are a plethora of edge servers that are deployed close to users. As a result, the economic factors of such large-scale deployment automatically come into play. Therefore, an edge server does not need and cannot have as many resources as a cloud server. Thus, they can hardly take a massive number of offloading requests from mobile devices due to constraints in memory, computing, data caching, power resources, limited communication bandwidth, and ultimately, may not be able to process all the tasks fully. If all the data are indiscriminately offloaded to the edge servers, this will lower the processing efficiency and increase the latency of the network.
5. Cyber Security and Privacy
The data acquired by AVs for processing and inferencing are always exposed to a number of security threats due to unauthorized access and weak protection against malicious entities that may jeopardize the private information of the owner. Cybersecurity and privacy are two of the leading bottlenecks hindering the wide deployment of AVs and public acceptance. A survey conducted in 2015 with 5000 respondents across 109 countries
[21] revealed people’s wariness and concerns regarding the misuse of personal information through the software hacking of vehicles with all levels of automation. The situation had not improved much by 2022, as the main threats had not been eliminated. Cybersecurity is the main liability hazard arising from loopholes in in-vehicle security systems such as fragile connectivity, open channels, insecure bus systems, and the existence of intelligent hackers. The hardware and software systems of an AV can be compromised in the following ways
[22]:
-
Intelligent hackers can take over the AV and connected vehicles through their wireless networks (Bluetooth, cellular networks, etc.) to sell personal information for financial gains, inflict physical harm or carry out unlawful activities such as drug and human trafficking. This is relatively easier, as demonstrated by a study
[23] wherein they took control of the brakes and engines of a Chrysler Jeep by hacking its Internet connection.
-
GNSS data can be remotely manipulated to create confusion or critically endanger passenger safety. This can be achieved by injecting fake messages or spoofing GNSS
[24].
-
Physical attacks on sensors include the use of bright lights to blind cameras, and creating interference using ultrasound or radio waves to distract other sensors from correctly perceiving obstacles. Such situations may even lead to fatal accidents. Other onboard hardware may be tampered with leading to privacy breaches.
-
The attacker may even intercept messages in intra-vehicle and inter-vehicle communication (V2V and V2I) and gravely endanger the safety and privacy of the owners and other AVs.
Cyberattacks
[25][26] can lead to functional safety issues and can easily lead to privacy and/or identity theft, even costing someone’s life, if the attacker deliberately changes the direction and takes full control over the actions of the AV. This has prompted companies and governments to take precautionary steps. Various software may be installed to detect malfunction or the presence of hackers, with frequent software updates and changing security architectures. Governments in the US, China, EU, and Singapore have enacted new legislation to address privacy and cybersecurity risks along with the adoption of a control-oriented strategy. Stronger laws and better software can go a long way in tackling these issues.
6. Legal Issues
As autonomous vehicles gradually take over driving control, the law must alter its code and implementation. Worldwide regulations exist to provide the safest and the most secure travel experience to people. Therefore, autonomous vehicles must prove that they conform to the desired safety standard. Current research in the US and Europe is working on this
[27][28]. Legal challenges are one of the most critical issues concerning AVs, covering myriad public policies, traffic codes, technical standards of conventional vehicles, and tort law
[29]. The use of the term “autonomous” in the case of vehicles has sometimes been misconstrued by the law because “autonomy” has broader philosophical connotations, unlike the technical one, which simply means that it can work independently of human intervention while driving
[30]. The Convention of Road Traffic of many countries still mandatorily requires the presence of a driver who shall, at times, be able to take control of the vehicle. This provides a legal framework for semi-autonomous vehicles, but the fully autonomous ones are still off the hook, for which they need to prove that they are either safer than or as safe as their predecessors.
7. Moral and Ethical Issues
When faced with unexpected traffic situations that require complex decision making within split seconds, human drivers are not expected to react optimally and may be excused for making wrong decisions. However, for AVs, which are capable of analyzing the potential outcomes of various options and taking actions accordingly within milli-seconds, wrongful decision making then becomes part of extensive debate and legislation. The AV must conform to the expected moral norms, which differ from person to person. For instance, personality traits determine whether the driver would like to endanger their own life to save others
[31]. It was found in a study
[32] that participants programming an AV tend to more readily endanger car occupants than pedestrians compared to participants driving in a simulator. There is growing evidence of discrepancies between moral judgments (what they would do in moral dilemmas) and moral action (what they would actually do)
[33][34]. What is considered ethical for human drivers may not be so for self-driving cars, and the evaluation of morality may vary based on the perspective of the way that the situation has been presented. Would it be acceptable that, because of AVs, fewer people are harmed, but pedestrians become the ones more likely to be harmed than vehicle passengers? Thus, the introduction of AVs may put different groups at risk compared to the current situation.
This entry is adapted from the peer-reviewed paper 10.3390/s23041963