Submitted Successfully!
To reward your contribution, here is a gift for you: A free trial for our video production service.
Thank you for your contribution! You can also upload a video entry or images related to this topic.
Version Summary Created by Modification Content Size Created at Operation
1 -- 2053 2024-02-13 14:16:59 |
2 update references and layout Meta information modification 2053 2024-02-18 06:24:56 |

Video Upload Options

Do you have a full video?


Are you sure to Delete?
If you have any further questions, please contact Encyclopedia Editorial Office.
Netinant, P.; Utsanok, T.; Rukhiran, M.; Klongdee, S. Home Security and Automation with Voice Commands. Encyclopedia. Available online: (accessed on 17 April 2024).
Netinant P, Utsanok T, Rukhiran M, Klongdee S. Home Security and Automation with Voice Commands. Encyclopedia. Available at: Accessed April 17, 2024.
Netinant, Paniti, Thitipong Utsanok, Meennapa Rukhiran, Suttipong Klongdee. "Home Security and Automation with Voice Commands" Encyclopedia, (accessed April 17, 2024).
Netinant, P., Utsanok, T., Rukhiran, M., & Klongdee, S. (2024, February 13). Home Security and Automation with Voice Commands. In Encyclopedia.
Netinant, Paniti, et al. "Home Security and Automation with Voice Commands." Encyclopedia. Web. 13 February, 2024.
Home Security and Automation with Voice Commands

With the rapid rise of digitalization in the global economy, home security systems have become increasingly important for personal comfort and property protection. The collaboration between humans, the Internet of Things (IoT), and smart homes can be highly efficient. Interaction considers convenience, efficiency, security, responsiveness, and automation.

home automation home security system Internet of Things

1. Introduction

Crime continues to be a prevalent issue with significant economic, social, and political consequences in countries across the globe [1]. Approximately 83% of the world’s population resides in areas characterized by elevated levels of criminal activity [2]. Contemporary home security systems have undergone significant advancements, expanding the system’s reach beyond mere residential protection by integrating home automation capabilities. Incorporating these modern features helps improve security measures, provides convenience to consumers in their daily lives, and contributes to endeavors aimed at convenience and energy conservation.
In our rapidly evolving digital age, the Internet of Things (IoT) has emerged as a critical smart application for modern security living [3][4][5][6][7][8][9]. Integrating IoT devices, automation detection, and notification systems with smart home technology offers a comprehensive security solution for everyday activities [8][10][11]. Cost optimization and facilitation are significant benefits provided by IoT-driven transformations for real-time remote-access systems [12] through cellular and Wi-Fi networks [4][6][13]. Integrating mobile access points within an IoT-driven home security system can significantly enhance the system’s ability to manage energy resources and maintain robust communication with various sensors and devices. By dynamically adjusting to the optimal positions within a home, these mobile access points ensure that the system’s throughput is maximized, resulting in a more responsive and energy-efficient security network [14][15]. The integration of IoT technology and internet connectivity enables users to remotely manage and react to smart home security system functions, including appliance control, security monitoring, intrusion alert, and automation lighting control [4][6][12][16].
Furthermore, incorporating energy monitoring and control is essential in designing and developing smart home security [17][18][19]. Smart home security systems are implemented using a single-board computer (SBC) to reduce energy consumption effectively. Famous microcontrollers, including but not limited to Raspberry Pi, Arduino, and ModeMCU, propel progress in the IoT domains of smart homes and security [7][20][21][22][23][24]. The compatibility of lighting management and intrusion detection exemplifies the revolutionary capacity of IoT technologies. Alarms throughout the property may be automatically illuminated or sounded upon the detection of an intruder by a hub. This interconnectivity improves security, so the responsiveness of IoT systems and user alerts demonstrate how the requirements for home safety are strengthened. Existing studies [25][26][27][28] have established that integrating IoT-enabled PIR (passive infrared sensor) intrusion detection into home automation systems positively influences security by providing comfort, energy, responsiveness, cost savings, remote control, and convenience.
Similarly, customizing smart home security systems to cater to the most stringent user demands poses unique obstacles, particularly concerning hands-free dictation. The use of voice-activated commands has transformed both automation and human-liberated control. Voice recognition technology has surfaced as a potentially effective intelligent security application for enhancing user convenience and natural command methods. Based on the previous research [29], an earlier study proposed IoT-enabled intruder detection via voice and motion to support a smart light. When an intruder was spotted via a PIR sensor, the system could activate the relay to switch the lights on or off. The research results were observed and summarized on user commands via the Blynk button and Google voice assistance in Thai and English during varying delay times of PIR sensors.

2. Emergence of Smart Home Automation System

Smart home automation systems have utilized innovative methods to improve domestic environments’ connectivity, efficiency, and adaptability. The ability of users to remotely monitor and control IoT-connected devices through specialized applications provides an exceptional level of flexibility, enabling home management regardless of the user’s geographical location [30][31]. Smart home security refers to a range of devices specifically designed to improve the safety and protection of residential areas. These devices include smart cameras, doorbells, locks, sensors, alarms, atmosphere control, and network security measures. Several prior studies have suggested smart home automation systems in diverse domains. Satapathy et al. [32] introduced a novel and economical home automation system utilizing the Arduino framework, which offers straightforward Wi-Fi Internet connectivity. This configuration allows users to access and control their electric devices using smartphones remotely. The essential hardware components consist of an LCD, a relay, an Arduino module, and an ESP8266 in the hardware configuration. Their experimental configuration is meticulously calibrated to optimize the control of diverse domestic devices and proudly exhibits a remarkable efficiency rate of 100 percent. Sharif et al. [33] introduced an innovative home automation model based on the layouts of residential units as part of a simultaneous endeavor. This model offers exceptional versatility in choosing hardware, devices, and communication protocols. The design streamlines essential elements of home automation, particularly the security functionalities. The proposed model provides detailed technical specifications for the hardware and software components of home automation systems. A notable apprehension is that the development process depends exclusively on open-source and readily available software technologies. This strategy enhances the system’s flexibility and prepares it for deployment in diverse real-world situations. In their study, Stolojescu-Crisan et al. [34] introduced qToggle, an innovative system that connects sensors, actuators, and various other data sources. The system facilitates smooth communication by harnessing the capabilities and flexibility of an application programming interface (API). The qToggle APIs are commonly executed through sensors and actuators with network connectivity in the upstream direction. Most qToggle devices utilize ESP8266/ESP8285 chips or Raspberry Pi boards. A specialized smartphone application has been created to enhance user accessibility and control by allowing the remote management of a wide range of home appliances and sensors. These three methods demonstrate the ever-changing field of home automation and emphasize the various strategies used to simplify and enhance the control of household environments. These systems enable the development of smart home technology solutions that are more efficient, cost-effective, and flexible, thanks to innovative hardware and software configurations.
The smart home automation system has been researched to enhance home management and convenience in various aspects, including responsiveness, accuracy, and voice command integration [35][36]. The instantaneous execution of commands and adjustments is essential for ensuring security features and energy management. Precision is the primary objective of accuracy, aiming to carry out tasks with minimal errors to foster user confidence. A previous study includes regulating temperatures, controlling lights, and managing intruders. The implementation of voice command technology can be customized to enhance user-friendliness via the control system [19][37]. The system provides unmatched convenience and accessibility, enabling users to control various aspects through voice commands. The voice command functionality can be practical, particularly for individuals with mobility limitations or visual impairments [29]. Smart home automation systems benefit from quick responsiveness, precise accuracy, and easy-to-use voice command capabilities, improving efficiency, comfort, and accessibility [35]. Dbritto et al. [38] and Zaro et al. [39] examined the utilization of Wi-Fi and mobile applications for the purpose of control and monitoring. Zaro et al. [39] also highlighted explicitly the use of Arduino technology to achieve cost-effectiveness.
Communication technologies, such as 3G, 4G, and 5G, play a pivotal role in the efficient functioning of smart home automation systems [29][40][41]. These cellular connections are important and essential for facilitating effective communication between diverse devices and systems. They ensure universal compatibility across different network generations and maintain the functionality of smart home devices in various network environments. The evolution of cellular networks from 3G to the more advanced 4G and 5G networks signifies a significant leap in enhancing the effectiveness of smart home automation systems. However, it is important to note that while these technologies can significantly enhance the functionality of smart home systems, they may make the systems more complex and expensive to install and use. Many smart home systems are designed to be user-friendly and cost-effective, making them a practical choice for homeowners. The interconnected nature of smart home devices heavily depends on data speed and capacity for real-time data transmission and processing. The advent of 5G technology significantly reduces latency, which is vital for smart home applications that require immediate responses, such as security systems. It also boosts smart home automation systems’ reliability, efficiency, and responsiveness [35][41][42][43].

3. PIR (Motion) Sensors for Intruder Detection and Security

Afreen et al. [44] introduced an innovative smart surveillance system designed for security areas using an IoT framework and a gravity microwave sensor. The Arduino UNO is utilized to control the operations of this setup. The system rapidly transmits a real-time alert message when a sensor, utilizing microwaves within its designated coverage area, detects object movement. The system uses a GSM module to establish a call connection to a cloud service. While a gravity microwave sensor remains unaffected by environmental factors such as temperature fluctuations, it necessitates precise placement to achieve optimal accuracy in larger areas. On the other hand, a PIR sensor is particularly adept at detecting motion in specific regions, making it ideal for intrusion detection purposes. Combining a Raspberry Pi with a PIR sensor creates an intrusion detection and alarm system. This system can include a siren for immediate alerts and the ability to send email notifications to the administrator in the specified area. The PIR sensor is commonly and exceptionally well suited to motion detection, given the characteristics of its infrared waves. In order to precisely detect human and animal motions, electronic security systems frequently implement PIR sensors; however, despite their relatively low cost, false positive alarms may still happen on IoT-enabled PIR systems due to sudden environmental fluctuations, such as altitude, height, light, temperature, and angle [20].
In addition, positioning and calibration accuracy are crucial to achieve optimal performance. Implementing PIR sensor technology is routine in intrusion detection and action movement systems [45][46]. When combined with additional security protocols, the sensors provide enhanced protection for residential properties, commercial establishments, and places of business [47]. Nevertheless, implementing these technologies poses difficulties when attempting to reduce false alarms and ensure precise detection. Design and development are essential during the design and installation of a system to meticulously evaluate environmental factors, such as temperature fluctuations, as they can affect the functionality of sensors. PIR sensors are also commonly utilized for reliable and economical intrusion detection [45]. Difficulties arise due to the environment’s delicate characteristics and the requirement for accurate calibration. In order to maximize the potential of PIR sensor technology for enhancing security and automation systems, this study seeks to assess its practical capabilities.

4. Voice Recognition in Smart Home Security

Currently, the automated smart home system adapted to voice command recognition is an essential technological element along with smart home security systems, providing a convenient and secure method to manage different home devices [48][49][50]. Gunawan et al. [51] and Wang [52] emphasized the significance of precise speech recognition in these systems. In addition, Gunawan [51] showcased the efficacy of the cloud speech technique by employing the Google Voice Kit to enhance processing speed and accuracy. Abidi et al. [49] and Chenxuan [50] highlighted the potential of voice control in augmenting home security, specifically in improving user experience and accessibility. Abidi et al. [49] emphasized the utilization of vocal commands for the management of household devices. Chenxuan [50] investigated a tailored speech recognition system designed specifically for elderly individuals.
Furthermore, the mobile version of Google Translate is a potent instrument that surpasses linguistic obstacles through its voice recognition system. The Google Translate framework can facilitate a collaborative multimodal communication experience by offering instantaneous translations in more than 100 languages and offline translations in almost 60 languages [53]. Incorporating voice recognition technology has enhanced Google Translate’s proficiency in natural language processing (NLP). The framework comprehends the subtleties of verbal communication, including accents, intonations, and colloquial expressions. These facilitate the acceptance of various inputs through users’ typing, speaking, or utilizing the camera translation feature. Several studies have investigated the use of Google Translate voice recognition in multiple applications. Wang [52] effectively employed Google Cloud’s speech-to-text and translation services for video translation, despite encountering difficulties with loud background music and literal translation. Lee et al. [54] integrated facial and vocal recognition into a smart home security system, utilizing a Raspberry Pi as the central component and attaining enhanced convenience and security. Ali et al. [55] implemented an IoT security system with voice recognition. The system incorporates intelligent personal assistant (IPA) systems integrated with the Google speech-to-text API. The simulation results indicate that the system has a high level of proficiency in recognizing 90% of the device names linked to all commands and achieving a 100% accuracy rate in correctly classifying commands within an approximate time frame of 30 s.


  1. The Global Organized Crime Index. 2023. Available online: (accessed on 23 December 2023).
  2. Ivaschenko, O.; Nivorozhkin, A.; Nivorozhkin, E. The role of economic crisis and social spending in explaining crime in Russia: Regional panel data analysis. East. Eur. Econ. 2012, 50, 21–41.
  3. Lohan, V.; Singh, R.P. Home automation using internet of things. In Advances in Data and Information Sciences; Springer: Singapore, 2019; Volume 39, pp. 293–301.
  4. Samad, A.; Siddiqui, F. IoT based automation for smart sustainable homes. In Proceedings of the 2nd International Conference on ICT for Digital, Smart, and Sustainable Development, New Delhi, India, 27–28 February 2020.
  5. Netinant, P.; Vasprasert, P.; Rukhiran, M. Evaluations of effective on LWIR micro thermal camera IoT and digital thermometer for human body temperatures. In Proceedings of the 5th International Conference on E-Commerce, E-Business and E-Government, New York, NY, USA, 28–30 April 2021.
  6. Ahmed, S.H.; Zeebaree, S.R. A survey on security and privacy challenges in smarthome based IoT. J. Contemp. Archit. 2021, 8, 489–510.
  7. Garg, R.; Gupta, S. A review on internet of thing for home automation. Int. J. Eng. Res. Technol. 2020, 8, 80–83.
  8. Farooqi, A.H.; Akhtar, S.; Rahman, H.; Sadiq, T.; Abbass, W. Enhancing network intrusion detection using an ensemble voting classifier for internet of things. Sensors 2024, 24, 127.
  9. Hasan, T.; Abrar, M.A.; Saimon, M.Z.R.; Sayeduzzaman, M.; Islam, M.S. Constructing an integrated IoT-based smart home with an automated fire and smoke security alert system. Malays. J. Sci. Adv. Technol. 2023, 3, 1–10.
  10. Gayathri, K.S.; Thomas, T. Intrusion detection systems for internet of things. In Handbook of Research on Intrusion Detection Systems; IGI Global: Hershey, PA, USA, 2020; pp. 148–171.
  11. Majumder, A.J.; Izaguirre, J.A. A smart iot security system for smart-home using motion detection and facial recognition. In Proceedings of the 2020 IEEE 44th Annual Computers, Software, and Applications Conference, Madrid, Spain, 13–17 July 2020.
  12. Rukhiran, M.; Sutanthavibul, C.; Boonsong, S.; Netinant, P. IoT-based mushroom cultivation system with solar renewable energy integration: Assessing the sustainable impact of the yield and quality. Sustainability 2023, 15, 13968.
  13. Ashraf, Z.; Sohail, A.; Hameed, A.; Farhan, M.; Alotaibi, F.A.; Alnfiai, M.M. Robust and lightweight remote user authentication mechanism for next-generation IoT-based smart home. IEEE Access 2023, 11, 137899–137910.
  14. Liu, X.; Xu, B.; Zheng, K.; Zheng, H. Throughput maximization of wireless-powered communication network with mobile access points. IEEE Trans. Wirel. Commun. 2023, 22, 4401–4415.
  15. Hellaoui, H.; Koudil, M.; Bouabdallah, A. Energy-efficient mechanisms in security of the internet of things: A survey. Comput. Netw. 2017, 127, 173–189.
  16. Rukhiran, M.; Wong-In, S.; Netinant, P. IoT-based biometric recognition systems in education for identity verification services: Quality assessment approach. IEEE Access 2023, 11, 22767–22787.
  17. Viswanath, S.K.; Yuen, C.; Tushar, W.; Li, W.-T.; Wen, C.-K.; Hu, K.; Chen, C.; Liu, X. System design of the internet of things for residential smart grid. IEEE Wirel. Commun. 2016, 23, 90–98.
  18. Al Faruque, M.A.; Vatanparvar, K. Energy management-as-a-service over fog computing platform. IEEE Internet Things J. 2016, 3, 161–169.
  19. Khudhair Al-Gburi, M.; Ali Abdul-Rahaim, L. Secure smart home automation and monitoring system using internet of things. Indones. J. Electr. Eng. Comput. Sci. 2022, 28, 269.
  20. Netinant, P.; Amatyakul, A.; Rukhiran, M. Alert intruder detection system using passive infrared motion detector based on internet of things. In Proceedings of the 2022 5th International Conference on Software Engineering and Information Management, New York, NY, USA, 21–23 January 2022.
  21. Tao, M.; Zuo, J.; Liu, Z.; Castiglione, A.; Palmieri, F. Multi-layer cloud architectural model and ontology-based security service framework for IoT-based smart homes. Future Gener. Comput. Syst. 2018, 78, 1040–1051.
  22. Beuran, R.; Wang, J.; Zhao, M.; Tan, Y. IoT security training for system developers: Methodology and tools. Internet Things 2023, 24, 100931.
  23. Yang, J.; Sun, L. A comprehensive survey of security issues of smart home system: “Spear” and “Shields”, theory and practice. IEEE Access 2022, 10, 124167–124192.
  24. Allifah, N.M.; Zualkernan, I.A. Ranking security of IoT-based smart home consumer devices. IEEE Access 2022, 10, 18352–18369.
  25. Likhitha, K.; Malineni, S.; Jampani, N.; Prasanna, N.L. Home security system using PIR sensor-IoT. Int. J. Sci. Res. Comput. Sci. Eng. Inf. Technol. 2019, 5, 497–500.
  26. Chen, X.-Y.; Wen, C.-Y.; Sethares, W.A. Multi-target PIR indoor localization and tracking system with artificial intelligence. Sensors 2022, 22, 9450.
  27. Palaniapan, S.; Kollathodi, M.A. Real time implementation of embedded devices as a security system in intelligent vehicles connected via Vanets. Int. J. Electr. Comput. Eng. 2019, 9, 4788–4797.
  28. Roslina, R.; Amelia, A.; Pranoto, H.; Sundawa, B.V. System of smart detection and control to electrical energy for saving of electrical energy consumption. Bull. Electr. Eng. Inform. 2021, 10, 2454–2465.
  29. Netinant, P.; Rukhiran, M.; Rattanakorn, P. Development of smart light control and intruder detection with voice and motion based on internet of things using Raspberry Pi. In Proceedings of the 6th International Conference on Business and Information Management, Guangzhou, China, 26–28 August 2022.
  30. Panigrahi, S.K.; Goswami, V.; Apat, H.K.; Barik, R.K.; Vidyarthi, A.; Gupta, P.; Alharbi, M. An interconnected IoT-inspired network architecture for data visualization in remote sensing domain. Alex. Eng. J. 2023, 81, 17–28.
  31. Kanellopoulos, D.; Sharma, V.K.; Panagiotakopoulos, T.; Kameas, A. Networking architectures and protocols for IoT applications in smart cities: Recent developments and perspectives. Electronics 2023, 12, 2490.
  32. Satapathy, L.M.; Bastia, S.K.; Mohanty, N. Arduino based home automation using internet of things (IoT). Int. J. Pure Appl. Math. 2018, 118, 769–778.
  33. Sharif, H.; Despot, I.; Uyaver, S. A proof of concept for home automation system with implementation of the internet of things standards. Period. Eng. Nat. Sci. 2018, 6, 95–106.
  34. Stolojescu-Crisan, C.; Crisan, C.; Butunoi, B.-P. An IoT-based smart home automation system. Sensors 2021, 21, 3784.
  35. Irugalbandara, C.; Naseem, A.S.; Perera, S.; Kiruthikan, S.; Logeeshan, V. A secure and smart home automation system with speech recognition and power measurement capabilities. Sensors 2023, 23, 5784.
  36. Venkatraman, S.; Overmars, A.; Thong, M. Smart home automation—Use cases of a secure and integrated voice-control system. Systems 2021, 9, 77.
  37. Iliev, Y.; Ilieva, G. A framework for smart home system with voice control using NLP methods. Electronics 2022, 12, 116.
  38. Dbritto, V.; Carwalo, T.; Chaudhari, P.; Solaskar, S.; Machado, S. Smart home automation system. In Proceedings of the International Conference on Recent Advances in Computational Techniques, Maharashtra, India, 26–27 June 2020.
  39. Zaro, F.; Tamimi, A.; Barakat, A. Smart home automation system. Int. J. Eng. Innov. Res. 2021, 3, 66–88.
  40. Shehab, M.J.; Kassem, I.; Kutty, A.A.; Kucukvar, M.; Onat, N.; Khattab, T. 5G Networks towards smart and sustainable cities: A review of recent developments, applications and future perspectives. IEEE Access 2022, 10, 2987–3006.
  41. Huseien, G.F.; Shah, K.W. A review on 5G technology for smart energy management and smart buildings in Singapore. Energy AI 2022, 7, 100116.
  42. Mazhar, T.; Malik, M.A.; Haq, I.; Rozeela, I.; Ullah, I.; Khan, M.A.; Adhikari, D.; Ben Othman, M.T.; Hamam, H. The Role of ML, AI and 5G technology in smart energy and smart building management. Electronics 2022, 11, 3960.
  43. Gohar, A.; Nencioni, G. The Role of 5G technologies in a smart city: The case for intelligent transportation system. Sustainability 2021, 13, 5188.
  44. Afreen, H.; Kashif, M.; Shaheen, Q.; Alfaifi, Y.H.; Ayaz, M. IoT-based smart surveillance system for high-security areas. Appl. Sci. 2023, 13, 8936.
  45. Al-Jazzar, S.O.; Aldalahmeh, S.A.; McLernon, D.; Zaidi, S.A.R. Intruder localization and tracking using two pyroelectric infrared sensors. IEEE Sens. J. 2020, 20, 6075–6082.
  46. Fang, L.; Wu, Y.; Wu, C.; Yu, Y. A nonintrusive elderly home monitoring system. IEEE Internet Things J. 2021, 8, 2603–2614.
  47. Erden, F.; Velipasalar, S.; Alkar, A.Z.; Cetin, A.E. Sensors in assisted living: A survey of signal and image processing methods. IEEE Signal Process. Mag. 2016, 33, 36–44.
  48. Wang, P.; Lu, X.; Sun, H.; Lv, W. Application of speech recognition technology in IoT smart home. In Proceedings of the 2019 IEEE 3rd Advanced Information Management, Communicates, Electronic and Automation Control Conference, Chongqing, China, 11–13 October 2019.
  49. Abidi, E.; Asnawi, A.L.; Azmin, N.F.M.; Jusoh, A.Z.; Ibrahim, S.N.; Ramli, H.A.M.; Malek, N.A. Development of voice control and home security for smart home automation. In Proceedings of the 2018 7th International Conference on Computer and Communication Engineering, Chongqing, China, 11–13 October 2019.
  50. Chenxuan, H. Research on speech recognition technology for smart home. In Proceedings of the 2021 IEEE 4th International Conference on Automation, Electronics and Electrical Engineering, Shenyang, China, 19–21 November 2021.
  51. Gunawan, T.S.; Mokhtar, M.N.; Kartiwi, M.; Ismail, N.; Effendi, M.R.; Qodim, H. Development of voice-based smart home security system using Google voice kit. In Proceedings of the 2020 6th International Conference on Wireless and Telematics, Yogyakarta, Indonesia, 3–4 September 2020.
  52. Wang, H.H. Speech recorder and translator using Google cloud speech-to-text and translation. J. IT Asia 2021, 9, 11–28.
  53. Martín, B.S. Translation Quality Assessment of Google Translate and Microsoft Bing Translator. Available online: (accessed on 24 December 2023).
  54. Lee, H.-T.; Chen, R.-C.; Chung, W.-H. Combining voice and image recognition for smart home security system. In Lecture Notes in Electrical Engineering; Springer: Singapore, 2019; pp. 212–221.
  55. Ali, A.-E.A.; Mashhour, M.; Salama, A.S.; Shoitan, R.; Shaban, H. Development of an intelligent personal assistant system based on IoT for people with disabilities. Sustainability 2023, 15, 5166.
Contributors MDPI registered users' name will be linked to their SciProfiles pages. To register with us, please refer to : , , ,
View Times: 98
Revisions: 2 times (View History)
Update Date: 18 Feb 2024