Mixed Reality (MR), a term first introduced in 1994, combines the physical and digital worlds, with Augmented Reality (AR) being the most well-known example. Unlike Virtual Reality (VR), which creates a virtual environment that completely isolates users from the real world, MR blends virtual and physical realms, blurring the boundaries between them.
Mixed Reality (MR), a term first introduced in 1994, combines the physical and digital worlds, with Augmented Reality (AR) being the most well-known example. Unlike Virtual Reality (VR), which creates a virtual environment that completely isolates users from the real world, MR blends virtual and physical realms, blurring the boundaries between them 
. Today, MR has evolved beyond its original definition, encompassing environmental understanding, human understanding, spatial sound, location and positioning in both physical and virtual spaces, and collaborative work on 3D assets in mixed reality environments 
. Furthermore, users can interact with digital content simply by tapping their fingers, opening up even more possibilities for interaction design.
In recent years, the smart home has become a popular concept. Smart homes are comprised of networks and sensors and can be controlled by smartphones through apps. Major international IT companies such as Google, Amazon, and Apple have entered the smart home field 
. The goal of the smart home is to provide a better quality of user life in terms of energy efficiency, security, convenience, and entertainment 
. However, smart homes are not well accepted in the market. This is caused by various reasons such as distrust and technology anxiety 
The resistance mentioned earlier can stem from the smart device itself, as its reliability, performance, and controllability can affect users’ adoption intentions. Older and less-educated participants tend to be the most distrustful of IoT and exhibit strong resistance. Additionally, complex services may create negative impressions and emotions in users’ minds 
. With regards to technology anxiety, Pal et al. argue that some users, particularly older adults, prefer using familiar technology instead of embracing new innovations due to their decreased cognitive and physical abilities 
. Furthermore, it has been noted that technology anxiety can also exist among the younger population, although limited research has explored this aspect. In recent years, the rapid growth of technology has necessitated individuals to quickly upgrade their knowledge and skills in using new technological products. This constant need for adaptation can lead to feelings of fear and anxiety, particularly among new and untrained users 
. Even among the digital natives generation, there remains a possibility of digital inequality arising due to digital limitations 
. These studies all suggest that the cost of learning new technologies and fear of new technologies contribute to technology anxiety. Addressing the issue of technology anxiety requires an essential focus on reducing the learning barriers associated with using new technologies.
Natural interaction is a design paradigm that aims to replicate human behavior in technological applications. It provides an intuitive, entertaining, and non-instructive interaction experience 
. The natural interaction system design focuses on recognizing congenital and spontaneous human expressions in relation to some object 
. Applying natural interaction can reduce the user’s cognitive load by mimicking familiar user interactions for virtual objects 
. Natural interaction can include using speech, gestures, and facial expressions to control and interact with technology rather than traditional methods such as buttons and touchscreens 
. In general, natural interaction allows for more user-friendly interactions with technology.
2. Natural Interaction
The concept of natural interaction has been developed for a long time. Ishii et al. present the idea called “Tangible Bits”. Another work conducted by Rekimoto et al. presents the early rising concept of interaction with the real world 
. In modern research, natural interaction has been applied widely in various fields and has proved that it can improve the user experience and make interaction joyful. Kyriakou et al. applied natural interaction to a museum AR system. Users can see virtual artifact replicas in their system through the AR application. The AR application is deployed on a low-cost HMD such as Google cardboard. Additionally, they used leap motion to track users’ hands in real time. The experiment results showed that the application was accepted positively among all age groups, and most users felt enjoyment 
. Another application scenario is a video game. Leibe et al. conducted a study that applied natural interaction to the video game Elder Scrolls V. They use Kinect as a pose recognizer to perform tasks such as “Raise shield” and “Cast spell”. By measuring the “fun value” of natural and native interaction through a questionnaire, they found that natural interaction provides a more enjoyable and intuitive user experience 
. As the adoption of AR technology has risen, Aliprantis et al. conducted an evaluation of gesture-based natural interaction within an AR context. Despite improvements in their designs, these have not yet received high levels of acceptance due to ongoing challenges with accuracy and complexity 
. Although the accuracy of gesture recognition has seen significant advancements in recent years, as evidenced by Gloumeau et al.’s development of a six-degrees-of-freedom manipulation technique for virtual objects 
, the steep learning curve associated with this technology remains a formidable challenge.
3. Technology Anxiety
Many studies have been conducted to explore the factors that could influence technology anxiety. Researchers have found that factors such as gender and computer experience have significant correlations with technology anxiety 
. Although numerous papers have mentioned the correlation between age and technology anxiety 
, Fernández-Ardèvol et al. hold the opposite opinion that age does not have a strong correlation with technology anxiety 
. However, other research, such as that by Ivan et al., found that technology anxiety increases when older individuals face younger adults who demonstrate better information and communication technology (ICT) skills 
. This suggests that multiple factors may influence technology anxiety, and understanding these factors can help facilitate the adoption of new technologies across various user groups.
4. Applying AR/MR Technology for Empowering Learning
AR/MR technology has been extensively adopted in educational and professional training scenarios, demonstrably reducing cognitive load and overcoming learning obstacles. Take, for instance, the work by Cheng et al., who created an AR book. This unique tool supplements standard educational content with virtual elements accessible via AR devices, not only diminishing cognitive load but also amplifying reading motivation 
. Language learning is another arena where AR/MR technology is making strides. Dalim et al. exploited speech recognition in combination with AR technology to facilitate children’s language acquisition. Their approach noticeably amplified engagement and expedited the learning rate 
. In the realm of professional training, particularly in medicine, Kobayashi et al. integrated MR into medical training protocols. Their research demonstrated that MR positively impacts acute care, surgical care, and medical science 
. These examples collectively attest to MR’s potential in alleviating the complexities of both study and professional training. However, current research is lacking in studies focusing on daily-use scenarios, as technology anxiety can be caused by the use of technology in daily life.
5. Smart Home Controller in AR Environment
Although there are many studies related to smart home control, few existing works explore the smart home in an AR environment. Mahroo et al. created an AR smart home framework called HoloHome. The goal of this framework is to allow AR applications on the HoloLens platform to be able to interact with real objects in the physical world. They use Vuforia image processing to locate the home appliance and overlay the virtual version of the home appliance over the real one. Each time the user looks at the specific smart device, the virtual replica is activated and necessary information appears