Submitted Successfully!
To reward your contribution, here is a gift for you: A free trial for our video production service.
Thank you for your contribution! You can also upload a video entry or images related to this topic.
Version Summary Created by Modification Content Size Created at Operation
1
Boštjan Šumak
 -- 1672 2023-07-06 10:50:01 |
2 layout
Camila Xu
 Meta information modification 1672 2023-07-06 10:56:40 |

Video Upload Options

Do you have a full video?
Send video materials Upload full video

Confirm

Are you sure to Delete?
Yes No
Cite
If you have any further questions, please contact Encyclopedia Editorial Office.
Šumak, B.; Kous, K.; Martínez-Normand, L.; Pekša, J.; Pušnik, M. User-Based Testing with Users with Disabilities. Encyclopedia. Available online: https://encyclopedia.pub/entry/46507 (accessed on 02 July 2024).
Šumak B, Kous K, Martínez-Normand L, Pekša J, Pušnik M. User-Based Testing with Users with Disabilities. Encyclopedia. Available at: https://encyclopedia.pub/entry/46507. Accessed July 02, 2024.
Šumak, Boštjan, Katja Kous, Loïc Martínez-Normand, Jānis Pekša, Maja Pušnik. "User-Based Testing with Users with Disabilities" Encyclopedia, https://encyclopedia.pub/entry/46507 (accessed July 02, 2024).
Šumak, B., Kous, K., Martínez-Normand, L., Pekša, J., & Pušnik, M. (2023, July 06). User-Based Testing with Users with Disabilities. In Encyclopedia. https://encyclopedia.pub/entry/46507
Šumak, Boštjan, et al. "User-Based Testing with Users with Disabilities." Encyclopedia. Web. 06 July, 2023.
User-Based Testing with Users with Disabilities
Edit
This entry is adapted from the peer-reviewed paper 10.3390/app13095498

Human-centered design (HCD) “is an approach to interactive systems development that aims to make systems usable and useful by focusing on the users, their needs and requirements, and by applying human factors/ergonomics, and usability knowledge and techniques“. Developing usable and accessible solutions demands conducting usability testing, also called user-based testing, in which users perform real tasks with a prototype or a real system, usually using one or more specific User Interfaces (UIs). A comprehensive understanding of the challenges users face when using solutions, especially when developing accessible solutions, requires including real users with disabilities in user-based testing. An inclusive HCD approach enables the detection and addressing of real problems and barriers experienced by users with disabilities, ultimately improving usability and accessibility based on their valuable feedback. Involving users with disabilities in user-based testing, on the other hand, requires adequate planning and execution of testing considering the different capabilities and limitations of users with disabilities.

UX evaluation inclusive UX evaluation inclusion of persons with disabilities

1. Introduction

Disability is an umbrella term for impairments, activity limitations, and participation restrictions. It denotes the negative aspects of the interaction between a person’s health condition(s) and that individual’s environmental and personal factors [1]. Persons with disabilities include those who have long-term physical, mental, intellectual, or sensory impairments which, in interaction with various barriers, may hinder their full and effective participation in society on an equal basis with others [2].
According to the World Health Organization’s estimation, 1.3 billion people, representing 16% of the global population, experience a significant disability. The number is growing because of increased noncommunicable diseases and people living longer [3]. Mobility disability, the most common disability, affects 1 in 7 adults [4]. In 2019, it was estimated that 970 million people were living with a mental disorder [5]. Vision impairment affects the quality of life of nearly 2.2 billion people, who often have lower workforce participation and productivity rates and higher rates of depression and anxiety [6][7]. By 2050, nearly 2.5 billion people will have some degree of hearing loss, and at least 700 million will require hearing rehabilitation [8].
Impairments affect many aspects of a person’s life, including communication and speech, cognition, education, employment, etc. For example, persons with brain injury, locked-in syndrome, cerebral palsy, muscular dystrophy, or amyotrophic lateral sclerosis may have limited limb movement ability [9]. People with neuromuscular problems usually lose a degree of autonomy in their daily activities [10]. People with severe disabilities such as amyotrophic lateral sclerosis, motor neuron diseases, cerebral palsy, stroke, and spinal cord injury with intubation have different degrees of communication problems [11]. With ageing, disability becomes more common, affecting around two in five adults aged 65 and older. The number of older people prone to various diseases that impact their effective use of information communication technologies (ICT) is expected to double by 2050 [12].
Disability has become a priority issue in international cooperation for inclusive development [13]. In the 2030 Agenda, disability is recognized as a cross-cutting issue and addressed in the following Sustainable Development Goals [14]: Goal 4—Ensure inclusive and equitable quality education and promote lifelong learning opportunities for all; Goal 8—Promote sustained, inclusive, and sustainable economic growth, full and productive employment, and decent work for all; Goal 10—Reduce inequality within and among countries; Goal 11—Make cities and human settlements inclusive, safe, resilient, and sustainable; and Goal 17—Strengthen the means of implementation and revitalize the Global Partnership for Sustainable Development.
Although there is a tremendous effort in enabling digital inclusion to ensure that every individual has access to information and communication technologies (ICT), people with disabilities are still facing a significant digital divide [15]. Inclusive design is essential to creating products that target a diverse audience. User Interface (UI) designers face different challenges while designing UIs for interactive systems due to the heterogeneity, which can also result from a diversity of end users and interaction modalities [16]. Designers and developers of adaptive applications with UIs able to adapt interaction contents and information processing modes according to users’ needs and disabilities especially face significant difficulties in implementing such applications that meet the dynamic of their environment [17].
Successfully developing usable and accessible solutions demands the design and conducting of usability studies. Usability evaluation can ensure that interactive systems (i.e., software, a website, or any information and communication technology or service) are adapted to the users and their tasks and that their usage has no adverse outcomes [18]. In user-based testing, it is very important to include real end users because only with their feedback can the development process result in applications that best serve the interests of end users. Evaluation by real users is the most valuable technique because it enables the detection of real problems and barriers that users experience while using the solution [19].
In general, when designing and conducting usability testing, it is recommended to follow principles and guidelines provided by existing standards. For applying interaction principles and the general design recommendations for interactive systems, ISO 9241-110:2020 [20] can be followed. A classification of evaluation techniques and guidelines for preparing an evaluation report based on a common industry format and the selected evaluation approach(es) are provided by ISO/IEC 25066:2016 [21]. The standard ISO 9241-210:2019 [22] provides requirements and recommendations for HCD principles and activities throughout the life cycle of computer-based interactive systems.

2. Human-Centered Design (HCD) for Usable and Accessible Solutions

The effective way to achieve high usability in modern solutions is to incorporate human-centered design (HCD) into the development process [23]. HCD “is an approach to interactive systems development that aims to make systems usable and useful by focusing on the users, their needs and requirements, and by applying human factors/ergonomics, and usability knowledge and techniques. This approach enhances effectiveness and efficiency, improves human well-being, user satisfaction, accessibility and sustainability; and counteracts possible adverse effects of use on human health, safety and performance.” [22] In the HCD process, the following principles specified by ISO 9241-210 should be followed [22][24]: (1) understand the user, the task and environmental requirements; (2) encourage the early and active involvement of users; (3) be driven and refined by user-centered evaluation; (4) include iteration of design solutions; (5) address the whole user experience; (6) encourage multi-disciplinary design.
Usability, accessibility, user experience (UX), and HCD have become essential issues to guarantee the quality and success of a software project [25]. When developing solutions tailored to the needs of users with disabilities, the user-centered approach allows understanding the experiences of such users, and based on the results, the usability, UX, and accessibility of these can be improved [26]. Usability is defined by the ISO 9241-11 ergonomics of human–system interaction—Part 11: Usability: Definitions and concepts as [27] “extent to which specified users can use a system, product or service to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use”. UX, on the other hand, is defined as “user’s perceptions and responses that result from the use and/or anticipated use of a system, product or service. Users’ perceptions and responses include the users’ emotions, beliefs, preferences, perceptions, comfort, behaviours, and accomplishments that occur before, during and after use.” [22] Accessibility is defined as “extent to which products, systems, services, environments and facilities can be used by people from a population with the widest range of user needs, characteristics and capabilities to achieve identified goals in identified contexts of use” [27].

3. User-Based Testing with Users with Disabilities

One of the most widely used methods that involves end users is usability testing, also called user-based testing, in which users perform real tasks with a prototype or real system [23], usually using one or more specific UIs. In the iterative user-centered design process, end-user participation is essential for applying techniques such as observation of users, performance-related measurements, questionnaires, interviews, and thinking aloud [28]. Especially when targeting users with disabilities, when it comes to user-based testing, it is essential to involve such users in the process to ensure that the product is usable and accessible to everyone. Usability assessment has been recognized as a critical success factor in developing usable interactive systems with increased productivity, reduced errors, reduced need for user training and user support, and improved acceptance by their users [29].
User-based testing with users with disabilities is paramount for investigating interaction and other difficulties with the product and enhancing the accessibility of a product [30]. Moreover, the expertise of each user, the configuration of the system, and the assistive products [31] utilized by the user are just a few of the variables that can determine whether the user manages to overcome a potential barrier or not [19]. Users can also be asked to explore the product freely while their behaviors are observed and recorded to identify design flaws that cause user errors or difficulties [18]. During the session, a researcher or more researchers observe the participant’s behavior and listen for feedback, enabling different variables to be measured (e.g., task completion time, the accuracy of execution, navigation behavior, etc.). Based on the qualitative and quantitative data analysis, the product’s usability can be improved. The participatory assessment methods with real end users who employ a UI as they work through task scenarios and give feedback provide better insight into the underlying causes of system usability problems users encounter [29].
When user-based testing aims to assess the solution’s performance in terms of the speed of performing tasks or errors when using the solution, it does not matter which users that are included. Existing research has shown that performance of users with disabilities while testing a product can be very close to the performance of users without disabilities [26][32][33]. However, when analyzing and comparing the benefits of products for users with disabilities, the results between users with disabilities and users without disabilities can differ significantly. The difference could be attributed to the greater utilization of new technology’s advantages to people with disabilities, while those without disabilities take less advantage of the benefits or do not even need them as much. For example, the study by Giudice et al. demonstrated that older adults who are blind or have a visual disability and experience difficulties in navigating could significantly benefit from a navigation system, and evaluating older participants with a visual disability is important, as the majority of vision loss is related to age [32].

References

  1. World Health Organization. International Classification of Functioning, Disability and Health (ICF). Available online: https://www.who.int/classifications/international-classification-of-functioning-disability-and-health (accessed on 20 March 2023).
  2. Inter-Parliamentary Union. From Exclusion to Equality. Realizing the Rights of Persons with Disabilities. In Handbook for Parliamentarians; Inter-Parliamentary Union: New York, NY, USA, 2015; ISBN 9789210572651.
  3. World Health Organization. Disability. Available online: https://www.who.int/news-room/fact-sheets/detail/disability-and-health (accessed on 1 April 2023).
  4. Centers for Disease Control And Prevention CDC: 1 in 4 US Adults Live with a Disability. Available online: https://www.cdc.gov/media/releases/2018/p0816-disability.html (accessed on 1 April 2023).
  5. World Health Organization. Mental Disorders. Available online: https://www.who.int/news-room/fact-sheets/detail/mental-disorders (accessed on 1 April 2023).
  6. Xie, I.; Wang, S.; Saba, M. Studies on blind and visually impaired users in LIS literature: A review of research methods. Libr. Inf. Sci. Res. 2021, 43, 101109.
  7. World Health Organization. Blindness and Vision Impairment. Available online: https://www.who.int/news-room/fact-sheets/detail/blindness-and-visual-impairment (accessed on 1 April 2023).
  8. World Health Organization. Deafness and Hearing Loss. Available online: https://www.who.int/news-room/fact-sheets/detail/deafness-and-hearing-loss (accessed on 1 April 2023).
  9. Soltani, S.; Mahnam, A. A practical efficient human computer interface based on saccadic eye movements for people with disabilities. Comput. Biol. Med. 2016, 70, 163–173.
  10. Alonso, R.; Concas, E.; Reforgiato Recupero, D. An Abstraction Layer Exploiting Voice Assistant Technologies for Effective Human—Robot Interaction. Appl. Sci. 2021, 11, 9165.
  11. Wu, C.-M.; Chen, Y.-J.; Chen, S.-C.; Yeng, C.-H. Wireless Home Assistive System for Severely Disabled People. Appl. Sci. 2020, 10, 5226.
  12. Kekade, S.; Hseieh, C.-H.; Islam, M.M.; Atique, S.; Mohammed Khalfan, A.; Li, Y.-C.; Abdul, S.S. The usefulness and actual use of wearable devices among the elderly population. Comput. Methods Programs Biomed. 2018, 153, 137–159.
  13. United Nations. Inclusive Development for Persons with Disabilities: Report of the Secretary-General; United Nations: Midtown Manhattan, NY, USA, 2018.
  14. United Nations. Transforming our World: The 2030 Agenda for Sustainable Development; United Nations: Midtown Manhattan, NY, USA, 2015.
  15. Duplaga, M. Digital divide among people with disabilities: Analysis of data from a nationwide study for determinants of Internet use and activities performed online. PLoS ONE 2017, 12, e0179825.
  16. Marco, L.; Alonso, Á.; Quemada, J. An Identity Model for Providing Inclusive Services and Applications. Appl. Sci. 2019, 9, 3813.
  17. Braham, A.; Khemaja, M.; Buendía, F.; Gargouri, F. A Hybrid Recommender System for HCI Design Pattern Recommendations. Appl. Sci. 2021, 11, 10776.
  18. Bastien, J.M.C. Usability testing: A review of some methodological and technical aspects of the method. Int. J. Med. Inform. 2010, 79, e18–e23.
  19. Arrue, M.; Valencia, X.; Pérez, J.E.; Moreno, L.; Abascal, J. Inclusive Web Empirical Studies in Remote and In-Situ Settings: A User Evaluation of the RemoTest Platform. Int. J. Human Comput. Interact. 2019, 35, 568–583.
  20. ISO 9241-110:2020; Ergonomics of Human-System Interaction—Part 110: Interaction Principles. International Organization for Standardization: Geneva, Switzerland, 2023. Available online: https://www.iso.org/standard/75258.html (accessed on 1 April 2023).
  21. ISO/IEC 25066:2016; Systems and Software Engineering—Systems and Software Quality Requirements and Evaluation (SQuaRE)—Common Industry Format (CIF) for Usability—Evaluation Report. International Organization for Standardization: Geneva, Switzerland, 2023. Available online: https://www.iso.org/standard/63831.html (accessed on 1 April 2023).
  22. ISO 9241-210:2019; Ergonomics of Human-System Interaction—Part 210: Human-Centered Design for Interactive Systems. International Organization for Standardization: Geneva, Switzerland, 2023. Available online: https://www.iso.org/standard/77520.html (accessed on 1 April 2023).
  23. Nakić, J.; Kosović, I.N.; Franić, A. User-Centered Design as a Method for Engaging Users in the Development of Geovisualization: A Use Case of Temperature Visualization. Appl. Sci. 2022, 12, 8754.
  24. Zickler, C.; Halder, S.; Kleih, S.C.; Herbert, C.; Kübler, A. Brain Painting: Usability testing according to the user-centered design in end users with severe motor paralysis. Artif. Intell. Med. 2013, 59, 99–110.
  25. Cayola, L.; Macías, J.A. Systematic guidance on usability methods in user-centered software development. Inf. Softw. Technol. 2018, 97, 163–175.
  26. Nair, V.; Olmschenk, G.; Seiple, W.H.; Zhu, Z. ASSIST: Evaluating the usability and performance of an indoor navigation assistant for blind and visually impaired people. Assist. Technol. 2022, 34, 289–299.
  27. ISO 9241-11; Ergonomics of Human-System Interaction—Part 11: Usability: Definitions and Concepts. International Organization for Standardization: Geneva, Switzerland, 2023. Available online: https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-2:v1:en (accessed on 1 April 2023).
  28. Andreoni, G. Investigating and Measuring Usability in Wearable Systems: A Structured Methodology and Related Protocol. Appl. Sci. 2023, 13, 3595.
  29. Jaspers, M.W.M. A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence. Int. J. Med. Inform. 2009, 78, 340–353.
  30. Gonçalves, R.; Rocha, T.; Martins, J.; Branco, F.; Au-Yong-Oliveira, M. Evaluation of e-commerce websites accessibility and usability: An e-commerce platform analysis with the inclusion of blind users. Univers. Access Inf. Soc. 2018, 17, 567–583.
  31. ISO 9999:2022; Assistive Products—Classification and Terminology. International Organization for Standardization: Geneva, Switzerland, 2023. Available online: https://www.iso.org/obp/ui/#iso:std:iso:9999:ed-7:v1:en (accessed on 1 April 2023).
  32. Giudice, N.A.; Guenther, B.A.; Kaplan, T.M.; Anderson, S.M.; Knuesel, R.J.; Cioffi, J.F. Use of an Indoor Navigation System by Sighted and Blind Travelers. ACM Trans. Access. Comput. 2020, 13, 1–27.
  33. Šumak, B.; Špindler, M.; Debeljak, M.; Heričko, M.; Pušnik, M. An empirical evaluation of a hands-free computer interaction for users with motor disabilities. J. Biomed. Inform. 2019, 96, 103249.
More
© Text is available under the terms and conditions of the Creative Commons Attribution (CC BY) license; additional terms may apply. By using this site, you agree to the Terms and Conditions and Privacy Policy.
Upload a video for this entry
Information
Subjects: Computer Science, Information Systems
Contributors MDPI registered users' name will be linked to their SciProfiles pages. To register with us, please refer to https://encyclopedia.pub/register :
Boštjan Šumak
,
Katja Kous
,
Loïc Martínez-Normand
,
Jānis Pekša
,
Maja Pušnik
View Times: 267
Revisions: 2 times (View History)
Update Date: 06 Jul 2023
Table of Contents
    1000/1000
    Hot Most Recent
    Video Production Service
    Feedback