An evaluation framework and selection tool for education apps usability, with a case study from health education apps

Aljaber, Tareq

Abstract

Mobile apps for health education are commonly utilised to support different users. The development of these apps is increasing rapidly. A critical evaluation framework is needed to ensure the usability and reliability of Mobile Health Education Applications (MHEAs) to save time and effort for stakeholders. This project aims to assist the evaluation of MHEAs through development of an evaluation framework, which includes suitable metrics, an efficient hybrid utilizing Heuristic Evaluation (HE) and Usability Evaluation (UE). This framework determines the usefulness and usability of MHEAs, in order to improve the software engineering to create more effective ways to evaluate such software. In this framework, the Medical Apps Selection Tool (MAST) has been developed in which performance helps to select suitable MHEAs, assisting stakeholders to choose MHEAs that meet their requirements.

The thesis employs two methods to make the evaluation framework capable of performing qualitative and quantitative data analysis. The first is a qualitative method, involving interviews based on proposed selected hybrid metrics from HE and UE, with three kinds of stakeholders: Patients, Health Professionals and Software Developers, to identify specific relevant selected hybrid metrics to measure usability in MHEAs. These metrics are deployed to measure usability in different MHEAs based on ranking these apps within the evaluation framework. These metrics were converted into an evaluation questionnaire, which has been applied to several MHEAs. The second method is the translation of the outcomes form the first method to measure the usability of MHEAs and determine what stakeholders require from using MHEAs. For this purpose, it categorises stakeholders with different needs from MHEAs; this reflected in the MAST, based on matching different stakeholders with different MHEAs.

The findings of the study indicate that the evaluation framework is able to evaluate MHEAs and record usability problems. Furthermore, this evaluation framework leads to selection of the most appropriate apps by developing the MAST for stakeholders. The framework is expected to be applicable to other domains and platforms.

Citation

Aljaber, T. An evaluation framework and selection tool for education apps usability, with a case study from health education apps. (Thesis). University of Hull. https://hull-repository.worktribe.com/output/4223074

• Thesis Type: Thesis
• Deposit Date: Apr 8, 2021
• Publicly Available Date: Feb 23, 2023
• Keywords: Computer science
• Public URL: https://hull-repository.worktribe.com/output/4223074
• Additional Information: School of Engineering and Computer Science, The University of Hull
• Award Date: May 1, 2019