A Framework for Evaluating the Usability of Mobile Learning Applications in Universities
DOI:
https://doi.org/10.46243/jst.2022.v7.i05.pp42-59Keywords:
Usability, Software Quality, Prototyping, Subjective test, mobile learning, mobilityAbstract
As the use of mobile devices overwhelmingly outpace that laptops and desktop computers today, high levels of usability of these mobile devices are a major supporting factor. The trend extends deeply into teaching and learning as mobile learning (a new form of electronic learning) takes shape, introducing an eminent aspect of mobility. Usability defines the aspects of quality in use of the software products; hence usability testing is a major concern in developing organizations for the success of product implementation and use. Most existing usability evaluation models were developed for desktop software development. Consequently, currently available models are not about mobile learning in particular, which also presents a gap that we attempted to fill. The researcher in this study developed a model that estimates usability as a function of aggregated usability influencing factors. The developed model combines important factors from other available models and encompasses most that support mobile learning to come up with a more comprehensive model. To evaluate the effectiveness of the developed model, a mobile learning prototype application was developed, tested and implemented alongside a task list for an objective study and survey questionnaire for a subjective study. The feedback from the experiment and survey was then used to assess and validate the prototype application in terms of high, average or low levels of usability using an advanced statistical tool. The results could be used as guidelines to developing organizations to produce more appropriate applications for mobile learning with high levels of usability.
References
Hussain and M. Kutar. Apps vs devices: Can the usability of mobile apps be decoupled from the device. IJCSI International Journal of Computer Science Issues, 2012
Abran, A., J. W. Moore, P. Bourque, and R. Dupuis, eds. 2004. Guide to the software engineering body of knowledge. Los Alamitos, Calif.: IEEE Computer Society Press
Alden, J. (2013). Accommodating Mobile Learning in College Programs. Journal of Asynchronous Learning Networks
Ali, A., Ouda, A., & Capretz, L.F. (2012) ―A conceptual framework for measuring the quality aspects of m-learning‖, Bulletin of the IEEE Technical Committee on Learning Technology
Allwood, C. & Wang, Z-M. (1990). Conceptions of computers among students in China and Sweden
J. Roschelle. Keynote paper: Unlocking the learning value of wireless mobile devices. Journal of Computer Assisted Learning. 19(3), 260—272, 2003
J. Attewell, C. Savill-Smith, R. Douch and G. Parker. Modernising education and training: Mobilising technology for learning. LSN, London, 2010. A. Kukulska-Hulme. Mobile usability in educational context: What have we learnt? International Review of Research in Open and Distance Learning. 8(2), 1—16, 2007
Beyond Human-Computer Interaction, 3rd ed. Wiley, West Sussex, UK, 2011
Boja, C. L Batagan, (2009) ―Analysis of M-Learning Applications Quality,‖ WSEAS TRANSACTIONS on COMPUTERS
Black, M., & Edgar, W. (2009) ―Exploring mobile devices as grid resources: Using an x86 virtual
Charette, R. 2005. Why software fails. IEEE Spectrum
Chou, Chientzu Candace, Lanise Block, and Renee Jesness. "A case study of mobile learning pilot project in K-12 schools." Journal of Educational Technology Development and Exchange, 2012
D. Parsons and H. Ryu, ―A framework for assessing the quality of mobile learning,‖ 11th International Conference for Process Improvement, Research and Education (INSPIRE), UK, Southampton Solent University, 2006
Davis, F. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. (1993). User acceptance of information technology: system characteristics, user perception and behavioral impacts
Davis, F. D. Perceived usefulness, perceived ease of use, and user acceptance of information technology (1989)
Day, D. (1996a). Cultural bases of interface acceptance
Dr. Christof Ebert (2007). Software Quality management
Galin, D. 2004. Software quality assurance—From theory to implementation. Upper Saddle River, N.J.: Pearson Education
Hanson, K., & Shelton, B. E. (2008). Design and Development of Virtual Reality: Analysis of Challenges Faced by Educators. Educational Technology & Society
Heo, J., Ham, D.-H., Park, S., Song, C., and Yoon, W. C. A framework for evaluating the usability of mobile phones based on multi-level, hierarchical model of usability factors
Hornbæk, K., and Lai-Chong Law, E. Meta-analysis of correlations among usability measures. In Proc. CHI’07, ACM (San Jose, USA, 2007)
Hsu, Y. C., Ching, Y. H., & Snelson, C. (2014). Research Priorities in Mobile Learning: An International Delphi Study. Canadian Journal of Learning and Technology
http://en.wikipedia.org/wiki/Mobile_apps, Retrieved 29 January 2012
Hussain, Azham, and Maria Kutar. "Usability metric Model for mobile phone application." PGNet, ISBN, 2009
Introduction into Usability, Jakob Nielsen's Alertbox Retrieve April 10 th, 2012. From the http://www.useit.com/alertbox/20030825.html
ISO 9241: Ergonomics Requirements for Office Work with Visual Display Terminals (VDTs) International Standards Organization, Geneva (1997)
ISO/IEC, 13407. Human-Centred Design Processes for Interactive Systems. 1999: ISO/IEC 13407: 1999(E)
ISO/IEC, ISO/ IEC 9126 in practice: what do we need to know? [Online] Available at: http://www.essi.upc.edu/~webgessi/publicacions/SMEF%2704-ISOQualityModels.pdf
J. J. Liu. Mob ile map: A case study in the design & implementation of a mobile application. PhD thesis, Carleton University, 2002
J. Traxler and J. Leach, ―Innovative and sustainable mobile learning in Africa‖ 4th IEEE International Workshop on Wireless, Mobile and Ubiquitous Technology in Education, Los Alamitos, USA, 2006. Page | 57
John Traxler. ―Defining the Mobile Learning ―. IADIS International Conference Mobile Learning 2005
Jun, G. and Tarasewich, P. 2004. Guidelines for handheld mobile device interface design
Jung, H. -J. (2014). Ubiquitous Learning: Determinants Impacting Learners’ Satisfaction and Performance with Smartphones. Language Learning & Technology
Karagiorgi, Y., & Symeou, L. (2005). Translating Constructivism into Instructional Design: Potential and Limitations. Educational Technology & Society
M. Wang, R. Shen, R. Tong, F. Yang, and P. Han, ―Mobile learning with cellphones and pocket-PCs,‖ Springer-Verlag Berlin Heidelberg, New York, 2005
Machine to run boinc on an iPhone‖, In 10th IEEE/ACM International Conference on Grid Computing, Washington, DC, USA
Mandeep Singh, Kanwalvir Singh Dhindsa, Securing RJSON data between Middleware and Smart phones through Java Script based Cryptographic Algorithms 2013
Massy, J., Quality of eLearning Must Improve, BizMedia Ltd, 2002
Masters, K. (2004). Low-key m-learning: a realistic introduction of m-learning to developing countries
Moura, A., Carvalho, A. A., (2010). Mobile phone appropriation and pedagogical mediation by students in educational contexts
Nassuora, A. B., (2013). Students Acceptance of Mobile Learning for Higher Education in Saudi Arabia, International Journal of Learning Management Systems, Natural Sciences Publishing Cor
Nielsen, J. (1994). Usability engineering. Morgan Kaufmann Pub
Nielsen, J. Usability Engineering. Morgan Kaufman Publisher, Academic Press, 1993
Niklas, S., and Strohmeier, S. Exploring the impact of usefulness and enjoyment on mobile service acceptance: A comparative study. Proc. HICSS (Jan. 4-7 2011), 1–10
Phillip B. Crosby (1979). Quality is free
Phillip B. Crosby (1999). Quality is still free: Making Quality Certain in Uncertain Times
R. Harrison, D. Flood, and D. Duce. Usability of mobile applications: literature review and rationale for a new usability model. Journal of Interaction Science, 2013
Robin Deegan. ―A Classification of M-Learning Applications from a Usability Perspective‖. Journal of the Research Center for Educational Technology (RCET) 16 Vol. 6, No. 1, Spring 2010
Rogers, Y., Sharp, H., and Preece, J. Interaction Design
Roschelle, J., "Unlocking the learning value of wireless mobile devices", Journal of Computer Assisted Learning, 2003
S. Wang and S. Dey, ―Adaptive mobile cloud computing to enable rich mobile multimedia applications,‖ IEEE Transactions on Multimedia, 2013
Sabina Baraković & Lea Skorin-KapovSurvey of research on Quality of Experience modelling for web browsing
Seffah, Ahmed, Mohammad Donyaee, Rex B. Kline, and Harkirat K. Padda. "Usability measurement and metrics: A consolidated model." Software Quality Journal, 2006
Shrestha, S., Moore, J., Abdelnour-Nocera, J. "Low-cost hardware for ICT4D: what's right and what's left?". IIEEE Multidisciplinary Engineering Education Magazine, Vol 6, No 1 (2011)
Stockwell, G. (2010). Using mobile phones for vocabulary act ivities: Examining the effect of the platform. Language Learning & Technology
Tapanee Treeratanapon. ―Design of the Usability Measurement Framework for Mobile Applications.‖ International Conference on Computer and Information Technology (ICCIT'2012) June 16-17, 2012, Bangkok
Vavoula, G., & Sharples, M. (2009). Meeting the challenges in evaluating mobile learning: A 3-level evaluation framework. International Journal of Mobile and Blended Learning
www.perfectomobile.com/WhyMobileAppsFail: Perfecto Mobile 2014 Benchmark Survey, Why Mobile Apps Fail, 2014
Zhang, D, & Adipat, B. (2005). Challenges, methodologies, and issues in the usability testing of mobile applications. International Journal of Human-Computer Interaction
Zhang, D. and Adipat, B. "Challeng es, Methodologies, and Issues in the Usability Testing of Mobile Applications". International Journal of Human-Computer Interaction, 18, 3, 293-308, 2005
Zhang, D., & Adipat, B. (2005) ―Challenges, methodologies, and issues in the usability testing of m obile applications‖, International Journal of Human-Computer Interaction, Page | 58
