User testing is regarded by many to be the Gold Standard of usability evaluation methods. Indeed the appeal of user tests is undeniable; the ability to show clients usability problems through an analysis of “real user” behaviour has palpable persuasive power, even with the most resistant developer. However, user testing is much more than simply allowing users free access to a computer system, the whole process must be carefully designed if the results of the test are to be reliable and valid.
In the workshops on user testing we will focus on the key factors involved in the planning of user tests, the process of conducting a user test, selecting usability measures, and the analysis and reporting of test data. User testing is inexorably linked to the context of use, that is to say, the environment in which the system is going to be used. The context of use is also related to the activity of determining what a usability problem actually is with regard to the system under study. As well as a summary of the key contextual issues, the following aspects will be covered in detail.
- Defining the goals/concerns that inform the design of a user test
- Deciding on who and how many people to test
- Methods for recruiting participants
- The development of appropriate task sets and scenarios
- Preparation of test materials
- Prepare of test environment and test team
- The importance of pilot testing
- Usability Problem Identification
- Analysis and reporting
- Testing in the field
Upon successful completion of this module, students will have demonstrated:
- Plan, prepare and carry out user testing in a variety of environments (laboratory based, remote on-site)
- Determine usability metrics, analyse data from tests for constructive report for usability issues
The user requirements workshop is led by Dr Sharon McDonald. Sharon ’s leading research includes navigation of the WWW and evaluation methods.