Web Usability Study
due in two weeks

Conduct a usability analysis of the Logistical Services web site at the University of Medicine & Dentistry of New Jersey at http://www.umdnj.edu/transweb/.

  1. Conduct the usability study on four people, a convenience sample of yourself and three others:

    • Conduct the study on yourself without first looking through the site.  That is, the session that you run on yourself should be the very first time that you look at the web site.

    • Start each session with a web browser open to the splash page at the link above (do not start the session on any other page). 

    • Start each session by briefing the participant with regard to what you will be asking him/her to do and how long the test will take.

    • At the end of each session, debrief the participant with regard to confidentiality, anonymity, and how you will be reporting the data.

  2. In conducting the usability study, use the following as your topic guide (to include issues above). 

    • Do not allow the participant to use the website search function except as a last resort - use of the search function is proof that the website has failed the usability test.  Observe and record the steps (e.g., menu items used) that the participant takes to complete each task and record the approximate amount of time that was taken to complete each task.

    • Create a paper form to use in recording your observations when you ask each participant (subject) to answer the following questions:

      1. What is the class schedule for driver safety training?  Print it.

      2. Where is the on-campus gas station for fleet vehicles?  Print the page showing this address.

      3. Transportation Services can pick up and drop off patients of some affiliated clinics.  How would you arrange for this service?  Print the page that supports this answer.

      4. How often are fleet vehicles inspected?  Print the page that shows this inspection interval.

      5. Repeat the Task B above.

      6. In addition to the above tasks, note that you must also report measures of likability in your report (below).  This necessarily requires that you take such measures during the session.

  3. Your written report must contain the following elements:

    1. research objectives
    2. methodology
    3. findings:
      1. utility (does the site do what it is apparently supposed to do?)
      2. usability (can the user easily figure out how to use the site?)
        1. ease of learning (how easily can the user learn to move around the site?)
        2. efficiency of use (e.g., how much time to complete tasks?)
        3. memorability (can the user repeat a task?)
        4. error frequency and severity (how often and how serious are navigation errors?)
      3. likability (user satisfaction)
    4. conclusions
    5. recommendations

  4. In a separate folder, include the forms with your handwritten notes of your observations of each study participant stapled to the pages that each participant printed.  These notes would include comments on the menu items that were selected in attemtping to complete the task, the amount of time (in seconds) that the participant required to get through various parts of the task, causes of these times (download times, errors working through links, etc.), the types of errors that a person made while trying to find information, the number of attempts that were made before success or abandonment of the assigned task, comments made by the participant regarding usability, likability, frustration, and etc.  Do NOT put the participant's name on your observation notes.

  5. This is an individual assignment that requires you to make your own observations and to write your own report.


References with which you are expected to be familiar for Quiz 2:

http://www.useit.com/alertbox/980503.html
http://www.useit.com/alertbox/991212.html
http://www.useit.com/alertbox/20000319.html
http://www.useit.com/alertbox/20010121.html