Web Usability Study
due in two weeks
(for our client's schedule, we are swapping the topics of weeks 8 and 9)
Conduct a usability analysis of WebTalentUSA at
http://www.WebTalentUSA.com.
Inform participants that they are to find all requested information as quickly
as possible.
- Conduct the usability study on four people, including a convenience sample
of yourself and three other convenient participants:
- Conduct the first session on yourself without first looking
through the website.
That is, the session that you run on yourself should be the very first
time that you look at the web site.
- Start each session by briefing the participant:
"I will be asking you to look at the website of a real organization.
The website was recently constructed by a web designer and our client
wants to be sure that it works in the way that they expect.
"I will be asking you to find six pieces of information on the
website.
While you are doing this, I will be taking notes regarding how you
found each piece of information, any troubles that you might have
encountered in finding that information, how long it took you to complete
each task.
"I am not recording any identifying information about you on these
notes.
They will be submitted to my professor with my project report as
evidence that I conducted this session, but they will be returned back
to me when my report is returned.
The professor is not keeping any data and is merely interested in
seeing evidence that I have conducted this usability study.
My conclusions will be presented in summary form to the client
organization, but information associated with you as an
individual will not be reported.
We should be done within about ten minutes.
"If you would want to quit at any time, just let me know and you
may take my written notes with you."
- DO NOT start each session with a web browser open to the home
page at the link above and do not start the session on any other
page.
Open only the browser (perhaps opened to a search engine, the school
website, or some other "neutral" website)
and ask the participant to find the client
organization's website as quickly as possible.
- At the end of each session, debrief the participant with regard to
confidentiality, anonymity, and how you will be reporting the data.
- In conducting the usability study, use the following as your topic guide
(to include issues above).
- Do not allow the participant to use any website or external search
functions except as a last resort - use of a search function is proof
that the website has a usability problem.
- Create a paper form to use in recording your observations of each
participant:
- Observe and record the steps (e.g., menu items used, pages accessed) that each
participant takes to complete each task.
- Record the participant's outcome or answer to each question.
- Record any affective comments that the participant makes.
- Record the approximate amount of time that was taken to complete
each task.
- Ask the participant to complete each of the following tasks as quickly
as possible:
- Find the website for an organization called WebTalentUSA.
- What kinds of scholarships does WebTalentUSA offer?
- Who can apply for a WebTalentUSA scholarship?
- How does one apply for a WebTalentUSA scholarship?
- What materials are sent with the scholarship application?
- Where does one send the application?
- How long has WebTalentUSA existed?
- What is the mission statement of WebTalentUSA?
- Repeat the Task C above.
- In addition to tracking the steps and the time to complete each
task, note that you must also report measures of likability in your
report (below).
This necessarily requires that you take likability measures during
the session.
- Your written report must contain the following elements:
- research objectives
- methodology
- findings:
- utility (does the site do what it is apparently supposed to do?)
- usability (can the user easily figure out how to use the site?)
- ease of learning (how easily can the user learn to move
around the site?)
- efficiency of use (e.g., how much time to complete tasks?)
- memorability (can the user repeat a task?)
- error frequency and severity (how often and how serious
are navigation errors?)
- likability (user satisfaction)
- conclusions
- recommendations
- In a separate folder, include the forms with your handwritten notes of your
observations of each study participant.
These notes would include comments on the menu items that were selected in
attempting to complete the task, the amount of time (in seconds) that the
participant required to get through various parts of the task, causes of these
times (download times, errors working through links, etc.), the types of
errors that a person made while trying to find information, the number of
attempts that were made before success or abandonment of the assigned task,
the ultimate outcome of each task,
comments made by the participant regarding usability, likability,
frustration, and etc.
Do NOT put the participant's name on your observation notes.
- This is an individual assignment that requires you to make your own
observations and to write your own report.
References with which you are expected to be familiar for Quiz 2:
http://www.useit.com/alertbox/980503.html
http://www.useit.com/alertbox/991212.html
http://www.useit.com/alertbox/20000319.html
http://www.useit.com/alertbox/20010121.html
|