1) What would you do if you want to know animal information?
2) What would you do to find information about mammals?
3) Select a mammal out of these animals.
4) What would you do to learn more information about that particular animal?
5) View the zoo map.
6) View the current location from the zoo and select the location.
7) Suppose you are near the elephants and now you want to see information about that animal.
How would you do that from the zoo map.
8) Close the animal information page
9) Search for an animal
10) Search about elephants
11) How would you cancel what you were searching for?
12) Go to zoo events.
13) Select an event.
14) What would you do if you want to set a reminder for that event so you can get notifications?
15) Go to the zoo calendar.
16) Go to the gallery
17) Capture a picture from the phone camera to upload.
18) Upload the picture.
19) Select a picture from the photo gallery to upload
20) Cancel the loading image.
21) Go back and select a picture from the gallery.
22) Upload the image.
23) Go to news feed
24) View a news item
25) Go to the product catalog
26) Select a product and add to the cart.
27) Make the payment.
28) What would you do to purchase a ticket for the zoo
29) Select one ticket for an adult
30) Confirm and check out to make the payment.
Description about the non-technical user
Piumi is our non
technical user. She is 25 years old and she is doing a management degree. It's
been only a couple of weeks since she started using a smart phone so she doesn't
have much experience in using android mobile applications. She admitted that
'whatsapp' is the only android mobile application she has used so far. She has
never used the MGS application that we have been reviewing in the HCI module.
She took about 13 minutes to complete the tasks (less time than the technical
user) as she was not that keen on describing about what she was doing and the
issues she encountered. But she was able to identify several breakdowns in the
prototype.
Video (with the non-technical user)
Description about the technical user
Our technical user is Mario and he is 22 years old. He
is doing a software engineering degree and he is familiar with android
technology and applications. He has developed android mobile applications as
well. He mentioned that he has used the application that we review in the HCI
module. So the team decided to do the evaluation with him as he is an
experienced user.
User took 16 minutes to complete the tasks given by the
team, (taking more time than the non-technical user) since he did the tasks
while he was describing what he was doing and pointing out the issues he
encountered during the evaluation. He was able to find out several breakdowns
in the paper prototype.
Video (with the technical user)
Transcript I (summary)
(With the technical user)
1.
Interviewer: How can you
view the zoo map?
2.
Interviewee: There’s no
shortcut to view the zoo map or anything. So I’d click on the home and go to
the zoo map.
3.
Interviewer: Now you have to
view your current location in the zoo map.
4.
Interviewee: I’m not sure
how to do that. I’d click on either this or this.(user looks confused and he
points to two different places in the map)
5.
Interviewer: Now you have to
go to zoo events. How would you do that?
6.
Interviewee: I’m guessing it’s
in this one but it looks like a calendar so I’m not sure I’d click that and
see.
(User taps on the icon
that looks like a calendar)
7.
Interviewer: Now you have to
select the events you are interested in.
8.
Interviewee: Okay how I can I
do that? Should I just tap on the event?
9.
Interviewer: What would you
do if you want to set a reminder for an event so that you can get notifications?
10. Interviewee: I’ll just tap on this ‘set reminder’.
11. Interviewer: Now you have to go to the zoo calendar.
12. Interviewee: How do I go to the calendar? Should I check the main
menu? (User asks for help)
13. Interviewer: (Offers help saying) that’s not what we are
expecting, from this interface you can get to the calendar.
14. Interviewee: I’d click on this I’m guessing. There’s no
specification as to how to get to the calendar.
15. Interviewer: Okay let’s move on with the rest. This is the zoo
calendar.
(Team proceeds with the
rest of the tasks, ignoring the breakdown)
16. Interviewer: Now you have to upload the image you selected from
the gallery.
17. Interviewee: I have to click ‘Done’ or ‘Upload’? I’m not sure what
the difference is. I’m going to select upload.
18. Interviewer: Now you have to select a product and add it to the
cart.
19. Interviewee: Okay I’ll add elephant show to the cart.
20. Interviewer: Now you have to make the payment for it.
21. Interviewee: My total and
all are not shown, so I’m not sure but I’ll click secure check out to make the
payment but I didn’t get to select the number of tickets.
(Interviewee thought he
was referring to zoo tickets so she mentioned that buying zoo tickets would be
the next task, but later she realized he was referring to the tickets for the
elephant show.)
Transcript II (summary)
(With the non-technical user)
1.
Interviewer: Now you have to
view the zoo map.
2.
Interviewee: Is it here?
(There was a picture of
a map of a country in the animal information page to indicate the animals’
country. User thought she had to select that and the team offered help saying
that she has to go to the home page in order to get to the zoo map)
3.
Interviewer:
Your current location will be displayed in the zoo map. Now you have to
select your current location.
4.
Interviewee: I think my current location is shown
from this blue color thing.
(User looked confused
what to select and she eventually showed the blue color location pointer.
5.
Interviewer: Now you have to
go to the zoo gallery
6.
Interviewee: Is it this?
(shows a wrong icon so the team helps the user saying she has to go to the
homepage to do that)
7.
Interviewer: You have to go
to your phone gallery and upload an image.
8.
Interviewer: I don’t know I’m confused. Is it
this?
(Show the plus sign)
Breakdowns identified after the paper prototype
Breakdowns identified after the paper prototype
 |
| Image 1 |
 |
| Image 2 |
 |
| Image 3 |
 |
| Image 4 |
 |
| Image 5 |
Usability
Evaluation Feedback Analysis
#
|
Prototype Screen
|
Reference
|
User’s feedback/ critical incidence/ problem
|
Reason for negative feedback / breakdown
|
Scope
|
Severity
(High/ Medium/ Low) and
Justification for giving it that rating |
Way(s) to rectify and any Tradeoffs (i.e., why the fix
might not work)
|
1
|
22-23
|
User
confuses the map of the animal’s country’s map with the zoo map. (when
navigating from animal information to the zoo map)
|
The map
looks prominent in the animal information interface which can mislead the non
technical users.
|
This
specific screen.
|
Low
(because this problem occurs when navigating to the zoo map from this
interface only and it tends to mislead the user only if he’s not careful)
|
Can
make it look less prominent. If it looks small and not eye catching, user
will not be confused. The map can be enlarged when the user clicks on it.
Tradeoffs:
at a glance users won’t be able to see how the population of that particular
animal species has spreaded.
|
|
2
|
28-29
|
When
the user was asked to go to the phone gallery and upload a picture from that,
user didn’t know what to tap on.
|
From
the “+” icon, user doesn’t get the idea that it is to go to the phone gallery
to select a picture and upload.
|
This
specific screen.
|
Low
(Since that particular interface doesn’t have that many icons, user will be
able to guess that it’s the icon to go to the gallery.
|
Instead
of having it as an image button it can be designed using a text.
Tradeoffs:
the looks of the interface might degrade.
|
|
3
|
3-4
24-25
|
When
the users were asked to view the current location both the users didn’t go
what to select
|
There
are several pointed arrow like icons in the zoo map so the user cannot get
the exact idea what to tap on.
|
This
screen and the screen that appears when the user select a location.
|
High
(If the user cannot get the exact idea of his/her current location, the user
can get lost in the zoo as it sprawls over a huge land area.
|
Displaying
a message saying “you are here” with a red arrow head at the location.
Tradeoffs:
takes up space on the interface, covering other locations in the map.
|
|
4
|
21
|
When
the user was asked to add a product for the shopping cart, user wanted to
view the number of tickets he bought but the system failed to satisfy the
requirement.
|
The interface
has a button to add products to the shopping cart but it doesn’t know the
existing amount in the shopping cart.
|
This
specific screen
|
Medium
(though it doesn’t show the existing number of products in this screen, when
you go to the next screen to make the payment, you will be able to see that.)
|
Indicating
the number of products in the cart currently, in a corner of the specific
product.
Tradeoffs:
takes up space.
|
|
5
|
16-17
|
User
was confused whether to select “done” or “upload” after the image from the
gallery loaded.
|
Both
the words give out the same meaning. So the user might wonder what the
difference will be between the two separate buttons.
|
Specific
to this screen.
|
Low (
user will probably select either of it and anyway the image is loaded
already)
|
Eliminating
one button out of them.
Tradeoffs:
no tradeoffs
|
No comments:
Post a Comment