Usability Test: Instruction For Using The Cyberware M15 Laser
Scanner
Scott Goode
scott_goode@hotmail.com
September 30, 2000
What Is The Cyberware
M15 Laser Scanner
Pictures Of BSU's
Cyberware M15 Laser Scanner
Examples Of
M15 Laser Scanned Objects
Manual Tested: Instruction
For Using The Cyberware M15 Laser Scanner
Contents
Introduction
Usability tests were conducted with two people of different backgrounds.
The subjects were chosen because they fit two or more of the following
criteria:
-
Experience with laser scanning: little or none
-
Computer skills: 5+ on a scale of 1-10
-
Possessed interest in laser scanning
-
Ball State student
Subject #1 Male, BSU student, Graphic Arts Management major, has used flatbed
scanners but not a 3D laser scanner
Subject #2 Female, BSU student, Psychology Graduate Program, never has
used a laser scanner, not much experience with flatbed scanners
Testing Objectives
The test was developed for users who have never used a 3D laser scanner
before. The testing objectives were:
-
Determine which directions are unclear and vague.
-
Determine what changes/additions can be made to make this manual easier
to use for the first time user.
Context
The usability test was administered to Subject #1 on September 28, 2000.
The test lasted 80 minutes and took place in the computer room of the Production,
Materials and Construction Lab in the Industry and Technology building
on Ball State's Campus.
Subject #2 took the test on September 27, 2000. The test lasted 90 minutes
and took place in the computer room of the Production, Materials and Construction
Lab in the Industry and Technology building on Ball State's Campus.
Testing Procedure
The subjects were greeted with a smile and were asked if they were ready
to take the test. The participants were given a copy of the manual and
asked to take a seat at the testing station. The following script was then
read to the each participant:
Hello and thank you for taking this usability test
of the Instruction For Using The Cyberware M15 3D Laser Scanner. The 3D
laser scanner emits a low power laser and captures surface geometry of
3D objects. We are not able to scan all objects due to the limitations
of the laser. Keep in mind; this instruction manual was initially designed
for students who are given an in-class demonstration of the 3D laser scanning
process. This test will examine the effectiveness of the manual for first
time users and you will offer suggestion how the manual can be rewritten.
Remember
that you are not being tested, the manual is. This manual does has a few
dead ends. I will point out the dead ends and provide help when they arrive.
You are encouraged to think out loud. If something is difficult to understand,
say it. This will help me to understand where improvements should be made.
Also, note that the software is not too user friendly. Remember, the manual
is being tested and not the software package.
Important: The M15 3D Laser Scanner is a very expensive piece
of technology. Before you begin, remove the protective brown cover by the
handle. There are several mirrors inside the scanner. DO NOT TOUCH THEM.
They can be scratched with a fingernail. If this happens, they will need
to be replaced. In reality, we do not have the money to replace the mirrors
and our new technology will become unusable.
Next, I showed the participants examples of scanned objects and what
can be generated with the results of the scanning process.
After the examples, I asked a the following questions:
-
On a scale of 1-10, 10 being the best and 0 the worst, how do you
rate your computer skills?
-
Have you ever used a piece of equipment like this before?
-
If so, how much experience do you have?
-
What is your major?
The subjects then worked their way through the manual.
Observations, comments and problem areas were recorded in my notes as
the subjects completed the steps in the user manual. After the subjects
finished the test a debriefing session took place. Each subject was asked
the following questions:
-
Where are the directions hard to read?
-
Were the questions worded correctly and free of jargon?
-
How did you feel about using this technology?
-
Would you use the manual again?
Findings and Changes
-
Both participants had trouble finding the power switch on the laser scanner.
Add an illustration to show where the switch is or clarify the instruction
to tell where the switch is.
-
Subject #1 didn't know where Cydir was located? "On the desktop?" he asked.
Add a note in this step.
-
Both participants had trouble in the Dir window. Since they were not in
any of the classes, they both didn't know which directory to open. Subject
#2 commented that there should be clearer instructions on how to create
a new directory.
-
Select/create seem to be in the wrong order subject #1 acknowledged.
-
Participant #2 missed pushing the enter key in step 13. Add a picture.
-
Participant #2 asked, "When do I take the cover off the laser?" step 15
-
Both participants had a problem measuring the object they were attempting
to scan. Both commented that a picture would help and a note about what
instrument to measure with.
-
Subject #2 asked how many scans are needed. Clarify step 17. Both used
16 scans because it was the default.
-
Both subjects didn't know what to void. They asked and I told them. Both
said that there should be a statement covering what to void.
-
Step 22. Closed area trick. Both asked what it was. Explain and clarify
with a picture.
-
Subject #1 wanted to skip steps 24-25.
-
Subject #1 didn't know how to close any of the windows. He figured it out
after trying a few things. Clarify how to close these windows.
-
Subject #2 clicked off the void window and lost the red dot. She was lost
then asked for help. A note in step 21 would have helped. She said, "I
think a help section in the directions would be useful."
-
Step 26 offered problems to both users. How to reposition the the part?
Do I use clay? A picture would clarify these problems.
-
Step 26 (actually step 13, because of the second scan set) also added another
problem for both users. Both were not sure what to name the second scan
set. The directions call for replacing the ??? with a 1. Change the directions
to accommodate the second and third scan sets.
-
Subjects #1 and #2 had questions of saving their work. A note that tells
students that the software auto saves their work.
-
Subject #2 had a problem with step 35. A picture showing how to close the
various windows would help.
-
User #2 suggested that directional arrows could help explain the controls
for viewing the mesh.
-
User #1 suggested rewording step 37 and step 40. "Do I type H then F or
HF?"
-
Both users questioned what a hole was in step 42. Explain what
holes and voids are.
-
Step 44 offered problems for both users. "What do I convert a file to?"
List what type of document they should save as.
-
Subject #1 asked, "What is decimate?" in step 47. Explain in the directions
that this means shrinking the file size.
Debriefing
After the test, a Post-Test
Debriefing session took place
Question 1
Question 2
-
pictures would help show where things are located on the screen
-
weird names and I had trouble closing the windows
Question 3
-
a chart with all the editing commands
-
pictures would help
Question 4
-
scanning itself
-
it was pretty easy to follow / read
Question 5
-
step 1, step 7, step 8, step 13, step 17, step 18, step 22, step
27, step 36
-
step 1, step 4, step 8, step 20, step 27, step 44
Question 6
-
not really
-
some were confusing like step 5 and 41
Question 7
-
some of the terms like void and pitch confused me, explain them
-
yes
Question 8
-
it was great
-
kind of intimidating at first, but it diminished as the time went by
Question 9
Usability Testing:
Findings and Recommendations
-
Add illustrations to the instructions. Most, if not all, of the steps would
be more understandable with pictures showing the monitor and what to do.
-
Add instructions for how to create a new directory in step 8.
-
Explain how to measure the objects being scanned. "Using a metric ruler,
..."
-
Define terms pitch, void and hole.
-
Explain how the number of scans relates to detail in step 18. More scans
equal greater detail.
-
Include and an illustration showing what to void in step 22. An explanation
would also help.
-
The closed area trick should also be explained in step 22.
-
Show how to position and reposition the piece being scanned. Use an illustration
in step 26.
-
Accommodate the instructions in step 13 for the second and third scan sets.
Replace ??? with "2" if this is the second scan set.
-
Add a chart that visually shows how to view the mesh (step 36). Include
arrows and a mouse.
-
Add a chart in step 37 that includes the editing commands.
-
An explanation of what type of file to save work as would be useful (step
44). A list of the file types and their purposes would help.
-
A note explaining that the program Cydir automatically saves work would
also help users.