Usability Test Results Summary
Objective Results
|
% Completing Task |
% Usability Errors |
% Accessibility Errors |
Mean Time on Task |
| Scenario 1: Preferences |
81% |
44% |
25% |
5:35 |
| Scenario 2: Medical Equipment |
88% |
19% |
19% |
4:09 |
| Scenario 3: Medications |
75% |
25% |
19% |
5:08 |
| Scenario 4: Care Plan |
94% |
19% |
6% |
6:04 |
| Scenario 5: Lab Result Communication |
88% |
31% |
13% |
4:57 |
Post-Scenario Subjective Ratings
|
% Rated Scenario Important to Care |
% Rated Usable |
% Rated Accessible |
% Rated Useful Functions |
% Rated Useful in Managing Care |
% Rated Needs No Improv. |
Overall Satis. |
| Additional Data: See the scenario details for individual scenario ratings. |
| Scenario 1: Preferences |
N/A |
88% |
94% |
88% |
N/A |
44% |
75% |
| Scenario 2: Medical Equipment |
94% |
88% |
88% |
88% |
88% |
56% |
94% |
| Scenario 3: Medications |
100% |
94% |
94% |
94% |
100% |
69% |
94% |
| Scenario 4: Care Plan |
88% |
94% |
94% |
94% |
94% |
81% |
94% |
| Scenario 5: Lab Result Communication |
100% |
88% |
94% |
94% |
100% |
88% |
94% |
Post-Test Questionnaire
Likert Scale Data
|
Strongly disagree |
Disagree |
Some. disagree |
Neutral |
Some. agree |
Agree |
Strongly Agree |
% Agree |
| The system presented tasks important to my healthcare |
|
|
|
|
2 |
4 |
10 |
100% |
| The system was easy to use |
|
|
1 |
1 |
1 |
1 |
6 |
88% |
| The system was accessible |
|
1 |
1 |
|
1 |
5 |
8 |
88% |
| The system provided useful features and information |
|
|
|
1 |
|
5 |
10 |
94% |
| The system requires no changes or improvements |
1 |
2 |
1 |
2 |
5 |
5 |
|
63% |
| The system would be useful to me in managing my own health care |
|
|
|
|
|
7 |
9 |
100% |
| Overall I am satisfied with the system |
1 |
|
|
|
|
8 |
7 |
94% |
Open-Ended Questions / Prompts
What did you like LEAST about the system?
- Too verbose with screen reader.
- Initial font size too small.
- Nothing really.
- Nothing I like least.
- Nothing.
- Nothing.
- Could communicate better to people of all levels.
- Nothing, except I wish it was mine.
- Nothing.
- Form accessibility with screen reader.
- Tables in meds were not accessible.
- Was lacking visual information.
- Not accessible to deaf with low literacy skills.
- Need to clean up the ARIA and be more consistent with ‘region’, ‘banner’ and ‘article’.
- Nothing.
- Nothing.
What did you like MOST about the system?
- Information was well structured.
- Overall accessibility and multi media in care plan.
- Access information any time and in one place.
- Ease of use.
- Equipment, medications and lab results.
- Communication with my doctor.
- No favorite.
- That I can add videos and links to my care plan.
- Nothing.
- How I can share information with others.
- Overall concept and comprehensive nature of the system.
- Care plan was useful.
- Potential to cover patients needs and access to information on health.
- Everything centralized and all in one place.
- Everything in one place.
- That is clear and that it could link to ASL information.
What, if anything, was MISSING from the system?
- Skip visual preferences.
- That it is not real.
- DNR, next of kin and other contact info.
- Supplies with equipment.
- Insurance information for supplies and vendors plus lab results over time.
- Nothing.
- Not sure.
- Nothing.
- Nothing.
- Nothing.
- Not sure.
- ASL content.
- ASL access, warning of side effects, alerts for medications that are not being taken.
- Nothing.
- Nothing.
- Nothing.
If you could have this system do anything you wanted, what would that be (wild ideas welcome):
- A screen reader accessible calendar.
- Gender based health information.
- History of all my lab results so I can track it over time.
- Manage all my medical image files such as MRI, x-ray. Let me Skype with my doctor.
- Link to the newest research on my conditions.
- Not sure.
- Make it like I am talking to a person.
- Communicate with my doctor in real time.
- Not sure, this is all new to me.
- Help me with insurance information and paperwork.
- Link to medical apps on my iPhone.
- If it could provide signed information, like videos of ASL.
- Clarify the patient is deaf and have access to ASL that covers everything. Also, a medical record that would do the thinking for you and keep track of the patient. Medication alerts if controlled substances were being abused.
- Give me all the information I need about medications.
- Set me up on a healthy and affordable diet.
- Notify me when there is anything new that can help me with my health.
Additional comments:
- You did too much for screen reader accessibility.
- I'm all for more information.
- I thought it was great.
- I haven't needed something like this, but it seems very useful and handy.
- It is easy to use, it just needs to be fixed up in the screen reader accessibility department.
- Maybe this will help you understand how bad it is for me. There are accessibility problems with this, but it is by far the most accessible health application I have ever tried.
- Needs connection to ASL resources.
- There are screen reader accessibility problems that need to be fixed, but nothing Earth shattering.
- Ten years ago I was living at home and this could have really helped me.
Previous Section: Participants