...
Usability metrics and results
Success rate definition
| Note |
|---|
Delete this info panel, this is only for guidance. Success criteria:
Measurement:
|
SUS score
SUS is a standardised questionnaire used to measure the usability of a product, using a 10 questions 5-point scale to generate a score between 0 and 100, with higher indicating higher usability.
The average SUS score is typically 68. A score of 68 or higher is generally considered acceptable or better than average. Above 70 is good, and above 80 is excellent.
...
Time on task
The time it takes participants to complete each journey. Shorter times generally indicate better usability. This metric helps to measure efficiency.
Personal savings
...
SUS score
SUS is a standardised questionnaire used to measure the usability of a product, using a 10 questions 5-point scale to generate a score between 0 and 100, with higher indicating higher usability.
The average SUS score is typically 68. A score of 68 or higher is generally considered acceptable or better than average. Above 70 is good, and above 80 is excellent.
...
Time on task
The time it takes participants to complete each journey. Shorter times generally indicate better usability. This metric helps to measure efficiency.
Personal savings
Create flexible savings: Users are expected to complete this journey within 3 minutes.
Create locked savings: Users are expected to complete this journey within 3 minutes.
Create fixed savings: Users are expected to complete this journey within 2 minutes.
Break savings plan: Users are expected to complete this journey within 2 minutes.
Cancel savings plan: Users are expected to complete this journey within 3 2 minutes.Create locked
Top up savings: Users are expected to complete this journey within 3 2 minutes.
Create fixed savings: Users are expected to complete this journey within 2 minutes.
Break savings plan: Users are expected to complete this journey within 2 minutes.
Cancel savings plan: Users are expected to complete this journey within 2 minutes.
Top up savings: Users are expected to complete this journey within 2 minutes.
Withdraw Withdraw from savings: Users are expected to complete this journey within 2 minutes.
Manage savings: Users are expected to complete this journey within 2 minutes.
Rollover savings: Users are expected to complete this journey within 2 minutes.
...
Post-test qualitative questionnaire feedback
...
Delete this info panel, this is only for guidance.
Post-test questionnaire:
After completing the tasks, participants will be asked additional targeted questions to gather specific feedback on their experience. These questions will be presented BEFORE the SUS questionnaire, for example:
Was there anything confusing or frustrating about the sign-up process?
How easy or difficult did you find the sign-up process?
Did you encounter any difficulties in reading or understanding the text or labels during the tasks?
Were there any features or elements that stood out as particularly helpful or problematic?
Did you experience any challenges with the colour scheme or visual elements?
Do you have any additional comments or suggestions for improving this experience?
...
Participants provided additional insights through open-ended post-test questions:
Common pain points | List any recurring issues, frustrations, or confusion that participants mentioned. |
|---|---|
Positive feedback | Summarise any positive comments about the product or specific features. |
User suggestions | Insert suggestions for improvement or areas where users struggled but offered solutions.Some participants complained about difficulty finding some buttons, especially when it come to breaking or canceling a savings plan. Participants also mentioned that the “copy” used in some places were not clear enough. |
Positive feedback | Some participants talked about how short the journeys are, they can create a savings plan very quickly, top up and withdraw from a plan quickly. |
User suggestions | A suggestion that stands out was the use of better “copy” to convey messages clearer |
Recommendations for improvement
Based on the test findings, the following recommendations are proposed to improve the product’s usability:
Design changes
...
[Task/feature]: revise [UI component, workflow, etc.] to streamline the user journey and reduce time on task.
...
proposed to improve the product’s usability:
Design changes
Overall look and feel of the product needs to be improved to give the product better aesthetics which influences customer decision while using the product.
Declutter congested sections and components to help customers make decisions better and faster, which improve success rates.
Quick wins
Minor adjustments to [insert feature or task] that can be implemented without major development effortUpdate the “copy” to covey information better..
Long-term recommendations
Consider a more comprehensive redesign of [specific user journey]the create savings plan journey, especially focusing on [insert issue]reducing the number of steps needed to create a savings plan.
Conclusion
Summary
The usability test revealed that while the product performs adequately in most areas, there are specific pain points related to [specific feature]savings plan creation journey and copy used in overall in the product. By focusing on these areas, we can significantly improve the user experience.
...