/
Deposits and savings SUS report

Deposits and savings SUS report

Due date

19 September 2024

Epic

https://teamapt.atlassian.net/browse/DS-34

Task

https://teamapt.atlassian.net/browse/DS-62

Designer

@Hamza Abdul

Useberry

View usability test results

Document summary

This document outlines a comprehensive plan/guide towards testing and conducting a System Usability Scale (SUS) for the current savings product which is essential to quantitatively assess its overall ease of use, identify specific usability issues, and gather user feedback to inform targeted improvements for a more intuitive user experience.

Objectives

As part of our ongoing efforts to improve the user experience and align our products with strategic goals, we have identified the System Usability Scale (SUS) score as a key performance indicator (KPI) for user satisfaction. Additionally, we will be tracking two other critical usability metrics: time on task and success rate. These metrics will provide a comprehensive view of how well our product supports primary user goals across web and mobile platforms.

The purpose of this usability test is to establish a usability benchmark for the product, which will serve as a foundation for future improvements.

Success metrics

  • SUS score

  • Time on task

  • Success rate

Test plan

Core user journeys

Personal savings

Persona

Core journey

Rationale

Persona

Core journey

Rationale

Kenneth Etuk
QA analyst

Create Flexible Savings.
Flexible savings let users save money with easy access to funds, offering flexible deposits, withdrawals, and goal management without penalties.

This is an important flow for user to be able to save, without this flow user cannot save or earn interest.

Inemesit udo
IT professional

Create Locked Savings.
Locked savings require deposits for a certain period, offering higher interest rates but limiting withdrawals until maturity, promoting long-term saving.

This is an important flow for user to be able to save, without this flow user cannot save or earn interest.

Anthony
Student

Create Fixed Savings.
Fixed savings offer a set interest rate on deposits for a fixed term, with no withdrawal until maturity, ensuring secure long-term savings.

This is an important flow for user to be able to save, without this flow user cannot save or earn interest.

Hussein
Graphic Designer

Top-up Savings.
Top-up into savings lets users add funds to their accounts anytime, boosting their savings goals and interest earnings.

This is an important flow for user to be able to boost their savings goals and interest earnings.

Vincent
Software Engineer

Withdraw from Savings.
Withdraw from savings allows users to access and transfer funds from their savings, offering financial flexibility.

This is an important flow for user to be able to transfer funds from their savings.

Taiwo
Student

Withdraw from Savings.
Withdraw from savings allows users to access and transfer funds from their savings, offering financial flexibility.

This is an important flow for user to be able to transfer funds from their savings.

Abubakar
Small business owner

Manage Savings.
Manage savings lets users track, adjust, and optimize their savings and goals for effective financial planning.

This is an important flow for user to be able to adjust, and optimize their savings and goals for effective financial planning.

Favour
Student

Cancel Savings.
Cancel savings lets users close their savings and access remaining funds, ending their savings commitment.

This is an important flow for user to be able to close their savings and access remaining funds.

Adesina
Office manager

Break Savings.
Break savings lets users withdraw from locked savings before maturity, often incurring a penalty.

This is an important flow for user to be able to withdraw from locked savings before maturity, often incurring a penalty.

Maryam
Small business owner

Rollover Savings.
Rollover savings lets users transfer funds from a maturing account to a new one, usually preserving interest rates.

This is an important flow for user to be able to transfer funds from a maturing account to a new one.

 

Business Savings

Persona

Core journey

Rationale

Persona

Core journey

Rationale

Hafsat
Small business

Create Flexible Savings.
Flexible savings let users save money with easy access to funds, offering flexible deposits, withdrawals, and goal management without penalties.

This is an important flow for user to be able to save, without this flow user cannot save or earn interest.

Michael
Work/small business

Create Locked Savings.
Locked savings require deposits for a certain period, offering higher interest rates but limiting withdrawals until maturity, promoting long-term saving.

This is an important flow for user to be able to save, without this flow user cannot save or earn interest.

Mfonido
Accountant

Create Fixed Savings.
Fixed savings offer a set interest rate on deposits for a fixed term, with no withdrawal until maturity, ensuring secure long-term savings.

This is an important flow for user to be able to save, without this flow user cannot save or earn interest.

Joseph
Small business

Top-up Savings.
Top-up into savings lets users add funds to their accounts anytime, boosting their savings goals and interest earnings.

This is an important flow for user to be able to boost their savings goals and interest earnings.

Daniel
IT support/small business

Withdraw from Savings.
Withdraw from savings allows users to access and transfer funds from their savings, offering financial flexibility.

This is an important flow for user to be able to transfer funds from their savings.

Bola xchange
Small business

Withdraw from Savings.
Withdraw from savings allows users to access and transfer funds from their savings, offering financial flexibility.

This is an important flow for user to be able to transfer funds from their savings.

Abubakar
Small business owner

Manage Savings.
Manage savings lets users track, adjust, and optimize their savings and goals for effective financial planning.

This is an important flow for user to be able to adjust, and optimize their savings and goals for effective financial planning.

Haminat
Small business

Cancel Savings.
Cancel savings lets users close their savings and access remaining funds, ending their savings commitment.

This is an important flow for user to be able to close their savings and access remaining funds.

Adesina
Office manager

Break Savings.
Break savings lets users withdraw from locked savings before maturity, often incurring a penalty.

This is an important flow for user to be able to withdraw from locked savings before maturity, often incurring a penalty.

Maryam
Small business owner

Rollover Savings.
Rollover savings lets users transfer funds from a maturing account to a new one, usually preserving interest rates.

This is an important flow for user to be able to transfer funds from a maturing account to a new one.

Adetunji Kabir
Small business

Create SAYT.
Rollover savings lets users transfer funds from a maturing account to a new one, usually preserving interest rates.

This is an important flow for user to be able to transfer funds from a maturing account to a new one.

AOL lukash innovation
Small business

Withdraw from SAYT.
Rollover savings lets users transfer funds from a maturing account to a new one, usually preserving interest rates.

This is an important flow for user to be able to transfer funds from a maturing account to a new one.

Labake Ayeni
Small business

Manage SAYT.
Rollover savings lets users transfer funds from a maturing account to a new one, usually preserving interest rates.

This is an important flow for user to be able to transfer funds from a maturing account to a new one.

Test environment

Interactive figma prototypes of the product was the product was tested on mobile and desktop devices in a remote and unmoderated setting. However testers had the liberty to ask questions when required.

Tasks

Core journey

Tasks

Core journey

Tasks

Create flexible savings

A user with interest of creating a flexible savings plan, has to navigate to savings sections, select a flexible savings, Enter details of savings, review terms and condition and then create plan.

Create locked savings

A user with interest of creating a locked savings plan, has to navigate to savings sections, select a locked savings, Enter details of savings, review terms and condition and then create plan.

Create fixed savings

A user with interest of creating a fixed savings plan, has to navigate to savings sections, select a fixed savings, Enter details of savings, review terms and condition and then create plan.

Topup savings

A user with interest of toping up a savings plan, has to navigate to savings sections, select savings plan, click on topup and enter amount, enter transaction pin and confirm.

Withdraw from savings

A user with interest of withdrawing from a savings plan, has to navigate to savings sections, select savings plan, click on withdraw and enter amount, enter transaction pin and confirm.

Manage savings

A user with interest of adjusting a savings plan, has to navigate to savings sections, select savings plan, click on manage and update plan and confirm.

Rollover savings

A user with interest of rolling over their savings has to navigate to the saving section, select savings plan, clicks on continue saving, selects partial or full rollover, updates target date and target amount and updates plan, then confirm.

Cancel flexible savings

A user with interest of cancelling a flexible savings plan, has to navigate to savings sections, select savings plan, click on the kebab menu, click on cancel flexible plan, enter transaction pin and confirm.

Break Savings

A user with interest of breaking a savings plan, has to navigate to savings sections, select savings plan, click on the kebab menu, click on break savings, select reason of breakage, enter transaction pin and confirm.

Create SAYT

A user with interest of creating a save as you transact savings plan, has to navigate to savings sections, select SAYT savings, Enter details of savings, review terms and condition and then create plan.

Withdraw from SAYT

A user with interest of withdrawing from SAYT plan, has to navigate to savings sections, select savings plan, click on withdraw, enter transaction pin and confirm.

Manage SAYT

A user with interest of adjusting a SAYT plan, has to navigate to savings sections, select savings plan, click on settings button, update plan and confirm.

Participants

Participant information

Number of participants

  • 5-8 participants per journey

Demographics

  • 18 - 34 years old

  • Based in Nigeria

  • Male and Females

  • Student, Employed and Unemployed

  • Has no experience with Moniepoint

  • Has no familiarity with the product

  • Has saved before on other platforms

Selection criteria

  • Banks elsewhere, not with Moniepoint

  • Lives anywhere in Nigeria 

  • Has low to high levels of education and tech skill

  • May have immediate need of financial support

  • May have saved before

  • Interested in saving

Participant profiles

Participant A

Kenneth

Age

39

Occupation

QA Ananlyst, Akwa Ibom

Tech savviness

Experienced

Fintech usage

Uses mobile banking apps (GTBank, Access Bank) for daily transactions.

Primary devices

Android phone

Key insights

Kenneth is a QA analyst, uses gtbank to save earnings on a monthly basis, saves foe emergencies, kids school fees and towards buying a landed property.

Participant B

Maryam

Age

25, Abuja

Occupation

Trader (Manages mums business)

Tech savviness

Low

Fintech usage

Uses apps like MTN, Zenith and Gtbank

Primary devices

Iphone

Key insights

Maryam keeps part of her earnings in Zenith bank and only uses when an urgency arises. She shows interest in savings with any company that offers good interest rate.

Participant C

Anthony

Age

28, Lagos

Occupation

Student/works for Uncle  

Tech savviness

High

Fintech usage

Primarily uses personal banking apps like Gtbank for saving, budgeting, and personal transfers. Also utilises fintech apps like Opay for peer-to-peer transfers and mobile payments.

Primary devices

iPhone 13

Key insights

Anthony uses inventory system in supermarket he works to efficiently track, manage, and control stock levels, ensuring that products are available for customers while minimizing overstock and reducing losses due to spoilage, theft, or mismanagements. User also saves part of salary with his uncle.

Participant D

Hussien

Age

29

Occupation

Graphic Designer, Lagos

Tech savviness

High

Fintech usage

Primarily uses personal banking apps like Gtbank saving, budgeting, and personal transfers.

Primary devices

Android phone

Key insights

He diligently saves 30-40% of his salary monthly, locking money away for long-term goals like house rent, internet, and airtime for the year, while also participating in a monthly and weekly "Ajo" contribution, where he prefers to be the last to receive funds, invests in his mother's business with no interest, leaves a portion of his salary for emergencies, and is interested in low-risk investments and the Nigerian stock market, as well as FX if the market stabilizes.

Participant E

Hafsat

Age

24, Abuja

Occupation

Student/Works

Tech savviness

Moderate

Fintech usage

Primarily uses personal banking apps like Zenith saving, budgeting, and personal transfers.

Primary devices

Android phone

Key insights

She participated in a year-long contribution with 12 fellow corpers to buy a phone, faced payment delays, doesn’t invest or save in FX, borrows from friends and repays fully, works a salaried job, saves part of her salary in Jaiz Bank (restricted for discipline), invests in gold, and her mother saves through AMANA for Salah; she’s interested in earning profit from savings.

Participant F

Michael

Age

38, Port-Harcourt

Occupation

Banker

Tech savviness

Moderate

Fintech usage

Primarily uses personal banking apps like Gtbank saving, budgeting, and personal transfers. and utilizes fintech apps like carbon for savings.

Primary devices

Android phone

Key insights

The user works a salaried job, saves monthly on the Carbon app toward a house and for emergencies, liquidates savings for urgent needs, has a joint savings account with his wife at FirstBank for emergencies, but faces issues with Carbon's lack of account statement downloads and joint account options with interest.

Recruitment process

For a savings product usability test, the recruitment process typically involved the following steps:

  • Defining User Profiles: We identified the target audience based on demographics such as age, income level, and familiarity with financial services, focusing on people who use or are likely to use savings products.

  • Criteria for Selection: Set specific inclusion criteria, such as experience with savings, digital literacy, and access to mobile or internet banking. Excluded participants who may have insider knowledge of savings product.

  • Sample Size: Recruited a balanced mix of users, typically 5–10 participants, ensuring diversity in age, tech-savviness, and geographic location within Nigeria.

Usability metrics and results

Success rate definition

SUS score

SUS is a standardised questionnaire used to measure the usability of a product, using a 10 questions 5-point scale to generate a score between 0 and 100, with higher indicating higher usability.

The average SUS score is typically 68. A score of 68 or higher is generally considered acceptable or better than average. Above 70 is good, and above 80 is excellent.

sus scale.png

 

Time on task

The time it takes participants to complete each journey. Shorter times generally indicate better usability. This metric helps to measure efficiency.

Personal savings

  • Create flexible savings: Users are expected to complete this journey within 3 minutes.

  • Create locked savings: Users are expected to complete this journey within 3 minutes.

  • Create fixed savings: Users are expected to complete this journey within 2 minutes.

  • Break savings plan: Users are expected to complete this journey within 2 minutes.

  • Cancel savings plan: Users are expected to complete this journey within 2 minutes.

  • Top up savings: Users are expected to complete this journey within 2 minutes.

  • Withdraw from savings: Users are expected to complete this journey within 2 minutes.

  • Manage savings: Users are expected to complete this journey within 2 minutes.

  • Rollover savings: Users are expected to complete this journey within 2 minutes.

Business savings

  • Create flexible savings: Users are expected to complete this journey within 3 minutes.

  • Create locked savings: Users are expected to complete this journey within 3 minutes.

  • Create fixed savings: Users are expected to complete this journey within 2 minutes.

  • Break savings plan: Users are expected to complete this journey within 2 minutes.

  • Cancel savings plan: Users are expected to complete this journey within 2 minutes.

  • Top up savings: Users are expected to complete this journey within 2 minutes.

  • Withdraw from savings: Users are expected to complete this journey within 2 minutes.

  • Manage savings: Users are expected to complete this journey within 2 minutes.

  • Rollover savings: Users are expected to complete this journey within 2 minutes.

  • Create SAYT plan: Users are expected to complete this journey within 2 minutes.

  • Pause SAYT plan: Users are expected to complete this journey within 1 minutes.

  • Change SAYT withdrawal frequency: Users are expected to complete this journey within 1 minutes.

  • Withdraw from SAYT savings: Users are expected to complete this journey within 2 minutes.

 

Success rate

Personal savings

  • Create flexible savings: this journey is considered successful when customer is able to create the savings plan within 3 minutes with a success rate of 68% and above.

  • Create locked savings: this journey is considered successful when customer is able to create the savings plan within 3 minutes with a success rate of 68% and above.

  • Create fixed savings: this journey is considered successful when customer is able to create the savings plan within 2 minutes with a success rate of 68% and above.

  • Break savings plan: this journey is considered successful when customer is able to break the savings plan within 2 minutes with a success rate of 68% and above.

  • Cancel savings plan: this journey is considered successful when customer is able to cancel the savings plan within 2 minutes with a success rate of 68% and above.

  • Top up savings: this journey is considered successful when customer is able to top-up the savings plan within 2 minutes with a success rate of 68% and above.

  • Withdraw from savings: this journey is considered successful customer is able to withdraw from the savings plan within 2 minutes with a success rate of 68% and above.

  • Manage savings: this journey is considered successful when customer is able to manage the savings plan within 2 minutes with a success rate of 68% and above.

  • Rollover savings: this journey is considered successful when customer is able to rollover the savings plan within 2 minutes with a success rate of 68% and above.

Business savings

  • Create flexible savings: this journey is considered successful when customer is able to create the savings plan within 3 minutes with a success rate of 68% and above.

  • Create locked savings: this journey is considered successful when customer is able to create the savings plan within 3 minutes with a success rate of 68% and above.

  • Create fixed savings: this journey is considered successful when customer is able to create the savings plan within 2 minutes with a success rate of 68% and above.

  • Break savings plan: this journey is considered successful when customer is able to break the savings plan within 2 minutes with a success rate of 68% and above.

  • Cancel savings plan: this journey is considered successful when customer is able to cancel the savings plan within 2 minutes with a success rate of 68% and above.

  • Top up savings: this journey is considered successful when customer is able to top-up the savings plan within 2 minutes with a success rate of 68% and above.

  • Withdraw from savings: this journey is considered successful customer is able to withdraw from the savings plan within 2 minutes with a success rate of 68% and above.

  • Manage savings: this journey is considered successful when customer is able to manage the savings plan within 2 minutes with a success rate of 68% and above.

  • Rollover savings: this journey is considered successful when customer is able to rollover the savings plan within 2 minutes with a success rate of 68% and above.

  • Create SAYT plan: this journey is considered successful when customer is able to create the savings plan within 2 minutes with a success rate of 68% and above.

  • Pause SAYT plan: this journey is considered successful when customer is able to rollover the savings plan within 1 minute with a success rate of 68% and above.

  • Change SAYT withdrawal frequency: this journey is considered successful when customer is able to change withdrawal frequency of the savings plan within 1 minutes with a success rate of 68% and above.

  • Withdraw from SAYT savings: this journey is considered successful when customer is able to withdraw from the savings plan within 2 minutes with a success rate of 68% and above.

 

Results

Personal savings

Core journey

SUS score

Time on task

Success rate

Comments

Core journey

SUS score

Time on task

Success rate

Comments

Rollover savings

72

2m 57.4s

83%

Journey seems easy to understand by users.

Create fixed savings

70.3

382m 56.5s

 

71%

Result was skewed by a user that spent too much time answering SUS questionnaire.

Create locked savings

71.3

3m 25.1s

60%

40% of participant dropped off during prototype test

Create flexible savings

69.7

37m 20.8s

60%

33% of participant dropped off during prototype test

Break savings plan

70.7

5m 15.2s

 

70%

The average time spent on the journey is a lot, a place to improve

Cancel savings plan

76.3

2m 45.3s

 

60%

 

The low success rate may be attributed lots of drop-off at different points during the test.

Top up savings

78.5

1m 29.3s

71%

flow was simple and straightforward based on feedback

Withdraw from savings

67.1

2m 39.8s

 

88%

 

High success rate, but SUS score suggests journey can be improved

Manage savings

75.5

2m 7.3s

 

83%

 

The high success rate and SUS score suggests journey was easy and straightforward for users to achieve their goals

 

Business savings

Core journey

SUS score

Time on task

Success rate

Comments

Core journey

SUS score

Time on task

Success rate

Comments

Rollover savings

70

1m 35.6s

 

75%

 

Flow looking straightforward and easy for users based on feedback

Create fixed savings

78

1m 51.4s

 

83%

Journey seems smooth, no negative feedback

Create locked savings

72.9

5m 18.1s

 

75%

 

Journey was smooth, but the time on task can be improved

Break savings plan

77.1

1m 39.7s

 

100%

 

Journey seems smooth, no negative feedback

Create flexible savings

75.8

102m 32.7s

 

71%

 

Some testers were stuck at some point during the test, leading to them spending too much time to eventually achieve the flow

Cancel savings plan

85.5

1m 26.9s

 

100%

 

Journey was easy for users, no negative feedback

Top up savings

78.1

2m 1.9s

 

100%

 

Journey was easy for users, no negative feedback

Withdraw from fixed savings

84.2

1m 30.6s

67%

Journey seems smooths, drop offs at the start and prototype sections highly skewed the results for the success rate

Withdraw from locked savings

78.8

1m 12.1s

86%

Flow looking straightforward and easy for users based on feedback

Withdraw from flexible savings

72.9

3m 59.3s

75%

Journey was easy for users, no negative feedback

Manage savings

77.5

1m 23.2s

100%

Journey was easy for users, no negative feedback

Create SAYT plan

76.4

2m 34.7s

78%

Journey was easy for users, no negative feedback

Pause SAYT plan

72.5

32m 46.3s

75%

A tester was stuck at the over section during the test, leading to them spending too much time to eventually complete the flow

Change SAYT withdrawal frequency

67.1

1m 56.0s

 

100%

 

The poor SUS score indicates the journey needs to be improved

Withdraw from SAYT savings

85.5

1m 28.2s

 

56%

 

The low success rate stems from high drop off rate after the instructions section of this test

 

 

Post-test qualitative questionnaire feedback

Participants provided additional insights through open-ended post-test questions:

Common pain points

Some participants complained about difficulty finding some buttons, especially when it come to breaking or canceling a savings plan.

Participants also mentioned that the “copy” used in some places were not clear enough.

Positive feedback

Some participants talked about how short the journeys are, they can create a savings plan very quickly, top up and withdraw from a plan quickly.

User suggestions

A suggestion that stands out was the use of better “copy” to convey messages clearer

Recommendations for improvement

Based on the test findings, the following recommendations are proposed to improve the product’s usability:

Design changes

  • Overall look and feel of the product needs to be improved to give the product better aesthetics which influences customer decision while using the product.

  • Declutter congested sections and components to help customers make decisions better and faster, which improve success rates.

Quick wins

  • Update the “copy” to covey information better..

Long-term recommendations

  • Consider a more comprehensive redesign of the create savings plan journey, especially focusing on reducing the number of steps needed to create a savings plan.

Conclusion

Summary

The usability test revealed that while the product performs adequately in most areas, there are specific pain points related to savings plan creation journey and copy used in overall in the product. By focusing on these areas, we can significantly improve the user experience.

Next Steps

The design team will implement the recommended changes and prepare for a follow-up usability test to measure improvements in SUS, time on task, and success rate.

 

 

Add label

Related content

Transfers SUS report
Transfers SUS report
More like this
Loans SUS report
Loans SUS report
More like this
Moniepoint channels SUS report
Moniepoint channels SUS report
More like this
Moniepoint POS SUS report
Moniepoint POS SUS report
More like this
Moniepoint Sales Network Tools SUS report
Moniepoint Sales Network Tools SUS report
Read with this
Deposits and savings SUS report v2
Deposits and savings SUS report v2
More like this