/
Moniepoint channels SUS report

Moniepoint channels SUS report

Due date

19 September 2024

Epic

https://teamapt.atlassian.net/browse/DS-34

Task

https://teamapt.atlassian.net/browse/DS-60

Designer

@Anjolaoluwa Adetimehin

Useberry

Insert links

Document summary

This document outlines efforts and results made to verify the usability of core journeys on the Dashboard for Moniepoint Channels.

Objectives

As part of our ongoing efforts to improve the user experience and align our products with strategic goals, we have identified the System Usability Scale (SUS) score as a key performance indicator (KPI) for user satisfaction. Additionally, we will be tracking two other critical usability metrics: time on task and success rate. These metrics will provide a comprehensive view of how well our product supports primary user goals across web and mobile platforms.

The purpose of this usability test is to establish a usability benchmark for the product, which will serve as a foundation for future improvements.

Success metrics

  • SUS score

  • Time on task

  • Success rate

 

Core user journeys

Persona

Core journey

Rationale

Persona

Core journey

Rationale

Chioma, business owner:

Chioma is a small business owner with a business banking account which she uses for managing her business' finances daily

User app management:

  1. App settings

  2. Password Passcode

  3. Hide and Reveal Bank Balance

  4. Switching Aliases for account number

  5. edit account limit

This journey was selected because it contains key activities that result in an uptick of support issues for Moniepoint, and frustration on the part of the user.

John, personal account user:

John is a student at Unilag with a personal banking account which he uses for allowance from his parents monthly.

Account overview:

  1. Check status of all accounts that are attached to the user

  2. View Balances

  3. Transaction History

This journey was selected because these are basic activities that every user needs to be able to conduct once they successfully log into the Moniepoint app.

Goriola, accountant:

Goriola manages multiple chains within a franchise, he is familiar with digital products.

Account overview:

  1. Check status of all accounts that are attached to the user

  2. View Balances

  3. Transaction History

This journey was selected because these are basic activities that every user needs to be able to conduct once they successfully log into the Moniepoint app.

Ahmad, personal account user:

Ahmad is a father with a small family. He uses his Moniepoint account as his primary account and manages all his family’s finances from there.

Product discoverability:

  1. Funds Transfer Initiation

  2. Bill Payment Initiation

  3. Card Management

  4. Savings

  5. Upgrading account/KYC

  6. Adding money to the account

This journey was selected because the discoverability of other features and offerings of the Moniepoint app is essential to Moniepoint’s revenue.

Faiza, is a business owner. She doesn’t speak any english and relies on help from her BRM and the icons within the app to get things done

Product discoverability:

  1. Funds Transfer Initiation

  2. Bill Payment Initiation

  3. Card Management

  4. Loans

  5. Savings

  6. Upgrading account/KYC

  7. POS

  8. Adding money to the account

This journey was selected because the discoverability of other features and offerings of the Moniepoint app is essential to Moniepoint’s revenue.

Lara, personal account user:


Lara is a customer support service agent at a local e-commerce company with a personal banking account which she uses to receive her salary from her company, she is familiar with digital products.

User app management:

  1. App settings

  2. Password Passcode

  3. Hide and Reveal Bank Balance

  4. Switching Aliases for account number

  5. edit account limit

This journey was selected because it contains key activities that result in an uptick of support issues for Moniepoint, and frustration on the part of the user.

Test environment

Platform & Test type: Physical moderated tests using staging versions of both the Personal and Business accounts.

Platform specification:

  • Mobile Staging, accessed through VPN and Test Flight.

Environment setup:

  • A list of tasks were drafted to guide each participant

  • Instructions were communicated to participants verbally

  • Results were recorded using a google form by the Designer

Tasks

All the actions assigned to the users were grouped in batches falling under the three core journeys identified in the section above: user app management, account overview and product discoverability.

Core journey

Tasks

Core journey

Tasks

Check status of all accounts that are attached to the user

A customer that has received notification of a transaction hold on their account is asked to identify the notification, and read out the expected actions for that account.

 

This requires the customer to switch between multiple accounts

View balances

A customer that has just logged in to the app is asked to identify and dictate the balance on their account

View transaction history

A customer that has just received some money is asked to review their list of recent transactions as well as details of the newest transaction.

Initiate a funds transfer operation

A customer that wants to send money out of their accounts is prompted to start the process of initiating the transfer

Initiate a bill payment initiation

A customer that wants to pay a bill from their account is prompted to start the process of making the bill payment

Initiate card management flow

A customer is asked to initiate the process for ordering and managing cards to their accounts

Initiate savings product flow

A customer is asked to check the amount of savings in the account and read it out loud. Or read out the number of savings types that are available

View and initiate KYC level upgrade

A customer is asked to verify the current KYC level of their account. They are also asked to begin to upgrade the process of upgrading their account from the mobile app

Initiate POS product flow

A business owner customer is asked to confirm how many POS they have attached to their account. The are also asked to confirm the amount of their most recent transaction.

Copy account number to add money to the account

A customer is asked to copy their account number in preparation of receiving money from a friend.

Edit App settings

A customer is asked to locate and identify the following within the app: Notification preferences, device management and app themes

Change password / passcode

A customer is asked to initiate the process of changing the passcode/password of their account from within the settings section of the app

Hide and Reveal Bank Balance

A customer, simulating use of the app in a crowded room, is asked to hide their balance so that it is not visible on the dashboard

Change between account number and phone number

A customer is asked to switch from using their phone number for receiving money to using their account number (vice versa depending on what setting was previously activated on the account)

Edit transaction limit, View account limit

A customer is asked to edit the transaction limit on their account.

They are also asked to read aloud the current single debit limit on their account

Participants

Participant information

Number of participants

5 Business Banking users, 5 Personal Banking users to test all the core journeys highlighted

Demographics

These users were a mix of people from business owners, to undergraduate students, working class professionals, older retired people. Familiarity with the product ranged from zero experience (using the app for the first time) to people with existing accounts on the app (both business and personal accounts). All test participants were located in Lagos as all tests were conducted physically, participants spoke a variety of languages including English, Yoruba, Pidgin English, and Hausa.

Selection criteria

The participants were a mix of new and existing customers. They were chosen at random, based on willingness to participate in the tests.

Select participant profiles

Participant A

Audu

Age

-

Occupation

SME owner

Tech savviness

Low

Fintech usage

Uses the moniepoint mobile app for business owners, recently had a transaction held for violating KYC limits on his account. He’s not very familiar with digital money management apps like this, and displays a high level of anxiety when asked to interact with the app.

Primary devices

Android phone

Key insights

Audu heavily relies on his POS terminal for business operations and tries his best to avoid using the mobile becuase of his limited experience with English and technology. He requires a high volume of assistance to perform actions he doesn’t perform daily for his business. He frustrated when he has to contact support for additional support his BRM is unable to provide because he doesn’t speak English.

Participant B

Temitope

Age

54  

Occupation

Market trader / POS operator

Tech savviness

Low

Fintech usage

Uses mobile banking apps (GTBank) for personal daily transactions and a Baxi POS terminal for CICO operations at her business.

 

I using Moniepoint Personal Banking application for the first time

Primary devices

Android phone

Key insights

Temitope needs simple, straightforward fintech solutions with minimal steps to complete transactions. Clear communication is essential for her as she is inclined to distrust many tech solutions and prefers that everything is spelt out clearly so she knows what decision to make. She asks a lot of questions and relies on feedback and notifications from the app. She also relies on familiar looking icons for decision making as she wears glasses and was unable read a lot of the text on screen but managed to stumble her way through using the familiar icons on screen.

Participant C

Ifeoluwa

Age

27

Occupation

Software Engineer

Tech savviness

High

Fintech usage

Regularly interacts with multiple banking platforms for personal transactions. Uses apps from Stanbic IBTC, Opay, Piggyvest and Kuda Bank.

Primary devices

Google Pixel 8

Key insights

Ifeoluwa prefers platforms that offer quick, reliable transfers and clear transaction histories. He likes to also know when a Bank’s network is offline and mentioned he particularly enjoys Opay user experience because of how intuitive it feels for him. He mentions that the Moniepoint app did not give him the same level of confidence as he spent time looking for a number of features on the app despite his familiarity with tech products and was unable to complete one of the tasks assigned to him (hide/show balance)

Participant D

Adaaku

Age

-

Occupation

Business owner

Tech savviness

Low

Fintech usage

She mainly uses the moniepoint app and POS for her business. She is also familiar with other banking apps that she has had to use over time, though her proficiency with them is still pretty low.

Primary devices

Android phone

Key insights

Adaaku struggled with nearly all the tasks given to her. For example, when given the instruction to upgrade her KYC account she was unable to, despite being a registered business owner on the app. She knew where to initiate POS views from, as well as send and receive money, and change her passcode. But that seemed to be the extent of her familiarity with the app as she required assistance for every other action she was asked complete on the app.

Participant E

Oga Sunny

Age

-

Occupation

-

Tech savviness

Moderate

Fintech usage

Oga sunny claims he’s familiar with banking app and digital systems as he’s been riunning his business for a while now. In the past, he’s used apps like Paga and currently uses Moniepoint to run his POS business, facilitating cash withdrawals, deposits, and transfers for customers. He also uses traditional banking apps for reconciling the daily balance.

Primary devices

Iphone

Key insights

Oga Sunny’s biggest concern during the tests was the challenge that Moniepoint’s decision to only allow save as you earn and promo balance cashout via the web app and not the mobile app as was previously available. He also mentioned he had asked for CAC registration a while ago and is still yet to receive feedback after weeks of waiting. This is particularly frustrating for him to deal with since there’s no way to currently track the progress of things for him on the app. He expressed he often finds himself feeling helpless because of the lack of updates, and the lack of awareness on why Moniepoint makes some of the decisions that they make when they change up settings (like with the promo balance problem)

Recruitment process

  • Recruitment channels included: walk-in complainants at the Moniepoint office, personal banking users recruited online and through the researcher’s network

  • Screeners were used to ensure participants met the following criteria:

    • regularly interact with banking apps

    • limited interaction with banking apps and technology products in general

    • current business owners with Moniepoint

    • current Moniepoint customers who do not speak English

Usability metrics and results

SUS score

SUS is a standardised questionnaire used to measure the usability of a product, using a 10 questions 5-point scale to generate a score between 0 and 100, with higher indicating higher usability.

The average SUS score is typically 68. A score of 68 or higher is generally considered acceptable or better than average. Above 70 is good, and above 80 is excellent.

sus scale.png

 

Time on task

The time it takes participants to complete each journey. Shorter times generally indicate better usability. This metric helps to measure efficiency. There were no predefined time on task measurements to measure against, so an average was calculated (per task) once all tasks had been completed by the participants.

Success rate

A task is considered successful if the participant completes it as intended within the defined parameters, with or without assistance (as many of the partipants needed some degree of direction to get things done), and within a reasonable time frame. Success rate will be calculated as the percentage of participants who successfully complete each task as defined by the instruction.

Results

An overall SUS score was calculated as the questionnaire was issued after all the tasks were completed by each test participant. These are the results:

Business Banking App SUS score: 34.5

Personal Banking App SUS score: 37.5

 

Suceess rates and time on task figures are detailed in the table below

Core journey

Time on task

Success rate

Comments

Core journey

Time on task

Success rate

Comments

Check status of all accounts that are attached to the user

12s

100%

 

View balances

7s

100%

 

View transaction history

8s

100%

 

Initiate a funds transfer operation

15s

100%

 

Initiate a bill payment initiation

9s

100%

 

Initiate card management flow

26s

100%

 

Initiate savings product flow

33s

100%

 

View and initiate KYC level upgrade

47s

60%

 

Initiate POS product flow

10s

100%

Most BOs were familiar with this

Copy account number to add money to the account

12s

100%

All users were able to complete this task effectively

Edit App settings

44s

60%

 

Change password / passcode

1m 48s

80%

 

Hide and Reveal Bank Balance

56s

10%

Only one user managed to complete this task successfully, and she spent nearly a full minute on the task before she found it. Others gave up after searching with no progress.

Change between account number and phone number

37s

20%

Only two people completed this. And that was because they had spotted the action previously while looking around the settings.

Edit transaction limit, View account limit

43s

60%

 

Post-test qualitative questionnaire feedback

Participants provided additional insights through open-ended post-test questions:

  1. If you could make this app better for yourself, what would you improve

  2. Is there any feature you really enjoy

Common pain points

  1. A number of users mentioned there seem to be an increasing number of things for them to address

  2. Some users mentioned that decisions that stress them out seem to be made recently (some of these seem like CBN induced discomfort, but a few users mentioned the particular issue of the “save as you earn” and “promo balances” only being available on web as a big issue)

  3. One personal banking user mentioned that it would be nice to not be able to break some types of savings at all. They cited Piggyvest as an example of airtight savings that are unbreakable even during moments of temptation.

  4. The location of the settings for the app currently makes it impractical because the majority of users assume there’s nothing else on the page beyond the “edit” CTA under the Personal Information section of the page.

  5. Some of the features on the app for the business users feel like overkill as they have never had reason to interact with these features in the past and it just provides them with an endless amount of confusing buttons to click

  6. English. The app really needs to be translated.

Positive feedback

  1. Some users mentioned they liked the way the app looked.

  2. A number of users mentioned it was convenient to have BRMs to help them navigate some of the most difficult aspects of the app.

  3. Users that knew how to upgrade their KYC were often able to do it because they had been shown how to do it in the past and knew what visual cues to look for, more of these types of actions could be provided.

Recommendations for improvement

Based on the test findings, the following recommendations are proposed to improve the product’s usability:

General

The SUS test, while fantastic for many other products and mediums seemed to have confused a number of the test participants. Some of them mentioned that it seemed like the were being asked the same question twice and struggled to answer the questions without some sort of additional prodding. A more nuanced testing scale may be required in the future.

Design changes

  • Edit App Settings: redesign this page to enable users find and edit items quicker. Half the time spent on this task for most participants was on locating the CTA required to complete their task.

  • Use clearer instructions, and more colloquial english to describe desired actions across the app.

  • Lean heavily on the use of visual cues similar to what exists on other apps to reduce the cognitive load on users when they try to locate action points and decipher desired behaviours.

Quick wins

  • Relocating the “Hide/Show balance” CTA to somewhere that’s closer to the balance

Long-term recommendations

  • Consider a more comprehensive redesign of the dashboard for business users, especially focusing on simplifying the interface to present a cleaner, easier to understand version for users

  • Translation of the app to other languages because a considerable volume of revenue comes from areas where English cannot be understood by users.

Conclusion

Summary

The usability test revealed that the product performs below average in most areas, and there are specific pain points related to a locating where to complete a majority of actions. By focusing on these areas, we can significantly improve the user experience.

Next Steps

The design team will implement the recommended changes and prepare for a follow-up usability test to measure improvements in SUS, time on task, and success rate.

 

 

Add label

Related content

Moniepoint POS SUS report
Moniepoint POS SUS report
More like this
Transfers SUS report
Transfers SUS report
More like this
Monnify SUS report
Monnify SUS report
More like this
Moniedesk SUS report
Moniedesk SUS report
More like this
Moniepoint Sales Network Tools SUS report
Moniepoint Sales Network Tools SUS report
More like this
Loans SUS report
Loans SUS report
More like this