/
Monnify SUS report

Monnify SUS report

Due date

19 September 2024

Epic

https://teamapt.atlassian.net/browse/DS-34

Task

https://teamapt.atlassian.net/browse/DS-75

Designer

@Kelvin Ogumor

Useberry

Create and activate the account
Funds Withdrawal
Web Checkout
Transaction Search

Document summary

Insert brief summary here.

Objectives

As part of our ongoing efforts to improve the user experience and align our products with strategic goals, we have identified the System Usability Scale (SUS) score as a key performance indicator (KPI) for user satisfaction. Additionally, we will be tracking two other critical usability metrics: time on task and success rate. These metrics will provide a comprehensive view of how well our product supports primary user goals across web and mobile platforms.

The purpose of this usability test is to establish a usability benchmark for the product, which will serve as a foundation for future improvements.

Success metrics

  • SUS score

  • Time on task

  • Success rate

Test plan

Core user journeys

Persona

Core journey

Rationale

Persona

Core journey

Rationale

A tech business owner that collects payment on via their mobile app

Funds withdrawal from wallet

This journey was selected because Merchants frequently withdraw funds settled to their wallet.

Business owner who runs an online academy, they allow potential students to pay for their courses online

Web Checkout using Card and Transfer

Checkout is one of our primary products this allows merchant to give their customers the ability to make payment online or in-app using different payment methods

An operations manager whose job is to ensure that online payments are always available for their customers

Create and activate Monnify account

This journey is crucial because a smooth onboarding process increases user conversions and can turn new users into long-term customers.

An operations lead that ensures all customer transactions are accounted for weather failed or completed transactions

Transactions Search

An efficient transaction search helps merchants quickly resolve customer issues, making it easier to locate missing transactions and maintain customer satisfaction.

Test environment

The test was unmoderated, done using an interactive prototype, and performed on the web.

Tasks

All tasks are assigned to the core journeys

Core journey

Tasks

Core journey

Tasks

Funds withdrawal from wallet

You have been settled for transactions collected via online payment.

How would you withdraw those funds from your wallet?

Web Checkout using Card

You just finished selecting the sofa you want from the Furniro online store, and it's time to check out and make a payment using your card.

How would you pay using your bank card?

Web Checkout using Transfer

You just finished selecting the sofa you want from the Furniro online store, and it's time to check out and make a payment using your transfer.

How would you pay using you Transfer payment method?

Create and activate Monnify account

You are a business owner and about to launch your online store, but you need a payment gateway. You have decided to go with Monnify. 

You are required to create your Monnify account.

Transactions Search

As a business owner, you need to search for a transaction made by a customer.

You are required to search for a failed transaction, with a reference number, payment method as Card and amount is 25,000 naira.

How would you do it?

Participants

Participant information

Number of participants

Funds withdrawal from wallet - 17
Web Checkout using Card and Transfer - 10
Create and activate Monnify account - 11
Transactions Search - 2

Demographics

  • Business Owners

  • Tech entrepreneurs

  • Operations Managers

  • Familiar with online payments

  • Tech Savy

Selection criteria

The participants included both existing customers and potential customers, and they were randomly selected based on their willingness to take part in the tests.

Participant profiles

Delete this info panel, this is only for guidance.

If applicable (otherwise delete section), provide a few short participant profiles to offer context - see examples below.

Participant A

Chinedu

Age

35

Occupation

SME owner (fashion retail)  

Tech savviness

Moderate

Fintech usage

Uses mobile banking apps (GTBank, Access Bank) for daily transactions and a POS terminal for customer payments. Prefers platforms that offer quick, reliable transfers and clear transaction histories.  

Primary devices

Android phone (Tecno Camon 16) 

Key insights

Chinedu heavily relies on his POS terminal for business operations and uses fintech apps to track transactions. He is often frustrated by network downtime with POS systems and values transparency in fees. Easy-to-read transaction reports and the ability to quickly reconcile daily sales are critical for his business.

Participant B

Halima

Age

27  

Occupation

Market trader

Tech savviness

Low

Fintech usage

Uses mobile money apps like OPay and PalmPay for personal savings, transfers, and accepting payments from customers. Not particularly tech-savvy, but uses these services due to their ease of access and lower transaction fees compared to traditional banks.

Primary devices

Android phone (Infinix Hot 10)

Key insights

Halima needs simple, straightforward fintech solutions with minimal steps to complete transactions. She values reliability, especially when receiving payments from customers. She finds features like SMS confirmations and immediate access to funds critical for trust in the service.

Participant C

Tunde

Age

40

Occupation

Corporate accountant (mid-sized firm)  

Tech savviness

High

Fintech usage

Uses digital banking platforms and business fintech solutions for managing payroll, supplier payments, and invoicing. Regularly interacts with multiple banking platforms for business transactions.  

Primary devices

Windows laptop, iPhone 13

Key insights

Tunde requires fintech solutions that streamline business transactions and offer integration with accounting software. He values features like automated invoicing, bulk payments, and detailed reporting, but he finds it frustrating when banking platforms lack API integrations with their business software. Efficiency and robust security features are critical for business operations.

Participant D

Amaka

Age

22

Occupation

NYSC corp member (service year)  

Tech savviness

High

Fintech usage

Primarily uses personal banking apps like Kuda and ALAT for saving, budgeting, and personal transfers. Also utilises fintech apps for peer-to-peer transfers and mobile payments.

Primary devices

Android phone (Samsung A32)

Key insights

Amaka prefers fintech apps that offer budgeting tools and savings features. She values gamification and rewards systems, such as cashbacks and referral bonuses, to increase engagement. Her main frustration comes from long transaction processing times or unexpected app downtimes. Security and user-friendly onboarding are important factors for her trust in the app.

Participant D

Babatunde

Age

50

Occupation

POS operator  

Tech savviness

Moderate

Fintech usage

Relies heavily on mobile money apps like Paga and Moniepoint to run his POS business, facilitating cash withdrawals, deposits, and transfers for customers. He also uses traditional banking apps for reconciling the daily balance.

Primary devices

Android phone (Itel A56)

Key insights

Babatunde’s biggest concern is the reliability of the fintech app or platform, especially in high-traffic areas. He prefers platforms with low transaction failure rates and quick settlement times. Instant customer support is crucial when POS systems encounter issues, and he values platforms with lower transaction fees.

Recruitment process

Some Participants were recruited through Monnify sales teams, and I cold texted potential Monnify users who fit the participant's profile

  • Business Owners

  • Tech entrepreneurs

  • Operations Managers

  • Familiar with online payments

  • Tech Savy

 

Usability metrics and results

Success rate definition

SUS score

SUS is a standardised questionnaire used to measure the usability of a product, using a 10 questions 5-point scale to generate a score between 0 and 100, with higher indicating higher usability.

The average SUS score is typically 68. A score of 68 or higher is generally considered acceptable or better than average. Above 70 is good, and above 80 is excellent.

sus scale.png

 

Time on task

The shorter the time to complete each task reflects better experience and efficiency. Since there are not time of task benchmarks set we will use an average for each ask

Success rate

[designer to define success for each journey]

  • Funds withdrawal from wallet: this journey is considered successful when funds withdrawal is successful

  • Web Checkout using Card and Transfer: this journey is considered successful when the user successfully makes payment on the check using the selected payment method.

  • Create and activate Monnify account: this journey is considered successful when the user successfully creates a Monnify account and then successfully submits all requirements to activate the account.

  • Transactions Search: this journey is considered successful when the user searches for a transition with search criteria (failed transaction, with a reference number, payment method as Card, and amount is 25,000 naira)

Results

Core journey

SUS score

Time on task

Success rate

Comments

Core journey

SUS score

Time on task

Success rate

Comments

Funds withdrawal from wallet

85.9

31.42s

67%

 

Web Checkout using Card

96.7

32.8s

89%

 

Web Checkout using Transfer

96.7

57.42

88%

 

Create a Monnify Account

91.9

37.7s

83%

 

Activate Monnify account

91.9

3m 39.0s

60%

 

Transactions Search

95

35.3s

67%

 

Post-test qualitative questionnaire feedback

Participants provided additional insights through open-ended post-test questions:

Common pain points

  • The USSD prototype had issues where user screen didn't move to the next activity after completion

  • Users had issues with the prototype not loading which led to drop-offs.

Positive feedback

  • Users felt the CTA button colors stood out and that was helpful in locating the CTA’s`

  • The progress shown in percentage was helpful as it made the user realize they where close to completion.

User suggestions

 

Recommendations for improvement

Based on the test findings, the following recommendations are proposed to improve the product’s usability:

Design changes

  • The input field should be revised and it looks too big which makes forms look to long and bulky

Quick wins

  • Change to be made to the header text in the withdraw form, currently Transfer details, should be changed to Withdrawal details. Change should be made to the CTA in the form, correct Make a transfer should be Withdraw.

Long-term recommendations

  • A total redesign of the application is needed as some of the UI components are defected or don't meet industry standards. During this process, more usability tests will be carried out wit users to ensure we meet their needs and give them a better user experience.

Conclusion

Summary

The usability test revealed that while the product performs adequately in most areas, there are specific pain points related to [specific feature]. By focusing on these areas, we can significantly improve the user experience.

Next Steps

The design team will implement the recommended changes and prepare for a follow-up usability test to measure improvements in SUS, time on task, and success rate.

 

 

Add label

Related content

Moniepoint channels SUS report
Moniepoint channels SUS report
More like this
Moniepoint POS SUS report
Moniepoint POS SUS report
More like this
Loans SUS report
Loans SUS report
More like this
Transfers SUS report
Transfers SUS report
More like this
Moniedesk SUS report
Moniedesk SUS report
More like this
Moniebook SUS report
Moniebook SUS report
More like this