/
Transfers SUS report

Transfers SUS report

Due date

19 September 2024

Epic

https://teamapt.atlassian.net/browse/DS-34

Task

https://teamapt.atlassian.net/browse/DS-71

Designer

@Alison Eyo

Useberry

Insert links

Document summary

This document outlines the efforts undertaken and results obtained in verifying the usability of core user journeys within the Moniepoint transfer feature.

Objectives

As part of our ongoing efforts to improve the user experience and align our products with strategic goals, we have identified the System Usability Scale (SUS) score as a key performance indicator (KPI) for user satisfaction. Additionally, we will be tracking two other critical usability metrics: time on task and success rate. These metrics will provide a comprehensive view of how well our product supports primary user goals across web and mobile platforms.

The purpose of this usability test is to establish a usability benchmark for the product, which will serve as a foundation for future improvements.

Success metrics

  • SUS score

  • Time on task

  • Success rate

Test plan

Core user journeys

Persona

Core journey

Rationale

Persona

Core journey

Rationale

Adebayo (35y/o)
Small business owner who frequently makes payments to various suppliers and contractors

Initiating a transfer to new recipient

This journey represents 90% of transfers, making it critical for user satisfaction and app utility. It was selected based on comprehensive analysis of user behavior data.

Emeka (40y/o)
Manager who regularly pays the same set of vendors for his company

Sending money to a saved beneficiary

While less common than new recipient transfers, this journey is important for understanding how the app supports repeated transactions and user convenience

Chinwe (28 y/o)
Values automated financial management

Setting up a recurring transfer

This journey is crucial for users who need to make regular payments. It was chosen to evaluate the app's ability to handle more complex, long-term transfer setups.

Fatima (32y/o)
Executive assistant who manages multiple accounts and transfers

Managing/deleting a recurring transfer

Essential for providing users control over their automated transfers. It was selected to assess the flexibility and user-friendliness of the recurring transfer feature

Oluwaseun (45y/o)
Business accountant who keeps detailed records of all financial transactions

Reviewing transfer history/downloading statements

Critical for user trust and financial management. It was chosen to evaluate the app's transparency and ability to provide clear transaction records.

Amina (38y/o)
HR Professional responsible for processing company payroll

Performing bulk transfer to multiple recipients

Important for business users who need to make multiple payments efficiently. It was selected to assess the app's capability to handle complex, multi-recipient transfers

Test environment

The initial plan was to conduct moderated tests using a live testing account.
However, due to geographical constraints, this approach would have limited our participants to users from only one of the 36 states.

To overcome this limitation, we opted for unmoderated, remote testing using mobile interactive prototypes accessible on both mobile devices and web browsers. This method allowed for broader geographical coverage and more diverse participant inclusion. Upon completing each core journey test, participants were asked to answer a series of questions and indicate their satisfaction level, providing valuable quantitative and qualitative feedback.

 

Tasks

Core journey

Tasks

Core journey

Tasks

Sending money to a new recipient

Imagine you're a small business owner who needs to pay a new supplier for the first time. You need to transfer ₦150,000 to the supplier's account using the Moniepoint app. Your task is to log into the app and complete this transfer. Please narrate your thoughts and actions as you go through the process

Sending money to a saved beneficiary

Imagine you're a freelancer who needs to pay your regular graphic designer for their latest work. You've paid them before and they're saved as a beneficiary in your Moniepoint app. You need to transfer ₦75,000 to their account.

Your task is to log into the app and complete this transfer to your saved beneficiary. Please narrate your thoughts and actions as you go through the process.

Setting up a recurring transfer

Imagine you are just started using Moniepoint for your banking needs. You want to set up a monthly transfer of ₦50,000 to your parents' joint account to help with their living expenses, for the 28th of every month. You also want to ensure you can easily modify or cancel this recurring transfer if needed.

Your task is to log into the app and set up this recurring transfer. Please narrate your thoughts and actions as you go through the process.

Managing/deleting a recurring transfer

Imagine you set up a recurring monthly transfer of ₦50,000 to your savings account six months ago. Now, you want to increase the amount to ₦75,000 and extend the duration for an additional 6 months. After making these changes, you then decide to cancel the recurring transfer entirely.

Your task is to log into the app, modify the existing recurring transfer, and then cancel it. Please narrate your thoughts and actions as you go through the process.

Performing bulk transfers to multiple recipients

Imagine you are the finance manager of a medium-sized company. It's the end of the month, and you need to process salary payments for 50 employees. You've been using Moniepoint's webapp for business transactions and want to use the bulk transfer feature to streamline this process.

Your tasks are to:

  1. Log into your Moniepoint account on your desktop

  2. Navigate to the bulk transfer feature

  3. Upload a CSV file with employee payment details (provided to you)

  4. Review and confirm the bulk transfer details

  5. Execute the bulk transfer

  6. Download a report of the completed transfers

Please narrate your thoughts and actions as you go through each task.

Reviewing transfer history/downloading statements

Imagine you're preparing your monthly financial report and need to review your transfer history for the past month. You also need to download a statement of your account for the same period.

Your task is to log into the app, review your transfer history for the past month, find a specific transfer of ₦200,000 made two weeks ago, and then download your account statement for the month. Please narrate your thoughts and actions as you go through the process.

Participants

Participant information

Number of participants

Indicate the total number of users involved (5-8 participants per journey).

Demographics

Include relevant demographic information such as age range, gender, location, experience level, job role, familiarity with the product, or other factors depending on the target audience.

Selection criteria

Describe the criteria used for selecting participants. Were they existing users, new users, or a mix of both?

Participant profiles

Delete this info panel, this is only for guidance.

If applicable (otherwise delete section), provide a few short participant profiles to offer context - see examples below.

Participant A

Chinedu

Age

35

Occupation

SME owner (fashion retail)  

Tech savviness

Moderate

Fintech usage

Uses mobile banking apps (GTBank, Access Bank) for daily transactions and a POS terminal for customer payments. Prefers platforms that offer quick, reliable transfers and clear transaction histories.  

Primary devices

Android phone (Tecno Camon 16) 

Key insights

Chinedu heavily relies on his POS terminal for business operations and uses fintech apps to track transactions. He is often frustrated by network downtime with POS systems and values transparency in fees. Easy-to-read transaction reports and the ability to quickly reconcile daily sales are critical for his business.

Participant B

Halima

Age

27  

Occupation

Market trader

Tech savviness

Low

Fintech usage

Uses mobile money apps like OPay and PalmPay for personal savings, transfers, and accepting payments from customers. Not particularly tech-savvy, but uses these services due to their ease of access and lower transaction fees compared to traditional banks.

Primary devices

Android phone (Infinix Hot 10)

Key insights

Halima needs simple, straightforward fintech solutions with minimal steps to complete transactions. She values reliability, especially when receiving payments from customers. She finds features like SMS confirmations and immediate access to funds critical for trust in the service.

Participant C

Tunde

Age

40

Occupation

Corporate accountant (mid-sized firm)  

Tech savviness

High

Fintech usage

Uses digital banking platforms and business fintech solutions for managing payroll, supplier payments, and invoicing. Regularly interacts with multiple banking platforms for business transactions.  

Primary devices

Windows laptop, iPhone 13

Key insights

Tunde requires fintech solutions that streamline business transactions and offer integration with accounting software. He values features like automated invoicing, bulk payments, and detailed reporting, but he finds it frustrating when banking platforms lack API integrations with their business software. Efficiency and robust security features are critical for business operations.

Participant D

Amaka

Age

22

Occupation

NYSC corp member (service year)  

Tech savviness

High

Fintech usage

Primarily uses personal banking apps like Kuda and ALAT for saving, budgeting, and personal transfers. Also utilises fintech apps for peer-to-peer transfers and mobile payments.

Primary devices

Android phone (Samsung A32)

Key insights

Amaka prefers fintech apps that offer budgeting tools and savings features. She values gamification and rewards systems, such as cashbacks and referral bonuses, to increase engagement. Her main frustration comes from long transaction processing times or unexpected app downtimes. Security and user-friendly onboarding are important factors for her trust in the app.

Participant E

Babatunde

Age

50

Occupation

POS operator  

Tech savviness

Moderate

Fintech usage

Relies heavily on mobile money apps like Paga and Moniepoint to run his POS business, facilitating cash withdrawals, deposits, and transfers for customers. He also uses traditional banking apps for reconciling the daily balance.

Primary devices

Android phone (Itel A56)

Key insights

Babatunde’s biggest concern is the reliability of the fintech app or platform, especially in high-traffic areas. He prefers platforms with low transaction failure rates and quick settlement times. Instant customer support is crucial when POS systems encounter issues, and he values platforms with lower transaction fees.

Recruitment process

[insert text here]

Usability metrics and results

Success rate definition

Delete this info panel, this is only for guidance.

Success criteria:

  • A task is considered successful if the participant completes it as intended within the defined parameters, without assistance, and within a reasonable time frame.

  • Define clear success criteria for each task, such as reaching a specific page, completing a transaction, or filling out a form correctly.

Measurement:

  • Success rate will be calculated as the percentage of participants who successfully complete each task according to the predefined criteria.

SUS score

SUS is a standardised questionnaire used to measure the usability of a product, using a 10 questions 5-point scale to generate a score between 0 and 100, with higher indicating higher usability.

The average SUS score is typically 68. A score of 68 or higher is generally considered acceptable or better than average. Above 70 is good, and above 80 is excellent.

sus scale.png

 

Time on task

The time it takes participants to complete each journey. Shorter times generally indicate better usability. This metric helps to measure efficiency.

  • [insert journey name]: users should/are expected to complete this journey within X minutes.

  • [insert journey name]: users should/are expected to complete this journey within X minutes.

  • [insert journey name]: users should/are expected to complete this journey within X minutes.

  • [insert journey name]: users should/are expected to complete this journey within X minutes.

  • [insert journey name]: users should/are expected to complete this journey within X minutes.

Success rate

[designer to define success for each journey]

  • [insert journey name]: this journey is considered successful when [specify].

  • [insert journey name]: this journey is considered successful when [specify].

  • [insert journey name]: this journey is considered successful when [specify].

  • [insert journey name]: this journey is considered successful when [specify].

  • [insert journey name]: this journey is considered successful when [specify].

Results

Core journey

SUS score

Time on task

Success rate

Comments

Core journey

SUS score

Time on task

Success rate

Comments

[journey name]

e.g. 60

1m 30s

%

Brief key feedback or observation for this journey

[journey name]

 

 

 

Brief key feedback or observation for this journey

[journey name]

 

 

 

Brief key feedback or observation for this journey

[journey name]

 

 

 

Brief key feedback or observation for this journey

[journey name]

 

 

 

Brief key feedback or observation for this journey

[journey name]

 

 

 

Brief key feedback or observation for this journey

[journey name]

 

 

 

Brief key feedback or observation for this journey

Post-test qualitative questionnaire feedback

Participants provided additional insights through open-ended post-test questions:

Common pain points

List any recurring issues, frustrations, or confusion that participants mentioned.

Positive feedback

Summarise any positive comments about the product or specific features.

User suggestions

Insert suggestions for improvement or areas where users struggled but offered solutions.

Recommendations for improvement

Based on the test findings, the following recommendations are proposed to improve the product’s usability:

Design changes

  • [Task/feature]: revise [UI component, workflow, etc.] to streamline the user journey and reduce time on task.

  • [Task/feature]: clarify instructions on [specific screen/interaction] to improve success rates.

Quick wins

  • Minor adjustments to [insert feature or task] that can be implemented without major development effort.

Long-term recommendations

  • Consider a more comprehensive redesign of [specific user journey], especially focusing on [insert issue].

Conclusion

Summary

The usability test revealed that while the product performs adequately in most areas, there are specific pain points related to [specific feature]. By focusing on these areas, we can significantly improve the user experience.

Next Steps

The design team will implement the recommended changes and prepare for a follow-up usability test to measure improvements in SUS, time on task, and success rate.

 

 

Add label

Related content

Moniepoint channels SUS report
Moniepoint channels SUS report
More like this
Moniepoint POS SUS report
Moniepoint POS SUS report
More like this
Loans SUS report
Loans SUS report
More like this
Monnify SUS report
Monnify SUS report
More like this
Moniedesk SUS report
Moniedesk SUS report
More like this
VAS SUS Report
VAS SUS Report
Read with this