| Page Properties | ||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Document summary
This research summary presents the results of the usability testing conducted on the sales network tools.
...
SUS score
Time on task
Success rate
Test plan
Test plan | https://docs.google.com/document/d/1BAltDfoqDzOkX4O4fPh0PQemcIkFQiZgjvZArWvVlS8/edit?usp=sharing Sales Network Tool Test Plan |
|---|
Core user journeys
Persona | Core journey | Rationale |
|---|---|---|
BRM & PRM (the primary point of contact within the sales network between business owners/marketers and the organization) | Onboarding After Receiving Activation Link | It is the first contact of the BRM with the platform (They wouldn’t be able to sell products without onboarding) |
Onboarding a Business Owner (A major part of why they use the platform, to onboard businesses) | One of the primary reasons for getting onboarded is to get more Business Owners(BOs) onboarded (Survey with users showed these core journey) | |
Selling and Assigning Cards to Business Owners and Customers | They sell cards to BOs and customers to increase market traction and ultimately their commissions | |
Monitoring Business Owners Performance and Placing PND on Non-performing Business Owners | They monitor BOs to make sure they keep up to the expected target | |
Taking Courses via Dashboard | They take courses to stay in tune and updated with the latest so as to perform optimally | |
BRM (the primary point of contact within the sales network between business owners/marketers and the organization) | Ability to Cash Out Commissions | BRMs need to get their commissions/rewards for personal consumption |
SC & SPO (those who oversee the main contact within the sales network between business owners/marketers and the organization, specifically the managers of BRM/PRM) | Initiating the Onboarding Process of a BRM | They are to initiate the onboarding process of BRMs that will perform and increase market traction |
Monitoring BRM/PRM Performance and Placing PND on Non-performing BRMs/PRMs | They monitor BRMs/PRMs to make sure they keep up to the expected target | |
Ability to Cash Out Commissions | They need to get their commissions/rewards for personal consumption | |
Selling Cards to BRMs | They sell cards to BRMs/PRMs to increase market traction and ultimately their commissions | |
SC (those who oversee the main contact within the sales network between business owners/marketers and the organization, specifically the managers of BRM/PRM) | Assigning POS to BRMs | SCs are to assign POS terminals to BRMs |
...
The tests were unmoderated, we allowed the users navigate these journeys themselves, remote and recorded. The tests were done with the present working platforms (mobile and web). Some technical issues didn’t allow for the use of test environment and prototypes.
Tasks
...
Provide details on the tasks participants were asked to complete. Ensure tasks align with real-world scenarios that users of the product would encounter.
[insert text here]
Core journey | Tasks |
|---|---|
Onboarding After Receiving Activation Link | A As BRM/PRM needs to be onboarded using , after receiving the activation link after the SC/SPO has initiated onboarding on their dashboardvia mail, follow the flow to be onboarded |
Onboarding a Business Owner (A major part of why they use the platform, to onboard businesses) | BRMs/PRMs goes in to their dashboard and onboard business owners or personal customersAs a BRM/PRM, from your dashboard onboard a Business Owner/Personal Customer |
Selling and Assigning Cards to Business Owners and Customers | As a BRM/PRM, from your dashboard, sell and assign cards to your BOs and customers |
Monitoring Business Owners Performance and Placing PND on Non-performing Business Owners | As a BRM/PRM, from your dashboard, monitor the performance of your downlines and place a PND on non performing downlines |
Taking Courses via Dashboard | As a BRM/PRM, take courses from the dashboard |
Ability to Cash Out Commissions | As a BRM, show how you cashout your commissions |
Initiating the Onboarding Process of a BRM | SC/SPO should log in and initiate the onboarding process of a new BRM/PRM |
Monitoring BRM/PRM Performance and Placing PND on Non-performing BRMs/PRMs | SC/SPO should monitor the performance of downlines and place a PND on non performing downlines |
Ability to Cash Out Commissions | SC/SPO should follow the dashboard on how to cashout their commissions |
Selling Cards to BRMs | SC should from their dashboard, sell cards to your BRMs |
Assigning POS to BRMs | SC should from their dashboard, assign POS terminals to BRMs |
Participants
Participant information
...
Usability metrics and results
Success rate definition
...
Success criteria:
A task is considered successful if the participant completes it as intended within the defined parameters, without assistance, and within a reasonable time frame.
Define clear success criteria for each task, such as reaching a specific page, completing a transaction, or filling out a form correctly.
Measurement:
Success rate will be calculated as the percentage of participants who successfully complete each task according to the predefined criteria.
SUS score
SUS is a standardised questionnaire used to measure the usability of a product, using a 10 questions 5-point scale to generate a score between 0 and 100, with higher indicating higher usability.
...
The time it takes participants to complete each journey. Shorter times generally indicate better usability. This metric helps to measure efficiency.
...
.
Onboarding After Receiving Activation Link: users should/are expected to complete this journey within 10 minutes.
Onboarding a Business Owner: users should/are expected to complete this journey within 4 minutes.
Selling and Assigning Cards to Business Owners and Customers: users should/are expected to complete this journey within X 3 minutes.[insert journey name]
Monitoring Business Owners Performance and Placing PND on Non-performing Business Owners: users should/are expected to complete this journey within 2 minutes.
Taking Courses via Dashboard: users should/are expected to complete this journey within X minutes.[insert journey name]2 minutes.
Ability to Cash Out Commissions: users should/are expected to complete this journey within 1 minute.
Initiating the Onboarding Process of a BRM: users should/are expected to complete this journey within 6 minutes.
Monitoring BRM/PRM Performance and Placing PND on Non-performing BRMs/PRMs: users should/are expected to complete this journey within X 3 minutes.
[insert journey name]Ability to Cash Out Commissions: users should/are expected to complete this journey within 1 minute.
Selling Cards to BRMs: users should/are expected to complete this journey within X 3 minutes.[insert
journey name]Assigning POS to BRMs: users should/are expected to complete this journey within X 4 minutes.
Success rate
[designer to define success for each journey]
[insert journey name]Onboarding After Receiving Activation Link: this journey is considered successful when BRM/PRM is able to get to the dashboard after validation.
Onboarding a Business Owner/Customer: this journey is considered successful when BRM/PRM is able to onboard a business owner/customer.
Selling and Assigning Cards to Business Owners and Customers: this journey is considered successful when BRM/PRM is able to sell and assign cards on the platform.
Monitoring Business Owners Performance and Placing PND on Non-performing Business Owners: this journey is considered successful when [specify].[insert journey name]BRM/PRM is able to view the performance of downlines and place PND when necessary.
Taking Courses via Dashboard: this journey is considered successful when BRM/PRM is able to take a course.
Ability to Cash Out Commissions: this journey is considered successful when [specify].[insert journey name]BRM is able to cashout successfully.
Initiating the Onboarding Process of a BRM: this journey is considered successful when SC is able to raise a request for a BRM onboarding successfully.
Monitoring BRM/PRM Performance and Placing PND on Non-performing BRMs/PRMs: this journey is considered successful when [specify].[insert journey name]when SC/SPO is able to view the performance of downlines and place PND when necessary.
Ability to Cash Out Commissions: this journey is considered successful when BRM is able to cashout successfully.
Selling Cards to BRMs: this journey is considered successful when [specify].[insert journey name]SC/SPO is able to sell cards on the platform.
Assigning POS to BRMs: this journey is considered successful when [specify]SC is able to successfully assign a terminal/POS to a BRM.
Results
...
Delete this info panel, this is only for guidance.
...
| Panel | ||
|---|---|---|
| ||
SUS score The average SUS score for SC/SPO was 79.9, this score falls within the industry benchmark. Analysis: the SUS score reveals positive aspects of user satisfaction, particularly related to how users use the platform for carrying out day to day activities. Analysis: the SUS score reveals [ positive /negative] aspects of user satisfaction, particularly related to [insert key findings]how users use the platform for carrying out day to day activities. Time on task The average time to complete key tasks was [insert time]4 minutes. Analysis: some tasks such as [task 1] took longer than anticipated due to [insert reason], indicating potential usability challengestook longer to finish mainly because of technical issues such as API failure and we had to redo some tasks. Success rate The overall success rate was [insert percentage]72%. This indicates that [insert percentage of participants] some users were able to successfully complete the core tasks without assistance. Analysis: certain tasks such as [specific task] had a lower success rate due to [insert reasons], while others were completed with high efficiencythat had a bit of technical know how took more time such as assigning terminals. |
Core journey | SUS score | Time on task | Success rate | Comments |
|---|---|---|---|---|
[journey name] | e.g. 60 | 1m 30s | % | Brief key feedback or observation for this journey | [journey name] | Brief key feedback or observation for this journey | [journey name] | Brief key feedback or observation for this journey | [journey name] | Brief key feedback or observation for this journey | [journey name] | Brief key feedback or observation for this journey | [journey name] | Brief key feedback or observation for this journey | [journey name] | Brief key feedback or observation for this journey |
Post-test qualitative questionnaire feedback
...
Delete this info panel, this is only for guidance.
Post-test questionnaire:
After completing the tasks, participants will be asked additional targeted questions to gather specific feedback on their experience. These questions will be presented BEFORE the SUS questionnaire, for example:
Was there anything confusing or frustrating about the sign-up process?
How easy or difficult did you find the sign-up process?
Did you encounter any difficulties in reading or understanding the text or labels during the tasks?
Were there any features or elements that stood out as particularly helpful or problematic?
Did you experience any challenges with the colour scheme or visual elements?
Do you have any additional comments or suggestions for improving this experience?
...
Onboarding After Receiving Activation Link | 75 | 09m 24s | 70% | Drop off from API failure (BVN validation) |
|---|---|---|---|---|
Onboarding a Business Owner (A major part of why they use the platform, to onboard businesses) | 42.5 | 04m 17s | 85% | |
Selling and Assigning Cards to Business Owners and Customers | 90 | 04m 08s | 79.5% | Experience can be better |
Monitoring Business Owners Performance and Placing PND on Non-performing Business Owners | 50 | 09m 13s | 75% | There are metrics they want displayed on the table shown |
Taking Courses via Dashboard | 100 | 01m 12s | 100% | |
Ability to Cash Out Commissions | 80 | 0m 34s | 100% | |
Initiating the Onboarding Process of a BRM | 90 | 10m | 90% | |
Monitoring BRM/PRM Performance and Placing PND on Non-performing BRMs/PRMs | 57.5 | 03m 08s | 89% | There are metrics they want displayed on the table shown |
Ability to Cash Out Commissions | 60 | 01m 29s | 100% | |
Selling Cards to BRMs | 57.5 | 03m 34s | 68% | |
Assigning POS to BRMs | 73.5 | 05m 57s | 56% |
Post-test qualitative questionnaire feedback
Participants provided additional insights through open-ended post-test questions:
Common pain points | List any recurring issues, frustrations, or confusion that participants mentionedCertain data they need to be able to be more productive isn’t being displayed and low internet bandwidth won’t load pages properly. |
|---|---|
Positive feedback | Summarise any positive comments about the product or specific featuresSome features such as cashout and placing PND are easier to navigate. |
User suggestions | Insert suggestions for improvement or areas where users struggled but offered solutionsData required should be displayed and optimize performance of the platform. |
Recommendations for improvement
Based on the test findings, the following recommendations are proposed to improve the product’s usability:
Design changes
[Task/feature]: revise [UI component, workflow, etc.] to streamline the user journey and reduce time on task.
[Task/feature]: clarify instructions on [specific screen/interaction] to improve success rates.
Quick wins
Minor adjustments to [insert feature or task] that can be implemented without major development effort.
Long-term recommendations
Consider a more comprehensive redesign of [specific user journey], especially focusing on [insert issue]Remove the claim profile screen upon login for PRMs, as it is irrelevant to their partner type.
Change the landing screen for SPOs, replacing the Loans section with a more relevant option for their role.
Implement a unified user interface for SCs and SPOs to eliminate the use of the Legacy UI.
Revise and rename features on the PRMs dashboard to reflect their specific roles and responsibilities.
Update dashboard terminology to better align with partner roles, such as replacing "Add Aggregator" with "Add BRM/PRM."
Quick wins
Reevaluate the success and failure screen messages to ensure they clearly communicate the intended message and remove any unnecessary screens.
Long-term recommendations
Streamline the approval stages involved in onboarding BRMs/PRMs to improve efficiency.
Consider using a different provider for liveness and face verification, as the current provider, Metamap, requires users to turn their heads during the process.
Conclusion
Summary
The usability test revealed indicated that while the product performs adequately in most areas, there are specific pain points related to [specific feature]. By focusing on these areas, we can significantly improve the Sales Network Tools effectively support partners in managing their networks, several pain points need attention. These include lengthy processes, such as onboarding business owners, approval flows for BRM/PRM onboarding, concerns about the visibility of network performance, and frequent downtimes during critical tasks. Addressing these challenges will lead to significant improvements in the overall user experience.
Next Steps
...