Methodology
A usability test involving 7 participants was conducted through a combination of online and in-person sessions. Participants
were asked to complete 5 tasks, ensuring comprehensive interaction with the app's core touchpoints.
- Complete onboarding/account setup
- Start the first tutorial in their learning path.
- Find the necessary supplies for a specific tutorial.
- Locate and save a specific tutorial.
- Find previously completed tutorials.
At the conclusion of each task, participants were asked follow-up questions. The time taken and success rate for each
participant and task were recorded, providing valuable insights into usability and task completion efficiency. At the end of the
test users were asked to rate the experience on a scale of 1-10 [1 being lowest and 10 highest], if they would use the app and
for any final comments.
Limitations
As with card sorting, a limitation of this study could be the limited sample size. Completion time was collected as a comparable
measure for future testing, however limited time meant no further scenario-based testing was conducted.
Task 1
Walk through the onboarding process.
Participant |
Time |
Positive feedback |
Improvements |
Successful |
1 - [MD] |
2 m 10s |
- Purpose of app is very clear |
|
|
- Detailed questions to create personalised experience | | 100% |
| 2 [AV] | 2 m | - Purpose of app clear | - Reduce text
- Explain why the sub questions are asked [e.g to adjust difficulty level] | 100% |
| 3 [M] | 1 m 90 s | - Yes
- Clear why you are asked questions to understand level of pottery
- Like the layout - it was fun
- Like the option to add other pottery types or goals | | 100% |
| 4 [TB] - UX/UI Designer | 7m 22 | - App purpose was outlined well in begging screens
- The questions made them feel like they were creating a reason to sue the app [goals]
- Liked overview of app features
- Benefit of pottery useful information | - Would be good to see how many onboarding screens there are [progress bar]
- Missing back button on account page | 100% |
| 5 [NZ] | 1m 13s | - Clear and liked customised experience e | | 100% |
| 6 [DJ] | 2m 39s | - Very clear
- Easy to understand even for non native speakers | | 100% |
| 7 [C] | 1m 37s | - Everything clear | | 100% |
Task 2
Start the FIRST tutorial in your learning path
Participant |
Time |
Positive feedback |
Improvements |
Successful |
1 - [MD] |
3 m 8s |
- Explanations of gesture are clear |
|
|
- Innovative to have it as hands free
- Liked questions asking how you feel to optimise experience | | 100% |
| 2 [AV] | 2 m | - Like being asked emotions and felt use of e emojis made this more engaging
- Gestures are explained clearer and the capitalised text for speech is helpful | - Would expect to be able to say emotions/do this later as hands will still be messy
- Icon for drop-down in learning path does not look clickable | 100% |
| 3 [M] | 1m 29s | - Would feel confident using gestures and voice command
- Like asking for emotions because it is relevant and helps to see how audience feels and how app improves their mood | | 100% |
| 4 [TB] - UX/UI Designer | 11m 45s | - Thought gestures was ‘really cool’
- Thought collecting emotions was useful to see if app has improved made and actually made a difference | - Confusion with circles on each tutorial - thought they were checkboxes | 100% |
| 5 [NZ] | 2m 9s | - Gestures clear
- Thought it was good identify if session was helpful in calming me down/ and identify difference between before and after | | 50% - was unsure when to exit tutorial and how to do so |
| 6 [DJ] | 2m 39s | - Everything was clear | - Designer note - participant did not read the screens asking how they felt, just click button to proceed [make more obvious] | 50% - did not acknowledge emotion screen so was later confused |
| 7 [C] | 2m 24s | - Thought hands free was ‘cool’
- Likes reminder off gestures | | 100% |
Task 3
Find what you need to complete tutorial ‘Christmas Decor’
Participant |
Time |
Positive feedback |
Improvements |
Successul |
1 - [MD] |
1m 2s |
- Overview of steps is helpful |
|
|
- Alternative to traditional clay tools makes it accessible | | 100% |
| 2 [AV] | 1 m 50s | - Tutorial was easy to find
- Liked that it tells you steps
- Providing alternatives make’s it more accessible for beginners | - What you need items are too text heavy
- Add ‘Required and ‘Optional’ headings | 100% |
| 3 [M] | 1m 20s | - Tutorials easy to find | | 100% |
| 4 [TB] | 1m 23s | - Easy to find what you need | | 100% |
| 5 [NZ] | 35s | - Easy | | 100% |
| 6 [DJ] | 55s | - Tutorial easy to find
- Emoji helps to scan through text and read most important information | - Increase font size in what you need cards | 100% |
| 7 [C] | 15s | - Easy to find | | 100% |
Task 4
Save the tutorial ‘stress relief’
Participant |
Time |
Positive feedback |
Improvements |
Successful |
1 - [MD] |
1m |
- Clear it is not a regular tutorial |
|
100% |
2 [AV] |
50s |
- Different format helps to show you have entered a different part of the app |
- Unclear that you don't actually make anything |
|
- Instead of pop up have text on page | 100% |
| 3 [M] | 15s | - Understood purpose of section being to relax | | 100% |
| 4 [TB] -UX/UI Designer | 40s | - Though this section was useful
- Likes that the colour changed to show different area | | 100% |
| 5 [NZ] | 38s | - Understood goal of being present with clay | | 100% |
| 6 [DJ] | 30s | - Purpose of mindful moments clear
- ‘Loved’ the colour change to show it is different section | - Did not read pop up - have this on page instead
- Increase font size on the tabs | 100% |
| 7 [C] | 20s | - Intention is clear, mindful moments focus on the process not what you create at the end | | 100% |
Task 5
Find previously completed tutorials
Participant |
Time |
Positive feedback |
Improvements |
Successful |
1 - [MD] |
1m 20s |
- Likes emotion log |
- Maybe you could add a note after session |
100% |
2 [AV] |
20s |
- Seeing pre and post pottery feelings make impact tangible |
|
|
- Likes being able to see the date completed, go back to tutorial and the tag of what type of tutorial it was | - Would expect settings to be here in profile | 100% |
| 3 [M] | 10s | - Interesting to analyse before and after
- Useful to track this data | | 100% |
| 4 [TB] -UX/UI Designer | 1m 20s | - Found this feature ‘cool’
- Like being able to compare before and after pottery data
- Liked being able to go back to tutorial | | 100% |
| 5 [NZ] | 13s | - Thought comparison information was useful | - Would be more helpful to show direct comparison, for example, how many ‘stressed’ feelings turned into ‘happy’ | 100% |
| 6 [DJ] | 5s | | - Was unclear this screen because skipped emotion questions | 100% |
| 7 [C] | 7s | - Helpful to see comparison before and after for each tutorial you have done | | 100% |