11 June 2021 -3 minute read
What we did
- We’ve run four user testing sessions with young people since going live last week, with our partner UK Youth busy booking in more sessions over the next two weeks.
- We’ve spoken to Leap Confronting Conflict about collaborating with their Leap Ambassadors programme to test the app.
- We’ve been putting the final plans in place for our Demo Day taking place on Monday, where four youth app providers—LVN, Mee Too, Youth Card, and My Best Life (NPC’s programme)—and a range of observers will be coming together to share learning and explore ways to collaborate.
- We’ve been updating our DPIA to factor in GDPR risks attached to the soft launch and feedback we’re gathering.
- We’ve been speaking to our funders about follow-on funding for our Bridging Phase.
What we’re thinking about
- What is the right number of testing sessions? Originally, we thought 30 user testing interviews would give us a good enough sample to feel confident about what is and isn’t working in the app. However, some of the team taking part in a Service Design course run by UAL have been learning that the ideal number of participants is actually 15. At this point, the insights should begin to plateau and to give you confidence in what changes need to be made. So we’re considering scaling back our original figure and introducing more opportunities for iteration in between.
- How do we get the same level of insights as you would from a site visit, when dealing with a pandemic? As part of our original plan for in market testing, we wanted to go out and speak to young people in-person, to watch them interacting with the app and get their immediate impressions. We think this is a really important part of understanding whether young people would actually see themselves using this as part of their everyday lives. However, with face-to-face services still severely impacted by the pandemic, we’re thinking about workaround solutions. These include organising a couple of online focus groups, possibly working with a school for a classroom visit, and otherwise encouraging more of the young people we’re speaking with to share the app with their friends, so that we can gather their impressions through a survey within the app. This is not ideal, but will help us to continue learning while youth settings are still largely closed.
Challenges
We’ve been using Hotjar to set up two feedback surveys within the app. While the functionality of Hotjar is really straightforward and follows a similar logic to using SurveyMonkey or similar, we’ve had a few teething problems getting the surveys to visualise properly, and ensuring we’re allowing people enough time in the app before the pop-up appears, to ensure they don’t feel harassed. A learning from this would be to ensure you test the survey is working as part of your final bug testing of the app, so that you don’t have any issues when it comes to the release.
Wins from this week
- So far, the app is testing really well! The young people we’ve spoken to have found it straightforward and easy-to-use, and they were impressed by the large range of services on the app. They also appreciated having the option to customise their results with the filter or the quiz.
