How to do remote usability testing
A step by step guide on remote moderated usability testing for free.
Unfortunately, we can no longer turn to our neighboring desk and ask a quick question — does this look right?
Fortunately, we can ask someone on the other side of the world the same quick questions.
While usability testing looks different now, it has drastically expanded how Junior Product Designers — like myself can improve their designs by collecting user feedback.
I want to walk you through a step by step guide on how anyone can do this, for free, from their own home.
Software
You will need to use 2–3 pieces of software that you likely already have. If you don’t, you can download them for free.
Video Call
The features you will need are screen record, screen sharing, and the ability to give the other user control of your screen.
I use Zoom because the general public is familiar with it and it has the best video quality.
Prototype
Your prototype needs to be clickable. I recommend going through the test yourself to check for obvious flaws before conducting a test with a participant.
I use Figma because of the ease of prototyping and the control it gives to click onto different frames if the user gets stuck or lost. Adobe XD is a close second.
Test Script
Remote participants may need extra help to get into the right mindset because they have not left their own home. Your test script needs to give a lot of background detail including how they are feeling, what they are doing and why they are doing a specific task.
I prefer GoogleDoc because I can save all the artifacts from the usability test like recordings and notes easily into the Drive. Use whatever form you prefer, including pen&paper.
Below is an example of the minimum amount of detail I would give for a task.
Background: I want you to imagine you are taking your new puppy on a walk through your neighborhood, a small suburb called Tinyville. On your way back home, you see a bunch of posters for a dog walking service. You really love your new puppy and spending time with him, but you could use some help walking him during the work week.
Task: Go to the homepage of xyz and look around.
Follow up: What do you think of the site? What is the first thing you looked at? What is the first thing you would like to click on? Why?
Computer Set Up
Before the testing session starts, I make sure that I am ready to go. I use two monitors which makes the process easier for me (but it is not necessary for this to work).
My computer (with the camera I’m using)
- Test Script — I use this like a cheat sheet to look at the participant while asking questions or speaking through their tasks.
- Zoom — As I am reading the script or asking follow up questions, I glance at the participant to pick up non-verbal cues. This is something easily done in person, but can be challenging in a remote environment.
Second Monitor
- Prototype — This is the screen I share with participants and give them control over. It helps the participants to be more comfortable because I am not staring at them (looking at the camera) while they are working through the prototype.
If you don’t have two monitors I would recommend printing the test script, and use split screen with your prototype and zoom.
Testing
During the meeting, be calm because the participant will pick up and reflect your energy. The participant has likely never done a remote usability test either.
Note Taking
- Screen Recording — I find the most value in video recording because I can review the user, their touch points, and their audio all within the same screen recording.
- Note Taking — To make note taking easier on myself, I make sure that prior to testing I have a numbering system to the tasks so that I can organize my notes accordingly.
Technical Difficulties
During the meeting, be prepared to face technical difficulties. Be sure to test everything (Prototype, Video, Audio, Screen Sharing, Changing Screen Control and Recording) prior to your testing session to limit any technical difficulties from your end of the call.
My most recent difficulty was a participant was able to see but unable to control the prototype screen I shared with them. My solution was completely improvised.
I asked them where they would click given the prompt and why? I went ahead and clicked where they asked throughout the entire usability test.
A benefit I found was more dialogue and I better understood every choice the user made, which may not have happened if it was in-person.
Accessibility and Diversity
As with any testing method, it is important to evaluate the methods used by testing goals. Remote usability testing may not be the best for your product or it may need to be paired with other methods to reach your testing goals.
Accessibility
I think this method of usability testing would not be possible for participants who use Assistive Technologies. Rebecca Topps wrote a great article about key considerations for remote usability testing for accessibility. I have also included resources to help aid you in choosing a different test method.
- Screen Readers (Mobile & Desktop)
- Navigate using keyboard only (Try just using your tab key and up and down arrows to navigate)
- Switch Control
Diversity within Participants
I have found as a one person team, it’s easier to recruit participants that I am comfortable with like my friends and family — even though I know many demographics are being left out of the equation.
I recommend to use remote usability testing to feel more comfortable and confident when conducting remote usability testing. I have used it to find participants in different geographic locations, ages, races, education levels, wealth to create a more accessible product.
Thank you for reading!
Want to learn more about me? I’m Jessica, a Budding Product based out of NYC. I am currently looking for a new challenge where can apply design thinking and contribute to a design team.
