Perhaps you recently booked a test and are wondering why not all the videos are there yet. Or maybe you are pressed for time and want to make sure you get your results as quickly as possible.
When tests take a long time to fill up, it is often due to the following reasons:
- The target group is very specific.
- For live sessions: There are not enough dates to choose from, or the dates are at inconvenient times.
- The requirements are not clear or are too extensive.
- The soft launch is activated.
Here's what you can do to fill your test quickly
Choose the broadest possible target group
Although our panel is large, it consists mainly of fairly average internet users. Broad target groups can therefore be recruited more quickly than target groups with very specific requirements.
However, most usability problems are found by everyone. Therefore, ask yourself how precisely your target group needs to be defined and whether you could define it a little more broadly.
For example, do the test subjects really need to be currently looking for a new car, or is it sufficient if they have purchased a car in the last five years?
Often, a vividly worded scenario is more important in helping test subjects put themselves in the situation than having them fit perfectly into the target group.
Of course, a very specific target group may be necessary for very specific questions, but in that case, simply plan more time for the test.
Sometimes, a really specific target group might be needed for very specific questions, in which case you should plan more time for the test.
Write the requirements simply, clearly, and as concisely as possible
The specific characteristics that you enter in the input field when booking the test will be passed on to the test subjects exactly as you have entered them. It is therefore important that they are worded as simply and concisely as possible, e.g., “You own a house or an apartment” instead of “You have residential property.”
Also, avoid UX-specific technical terms such as “Figma prototype” or “hamburger icon.”
Write the requirements from the testers' point of view, like “You own a house” instead of “I'm looking for homeowners.”
For better readability, format the requirements as a list and don't use more than 3-4 bullet points.
More testing is done in the evenings and on weekends
If you create your unmoderated test in the afternoon, it will often be full by the next day. Also, if you create it on Friday, all the videos will usually be there by Monday (if you follow our other tips).
Provide as many time slots as possible – even outside normal working hours
For moderated tests, you should provide significantly more time slots than you have test subjects booked. The more choice the test subjects have, the more likely it is that one of the appointments will suit them. Of course, we only charge for as many test subjects as you have booked, regardless of how many available time slots you specify.
Also keep in mind that most of our test subjects have jobs themselves and therefore cannot necessarily participate in tests during average working hours. Therefore, see if you can also offer test appointments in the morning, late afternoon, or evening.
Deactivate soft launch
When booking, you can choose whether you want your test to start immediately with all test subjects (full launch) or whether you would prefer to start with just one test subject to see if everything works and then invite the other test subjects (soft launch).
Soft launches naturally result in a delay, as you have to manually approve the test after reviewing the first video. If you need quick results and are confident that your product works technically, and your test concept is easy to understand, select Full Launch when booking your test:
If you want to play it safe and choose the soft launch, be sure to keep an eye on the test and activate it immediately once you have reviewed the first video.
Unmoderated vs. moderated
The most important thing is, of course, which method is best suited to your question. However, if your questions can be answered satisfactorily without a moderator and you need quick results, you should opt for unmoderated tests.
Mobile vs. desktop
Tests on mobile devices are usually completed faster than desktop tests. Therefore, consider whether the device on which your test is conducted is relevant to the results. If not, then choose exclusively or at least more mobile testers.
Test without a webcam (unless absolutely necessary)
Experience shows that tests without a webcam are completed much faster, and for many questions it is not necessary to observe the test subject's gestures and facial expressions. Especially if you have a test object, i.e., the testers are sharing their screen, it is much more important to observe what is happening there. A webcam can even be distracting or misleading in this case.
Conclusion: Check your target group and testing method
So, here's a rule of thumb for getting test results fast:
For each test, think about which target group restrictions you can leave out and whether you've picked the right test type for your questions.