Remote user testing also works well with quantitative testing because it allows you to get data from a large sample size of test participants. If you’re doing a moderated usability testing, you have the opportunity to follow up on anything the participant does that you find interesting. 2. Because of that, we’re usually asking about a participant's understanding of the content, how they would like to adjust it, and their ability to navigate it. During a moderated test, you are live, “on the line” with your test participants, guiding them through the tasks, answering their questions, and replying to their feedback in real time. Questions are a way to get more feedback out of your remote usability test. You also don’t need to schedule or attend the test yourself, so more tests can be completed in less time. Discover the latest news, product updates, and user research insights from Maze. All this is vital for getting the most out of each testing session. Virtual usability testing is open to all SAP Customers and Partners. Test for free or hire from our curated 70,000+ testers panel. The number one rule of usability test questions is no leading questions. To find out more about your participants, you have two types of user testing questions at your disposal: demographic questions and background questions. Instead, you should carefully word your questions so they’re neutral and open. Use this to your advantage by asking specific questions based on user behavior: However, just because you’re moderating the test, that doesn’t mean you should bombard the participant with questions throughout the test. Why did you go with that option? ... we can ask someone on the other side of the world the same quick questions. Even if you’ve gone for unmoderated testing, usability testing software like Maze lets you ask research questions before and after each task and at the end of the test. Once you start working on your design, conducting short, sharp remote tests to validate specific design features ensures your iterations are always backed by data. How experienced/comfortable are you with using an application to do [X action]? Compared to remote … That being said, it’s time to have a look at the types and examples of ready-to-use usability testing questions. It’s a tried-and-tested usability survey that’s frequently used to measure product usability. You create a test … I see that you [X]. Align with your team on decisions and build better products. On the other hand, the unmoderated approach requires questions to be written in advance. Align with your team on decisions and build better products. And that includes testing your usability test. First, your results will lack the detail and depth you need to make improvements—if a participant is struggling with specific tasks, you need to know why. First, focusing your test on a few hypotheses will make your results much clearer one way or the other. And since the tests take more work to schedule, you might want to dig a little deeper to make the most of each one. You have probably already prepared everything in the user testing tool of choice, but also make sure other tools like video conferencing or note-taking apps are set up properly before you start the testing session. This is a massive benefit over in-person testing, as you can test a lot more people in a lot less time—and with way less effort. Using a standardized format with rating scale questions is a good way to gather quantitative data on the overall usability of your designs—particularly important if you’re at the summative testing stage. So it’s tempting to take people up on their offer to participate as soon as you find them. Phone interview. Moderated tests can be a little more complex, as you can have full conversations about what people are finding difficult and make notes on how they get stuck. Moderated + remote usability testing. And since they’re easy to create and distribute, unmoderated tests are particularly useful for frequent testing if you’re short on time or money. Remote usability tests are done over the internet or by phone; in-person testing, as the name suggests, requires the test to be completed in the physical presence of a UX researcher/moderator. Here’s a few places to start your search: Whatever method you try, start building a pool of users ready for testing as soon as you need them. What features would make you more likely to use this product more. Traditionally, usability testing is used to achieve the following goals: Depending on the type of testing you’re doing, you might also want to conduct a more formal post-test UX survey. Make sure your product is easy to use when it’s released by completing a series of remote user tests. What made completing this task a good experience? (1 = not user-friendly at all, 10 = super user friendly), How was the process of making an order? Well-written and structured usability tasks will get you more accurate results. Remote usability testing lets you do this type of task-focused testing quickly and cheaply. However, it’s also important not to ask too many questions so the participant can complete the test with minimal distraction. Participants can take remote tests on their devices in their free time. Remote usability testing isn’t less work than in-person testing, it often requires more planning and more communication. Remote testing has increased in practice with the advancement of technological innovation and is facilitated by online tools. Getting off to a positive start will help your participants feel relaxed when it comes to taking the test. Remote usability tests are like traditional usability tests with one key difference: the participant and facilitator are in two different physical locations.Rather than the usability expert going … Which parts of the website do you use most often? Second, the shorter the test, the more likely the user is to finish it. Finding users is the biggest potential bottleneck for remote research. What’s your opinion on the way features and information are laid out? The downside is that it still requires a level of commitment on the user’s end—they have to do the test at a certain time with a specific setup, and the extra questions make it a more time-consuming experience all round. Questions are one of the main techniques UX researchers have to interact with real users—so use them wisely. The SUS even gives your product a usability score at the end. Remember that one of the main benefits of remote usability testing is being able to test with large sample sizes. Services like and TryMyUI have panels of people who take occasional usability tests from their home or office for $10 a session. One usability testing best practice is to test people who resemble your target audience, as this will give you an accurate idea of how to improve your design from real potential users. Giving people fewer options lets you pinpoint design decisions and test them more rigorously. For a quantitative, time-saving approach, try unmoderated remote testing. Asking demographic questions carefully avoids making assumptions about people by mistake. Finding new participants online is less time-consuming and cheaper than finding participants for in-person testing. And because in-person, moderated usability testing can get resource-intensive quickly, many design teams turn to more cost-effective methods such as remote, unmoderated usability testing. Here’s a few examples of well-worded demographic questions to ask as part of your user research. Finding participants for user testing can be tough. Follow up with participants after each task to get people’s opinion on specific design elements, or ask general questions at the end of the test to get qualitative feedback. While every usability study used to take place in person, these days technological advances have made unmoderated tests a viable way to get results fast. Can you explain why you did that? You never know—they might say something that sparks an idea for the next big feature. The type of questions you should ask are generally similar regardless of your testing process. How have you seen [content] … How you write and structure the tasks will largely determine the success of your remote usability test. Hope everyone is staying safe. Also, the user doesn’t need to trek to your office. You need to recruit test participants, set up a testing environment, prepare task scenarios, fill out paperwork, and much more. Here’s a few examples: Finally, using simple and straightforward language is always best practice with any usability test—but it’s especially important when you’re writing questions for unmoderated testing. Unless conducting user tests at 3 am is your thing. You create the tasks and write the questions in a usability testing platform like Maze, send them to users, and then they complete the test alone. Get actionable insights on your prototypes fast, early and often. Get as much background info as you need, practice your wording to avoid leading questions, and think about the type of data you want to come away with at the end. Let's look at what remote usability testing is and how to best use this UX research method for improving user experience. Usability testing is a research methodthat helps you understand how well users interact with a product in order to improve the overall experience. Why? A remote moderated usability test is when a moderator provides participants with activities to complete using a design or interface. And outside the usability test itself, questions allow you to know the person behind the user. Understanding the top usability testing methods, Guerrilla usability testing: Quick and easy usability testing, How to ask effective usability testing questions, 3 real-life usability testing examples based on actual products, Usability testing tools: Choosing the right one for you, Reporting usability testing results and findings. Finally, it’s crucial to conduct a pilot for unmoderated remote tests to make sure the way you wrote the tasks is crystal clear. Did you notice that there was an alternative way to do [X]? So you’ll probably get fewer takers, and they all need to be in your timezone. There was no such thing as 'in-person' or 'remote' usability tests, as everyone had to be in the same room to do any kind of UX research. 18-24, 25-30, 31-40, etc. Remote usability testing piloted at this year’s virtual SAPPHIRE NOW and ASUG Annual Conference. Read our best tips and guides on how to get the most out of Maze. Get people from different teams to try it out, as copywriters will see it with different eyes to the customer success team. Reach out to specific segments of users in your email list who’ll be interested in testing a feature that’s relevant to them, Create a pop-up on your site or in-app asking people for their feedback, Post on social media to give your fans a chance to shape your product, For new product releases, encourage early email subscribers to become beta testers, If you lack time and users, you can hire test participants from a usability testing tool that has a. If you're running an unmoderated test, send it in batches—not all at once. To really see the benefits of remote usability testing, you have to set up your test in a way that’ll get actionable results. So start looking as early as possible and make sure you've got a list of test participants that are open to giving you feedback for when you need to start testing. How Remote Usability Testing Works. Nowadays, it's not uncommon for remote testing to be the preferable route to take. We recommend seven or eight tasks for unmoderated remote usability tests. Remote usability testing is currently gaining popularity among both big and small businesses. 6 tips for creating an effective remote usability test, find people willing to take remote usability tests, Well-written and structured usability tasks, Finding willing participants is much easier, as users can take the test whenever they want, wherever they want, It’s faster and cheaper to do quantitative usability testing, so you’re more likely to get statistically significant results, You can test your design on a wider range of people from different parts of the world. Taking the remote approach to usability testing comes with some big pros: Some of the typical advantages that people see with remote usability testing are a broader and often a more diverse population to recruit from, rather than just the people who are near your office and can leave work in the middle of the day. In a usability-testing session, a researcher (called a “facilitator” or a “moderator”) asks a participant to perform tasks, usually using … Moderated tests work much the same as traditional in-person usability tests, except the moderator and the user aren’t in the same room. Moderated remote tests can be less focused, but the same principle applies. While moderated usability testing is undeniably useful it … Because while it’s definitely easier to find people willing to take remote usability tests than in-person ones, it still takes time, especially if you need users with a particular background or job title. The earlier you find the right target audience, the earlier you can start testing in the design process. Colleagues outside your own team will also experience it totally fresh, so their perspective will be closer to your users’.If you're running a moderated test session, make sure your internet connection works well and your setup is ready. Here’s a few examples of questions you should not ask during a usability test: By using words like ‘simple’ and ‘clear,’ you can unintentionally plant ideas into the participant’s head. Understanding the top usability testing methods, Guerrilla usability testing: Quick and easy usability testing, How to ask effective usability testing questions, 3 real-life usability testing examples based on actual products, Usability testing tools: Choosing the right one for you, Reporting usability testing results and findings. For example, when running remote unmoderated testing, if a task is unclear, you can’t be there to explain it in more detail and move them in the right direction. It’s important to let the user feel relaxed and complete the test in their own time, so test conditions more accurately reflect a natural situation. Here are some background questions to ask your participants: By deploying the right demographic and background questions pre-test, you make sure you choose the right test participants, and you’ll have more information with which to analyze your results afterwards. To minimize these risks, write some introductory context and guidelines at the start of the test, so participants know what to expect. The time between creating the test and getting results is much shorter, which means your team can get data-driven design insights very fast. The wording of your questions has to be very precise for remote user research because you only get one shot. Event: SAP Usability Testing Testing Dates: December 8-10, 2020 Location: Online Remote Usability Testing Sessions Via Zoom Prerequisite: You do not have to be registered as an UKISUG Digital Connect attendee to participate. In general, usability testing follows the law of diminishing marginal returns: each additional test result provides less new insights than the one before it.
2020 remote usability testing questions