{"id":332,"date":"2016-09-26T15:57:00","date_gmt":"2016-09-26T15:57:00","guid":{"rendered":"https:\/\/staging.infragistics.com\/blogs\/?p=332"},"modified":"2025-02-26T09:26:51","modified_gmt":"2025-02-26T09:26:51","slug":"pilot-test","status":"publish","type":"post","link":"https:\/\/www.infragistics.com\/blogs\/pilot-test","title":{"rendered":"How To Conduct a Pilot Test First Effectively?"},"content":{"rendered":"\n

It\u2019s a rehearsal of the study with someone standing in as the participant. You run the session as if it was with a real participant, but you throw away the data. The purpose is to see if there are any problems with your technique and also to get some practice with the procedures involved. Afterwards, you can make changes to your technique and discussion guide.<\/p>\n\n\n\n

\"MobileTabletTesting4\"<\/a><\/figure>\n\n\n\n

What Problems Do Pilot Tests Find?<\/h2>\n\n\n\n

Pilot tests help you find problems in your research plan and methods, including:<\/p>\n\n\n\n

    \n
  • Do the participants understand what you\u2019re asking them to do?<\/li>\n\n\n\n
  • Does the phrasing of tasks give away the answer?<\/li>\n\n\n\n
  • Are your questions or tasks biased?<\/li>\n\n\n\n
  • Do your questions or tasks elicit the kind of information you need?<\/li>\n\n\n\n
  • Are there repetitive or unnecessary questions or tasks that can be eliminated?<\/li>\n\n\n\n
  • Can the tasks be completed in the prototype, or are certain screens, states, or interactions missing?<\/li>\n\n\n\n
  • How long does the session take?<\/li>\n<\/ul>\n\n\n\n

    Choosing the Pilot Test Participant<\/h2>\n\n\n\n

    For some studies, you can use just about anyone as a pilot test participant, such as a coworker, friend, or relative. For example, if you\u2019re doing a pilot usability test of a general, consumer-facing website, such as a travel booking site, you could use just about anyone. They don\u2019t have to have any special knowledge or experience.<\/p>\n\n\n\n

    But for some tests, it\u2019s best to get a pilot test participant who closely fits the profile of the actual participants you\u2019ll be using. For example, if you\u2019re conducting usability testing of software used by tax accountants, it\u2019s ideal to get a pilot test participant with the domain knowledge that\u2019s needed to use that application. Even for something that seems simple, such as a study of people using a car buying website, it\u2019s best to have a pilot test participant that fits the user profile of people who are considering buying a car in the next three months. If your questions have a lot to do with the motivation of car buyers and how they use the site, you\u2019ll get very different answers from someone who doesn\u2019t fit the profile. In these situations, if you use a pilot participant who doesn\u2019t fit the profile, you won\u2019t get a good sense of whether the questions are relevant, produce interesting discussion, or how long the session will take.<\/p>\n\n\n\n

    Can\u2019t Your First Session Be the Pilot Test?<\/h2>\n\n\n\n

    If you don\u2019t specifically conduct a pilot test, then your first session becomes<\/i>a pilot test. That\u2019s where you\u2019ll find the problems with your method, the tasks, and the questions. The problem with waiting until your first participant to find the problems, is that you won\u2019t have much time to make changes before the next session. You may be able to make minor changes in the brief time between the first and second session, but it will be too late to make major changes.<\/p>\n\n\n\n

    The Ideal Pilot Test<\/h2>\n\n\n\n

    Ideally, conduct the pilot test at least a day or two before the first session. Recruit an extra participant, who matches all the screening criteria, to perform the pilot test. If everything works out well, you can keep that person\u2019s data. If you find problems, you can correct those before the official research sessions begin.<\/p>\n\n\n\n

    Test New Research Activities<\/h2>\n\n\n\n

    Pilot testing is always useful, but it\u2019s especially important when you\u2019re going to try a new technique. For example, I once conducted a group workshop in which we had the participants divide into small groups to illustrate their work processes on post-it notes. We found that it was too difficult for them to do this together as a group activity. They ran out of time, and it wasn\u2019t the best experience. For subsequent workshops, we had each participant work individually to illustrate their own work process, which was much easier and more effective. In effect, our first workshop was successful as an unintended pilot test. However, it would have been much better if we had planned it as a pilot test with a smaller group of participants.<\/p>\n\n\n\n

    Why Pilot Tests Are Important<\/h2>\n\n\n\n

    You never quite know how well a research study will go, until the first session. It\u2019s much better to work out the kinks in a pilot test than in the first session. Sure, you can sometimes get away skipping the pilot test, and everything works out fine. But it\u2019s those times when things go wrong, which could have been found earlier, that you\u2019ll wish you had conducted a pilot test first.<\/p>\n","protected":false},"excerpt":{"rendered":"

    Before beginning a user research study or usability test, one of the most important things you can do is to run a pilot test. What\u2019s a pilot test?<\/p>\n","protected":false},"author":88,"featured_media":2370,"comment_status":"publish","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[17],"tags":[],"class_list":["post-332","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-how-to"],"_links":{"self":[{"href":"https:\/\/www.infragistics.com\/blogs\/wp-json\/wp\/v2\/posts\/332","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.infragistics.com\/blogs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.infragistics.com\/blogs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.infragistics.com\/blogs\/wp-json\/wp\/v2\/users\/88"}],"replies":[{"embeddable":true,"href":"https:\/\/www.infragistics.com\/blogs\/wp-json\/wp\/v2\/comments?post=332"}],"version-history":[{"count":3,"href":"https:\/\/www.infragistics.com\/blogs\/wp-json\/wp\/v2\/posts\/332\/revisions"}],"predecessor-version":[{"id":2472,"href":"https:\/\/www.infragistics.com\/blogs\/wp-json\/wp\/v2\/posts\/332\/revisions\/2472"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.infragistics.com\/blogs\/wp-json\/wp\/v2\/media\/2370"}],"wp:attachment":[{"href":"https:\/\/www.infragistics.com\/blogs\/wp-json\/wp\/v2\/media?parent=332"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.infragistics.com\/blogs\/wp-json\/wp\/v2\/categories?post=332"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.infragistics.com\/blogs\/wp-json\/wp\/v2\/tags?post=332"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}