Asynchronous remote usability test

When is this method appropriate?

The asynchronous remote usability test is especially qualified if you would like to test your website with larger samples. The procedure does complete the classical usability test in laboratory in a very good way. This test can take place before or after a lab test.

Remote usability tests enable to comprehend the click behaviour while using an internet offer. They are comparable to classical web-analytic tools. In addition, it is possible to implement a survey before, during or after the site usage. Furthermore, the attendees can comment single sites during the site usage. It is possible to complete users’ pure behaviour data with opinions, ratings and comments. This combination of quantitative data and qualitative data facilitate the interpretation of the quantitative data.

Possible questions

• Where is potential for improvement on your website and where on your website are the users optimally supported?
• How do users rate the design and layout of site elements?
• Processes: where on your website and where during the operating process do users drop out operating processes (for instance order process in an online-shop) and why?
• What website design version functions in a better way?
• Are there any differences between the behaviour of different user groups which should be considered?
• How do users use your website and what are their intentions?
• Where is your offer compared to your competitors?

And many more…

In what project phase applicable?

• Development/conception
  At early time the asynchronous remote usability test can examine if layouts, concepts and prototypes or click-dummies are favoured by users. With the aid of clickable high-fidelity prototypes navigation structures and concepts can be task-based tested.
• Implementation/programming
  A final usability test (in the meaning of a release test) can be implemented as an asynchronous remote usability test and provides time and cost efficient data of a big sample.
• Live Activity/usage
  During the activation of your website an asynchronous remote usability test offers you a variety of possibilities: permanent analysis of processes or process flows, identification of critical events, comparable studies with your competitors (benchmarking).

What is the procedure of this method?

The tool which was developed for the implementation of this test unifies scattered aspects from the usability test in laboratory, the online survey and the focus groups and offers comprehensive insights into the user experience of your website. The test subjects use the website or the prototype from home or work. Hereby it is possible to “pick up” the users at certain areas of your website e. g. to interview and observe them during an order process (for instance overlaying of a question or a questionnaire referred to done actions).

Recruiting test subjects can be done by a panel, email lists or live by a layer on your website. The test subjects can be lead through your web offer by little tasks and questions. The tool collects mouse clicks and navigation paths (visualised by click streams and by screenshots) as well as the answers and the subjects’ comments. Already here it is possible to record interactions with flash-objects or ajax-applications. All these data are descriptively illustrated and collected for further examinations.

Strengths of this method

• It is possible to use relative big user groups for this study.
• The user can attend from home or work. By this hardly contactable user groups can be used for this test.
• Recording of interactions with flash and ajax is possible.
• Qualitative and quantitative data can be ascertained. So a comprehensive understanding of the test subjects (their actions and intentions) is possible.
• “True intent studies” can be implemented. Hereby the survey of the attendees takes place by certain actions (for example calling a particular website) and the test subject can be observed during the real interaction. That means we do not recruit any users from our panel but actual users of your website.

What about the sample size?

The sample size should be individually discussed related to your questions. With the asynchronous remote usability test it is possible to create sample up to 500 test subjects.

How much time takes the implementation?

The duration of the data ascertainment depends on the number of study attendees. If the attendees are live recruited on your website, the traffic on your site has to be considered. In average the implementation of such a study (ascertainment und evaluation) takes about 3 to 4 weeks. If the test is based on our online-access-panel bonopolis.de, we already have data and recommendations after 2 weeks.

What input do you have to provide?

Optimally you come to our premises with concrete questions and/or site areas which we can carefully examine and thematise during the evaluation. We would like to work out with you this kind of questions. Thereby we draw on our comprehensive project experiences.

If you want to implement an asynchronous remote usability rest during the concept phase, we give you appropriate materials. Screens or wireframes (schematic illustration of a website) can already be rated by test subjects. To implement a task-based user test for high-fidelity prototypes (graphical and functional click-dummies) we need an object which is able to go online and which has enough functions.

What do you receive from us?

You receive an interpretative result report with the following contents:

• Management summary
• Detailed illustration of the results which base on survey data.
• Interpretation of the data: identification of the reasons and causes for the ascertained data.
• Concrete guidance to remedy identified usability and design problems, verbal described or visual-functional implemented (for example in terms of optimised wireframes or clickable prototypes).

On demand we present the results and findings of the test within a moderated workshop. In addition, it is possible to have a look at the to date ascertained data during the current study.

Do you have any further questions? Please do not hesitate to contact us! We would like to consult you.