Schedule Time & Gather Materials
- Time for Testing: 2 Days
- Time for Analysis: 2 – 4 Days
- Access to a remote testing service
- Links to your live site as well as competitors’
Carry Out This Method
- Determine the key performance metrics you want to test. Depending on your industry or specific service, you may wish to test task times, user satisfaction, or conversion rates.
- Write your test scenarios and tasks. They must be applicable or mostly applicable to all sites being tested.
- Conduct a Usability Lab Test in which you test each user with 1 task on three sites, or two tasks on two sites. Any more than 3 or 4 tasks may overwhelm users or require too much time.
- Collect data from users. Analyze them with a focus on success metrics. Determine where you fall short of industry standard and where you succeed.
Try These Tips
- See Remote Testing for links to remote testing tools. We recommend one with video documentation so you can check for user comments or manually check task times.
- You can use a lab test methodology rather than a remote test to get more qualitative feedback. This will restrict your ability to test multiple competitors with as many users as you might like, however.
Explore More Resources
- Nielsen Norman Group: Competitive Usability Evaluations: Learning from Your Competition
- MeasuringU: 10 Best Practices for Competitive UX Benchmarking
- UserZoom: Competitive UX Benchmark Studies: Win Customers by Staying Ahead of the Competition
- Nielsen Norman Group: Redesigning Your Website? Don’t Ditch Your Old Design So Soon
- Usability Testing: Benchmarking & Competitive Analysis