Introduction

Background

Based on the original design for Geo-fence, an engineer provided feedback that he could not determine how to preview the map and what the eye icon represented. To solve these problems, I created “Design B.” The new design looks quite different than the original design, so I wanted to compare them to see which is more user-friendly. Our product wants to help users to save their time during the operation process. Therefore, time spent and misclick rate are two important indicators to evaluate our design.

The purpose of this experiment is to verify the following: (1) that Design B performs better in map preview than Design A, (2) that Design A and Design B have the same level of performance in checking devices and editing information, (3) and that Design B has greater overall usability than Design A.

Design A

Design A

Design B

Design B

Methods

Participants

The participants were twenty-one native English speakers with ages ranging from 30 to 50. It's a between-subjects experiment design, which means each participant only interacted with a single user interface. Ten participants interacted with Design A while the other eleven participants interacted with Design B. After finishing the experiment, they each received $3 for their participation.

Materials

(1) lihi.io

The lihi.io is a shortened URL service for A/B testing. It randomly assigns participants into different destination URLs, and repeat users will return to their assigned destination page.

(2) Maze

The Maze is an online user testing platform that provides actionable insights for prototypes, bringing confidence to the design process.

*Misclick rate: Participant clicks on another hotspot than the expected ones. This means the user got off the expected path(s), which in a live product results in frustration or a lost user.

*AVG time: If participants spent too much time on a screen indicates something is wrong and needs to be improved.

*Success rate: **** If participants give up on a mission indicates something isn't right and should be checked.