Related links: Protocol | T298978

Contents

1. Recommendations
2. Observations
3. Participants
4. Analysis of tasks (Jazmin)
5. Analysis of tasks (Robin)

1. Recommendations

1. For onboarding / language
   • Keep onboarding tooltips visible when scrolling. Only proactively tapping “GOT IT” should dismiss the tooltip.
2. Reading focus mode
   • Make sure the Reading focus mode setting completely hides edit pencils, without having to refresh the screen (some participants experienced this)
   • ADD ARTICLE DESCRIPTION, ADD IMAGE CAPTION, ADD IMAGE TAGS CTA’s should be hidden when reading focus mode is enabled
3. Customize toolbar
   • Make sure the entire list item is draggable not only the icon on the right. Alternative concepts if this is not feasible:
     • Show a tooltip when users try to drag and drop the label instead of the icon
     • If tooltip does not improve the situation → consider moving towards a pattern that does not rely on drag on dropping, e.g. numbered checkboxes
   • Terminology: Users don’t get the current wording ‘Actions and Destinations’, change the copy of the detail screen to: Customize the bottom toolbar with 5 quick links you find most helpful.
   • Add a an additional, sixth ‘More’ menu item to the bottom toolbar
     • Currently the feature is hard to discover inside of Theme
     • In addition, participants had a hard time connect the items in the toolbar and the overflow menu. People had issues finding links that have been moved out of the toolbar.

Observations

What works?

1. Onboarding / language
   • Tooltip is displayed for all participants
   • One candidate (FR) appreciated the full screen onboarding when editing article descriptions for the first time. This should be explored further in onboarding and guidance phase (T301397)
2. Reading focus mode
   • Reading focus mode disabled by default as participants learned how it works
   • 4/5 understood what the reading focus mode setting does, understood differences when the mode is enabled
   • 5/5 had no issues going back to editing after turning on reading focus mode
   • 4/5 like the ‘Reading focus mode’ feature
3. Customize toolbar
   • Once arrived in the customization screen, 5/5 understood what the screen does.
   • 5/5 figured out how to drag&drop items (but 3/5 were dragging the labels first)

What doesn’t work?

1. General / Onboarding / Language
   • Tooltip wasn’t noticed by 4/5, participants scrolled and the tooltip disappeared
2. Reading focus mode
   • Likely related to the tooltip that disappeared → 3/5 participants had issues discovering the ‘Reading focus mode’ setting
3. Customize toolbar
   • Language: ‘actions and destinations’ in the task was confusing to almost all participants
   • Discovery: All participants had issues finding ‘Customize toolbar’
   • Interaction: 3/5 participants wanted to drag&drop the label on the customization screen in order to move items.
   • 3/5 had issues finding items in the overflow menu after moving them out of the toolbar (they had troubles making a connection between the toolbar and overflow menu)