<aside> 💡 The test analysis below has been compared with Usability tests – talk pages (before)

</aside>

Phabricator: T321261

Table of contents

1. Participants

• AR Female (21, Morocco)
• FR Female (29, France)
• HI Female (21, India)
• JA Female (24, USA)
• ID Male (27, Indonesia)

2. Summary

😍 – What works better than before?

1. Understanding of article talk pages: 5/5 understood that article talk pages are about discussions related to the article. The more conversational design we choose seems to work.

   article-talk-pages.mp4

2. Understanding of the diff view: 4/5 understood what the diff is all about. The recent design updates improved understanding. The strike-through and summary design updates for additional clarity made a difference.

   CleanShot 2022-10-14 at 17.25.42-converted.mp4

3. Performance: There were drastic improvements in the perceived performance when publishing messages. It much more feels like instant publishing than before.

   CleanShot 2022-10-17 at 14.51.30-converted.mp4

4. Orientation: People navigate and orient themselves perfectly in the new modernized interface for talk pages. The continuity between the notifications home page and talk pages works. Comparing it with the before state, the new design has been a huge improvement.

   CleanShot 2022-10-17 at 15.00.06.mp4

5. Notifications discovery: 5/5 had no issues finding notifications.

   CleanShot 2022-10-14 at 17.15.49-converted.mp4

😡 – Where is room for improvement?

1. Talk page discovery:

   • Problem: Participants associate Wikipedia mainly with editing articles, also when asked to discuss edits. They had issues finding the talk page entry point. Most used the edit pencil.

     CleanShot 2022-10-14 at 17.35.16-converted 2.mp4

   • Solutions:

     1. Add the “Discuss edits” item to the menu when tapping the first edit pencil

        

     2. Add a discovery tooltip for the talk pages option in the overflow menu

     3. Introduce the talk page bubble next to the article title (T296084 | Figma)

     4. Introduce it as a default in the bottom toolbar

        

2. Orientation

   • Problem: Certain notification types take users outside the app with a different design (e.g. Wikimedia Commons). This confused participants.

     CleanShot 2022-10-14 at 17.43.20-converted.mp4

   • Solution: Make sure to keep users in the app at all times when they tap notifications (use mobile web view. In the test, notifications coming from Wikimedia Commons took users outside the app.