Designing a scalable reporting system for a safe Wikipedia.

I joined the Trust and Safety Tools team in July of 2022 and led the design of the Incident Reporting System, a complex, multi-year project.

Team

The Trust and Safety Tools team at the Wikimedia Foundation creates tools for the Wikimedia open-source community by collaborating with the Trust and Safety policy department.

Objectives

  1. Design an MVP that allows users to report harassment to Administrators
  2. Test MVP on pilot wikis
  3. Release and seamlessly integrate with all other wikis

Long term vision

Untitled

Designs

Mobile designs for the Incident Reporting System

Untitled

1️⃣ The person facing harassment wants to report the message. They click the overflow button next to it and select 'Report.' Given the system's deployment across 300 wikis in diverse languages, I focused on simplifying the user experience and UX copy. This meant ensuring adaptability for longer text languages.

Untitled

2️⃣ After clicking 'Report,' users access existing resources. This step aims to leverage community-created tools, policies, and norms designed to help editors resolve conflicts collaboratively. By introducing this step, we seek to discourage reports for mere disagreements and guide editors dealing with aggressive behavior rather than abusive conduct.

Untitled

3️⃣ On this page, users encounter a pre-filled form. In designing it, I considered the information architecture—prioritizing what the user sees first and streamlining the process, especially for those in distress. Given Wikimedians' tendency for verbosity, including features like a harassment link and word count was essential to manage potentially lengthy reports.

Untitled

4️⃣ After submitting, they receive a success message! Future versions will include features like report preview and progress tracking. Our team's focus is on implementing and testing the MVP quickly, gathering community feedback, and iterating for further improvements.

Desktop designs for the Incident Reporting System

1️⃣ The desktop design for when a user is harassed on their User Talk page.

1️⃣ The desktop design for when a user is harassed on their User Talk page.

2️⃣ The user undergoes a brief, 2-step process. In the first step, they receive resources to address harassment independently. If they choose to file a report, they can click the button in the bottom right of the dialog.

2️⃣ The user undergoes a brief, 2-step process. In the first step, they receive resources to address harassment independently. If they choose to file a report, they can click the button in the bottom right of the dialog.