Pymetrics

Services User Acceptance Testing

Timeframe December 2020

Pymetrics

Project #

Pymetrics is a series of behavior-based neuroscience games that objectively measure cognitive, social, and behavioral attributes.

In February 2020, I conducted User Tests on four use cases with several sub-tasks on the Pymetrics website and native iOS app.

Objective #

The purpose of this testing is to perform User Acceptance Testing to determine if it is possible for a visually impaired person using a specified screen reader and browser to complete these tasks. This testing focused on the screen reader user experience. It did not focus on finding WCAG failures.

Work #

Use cases:

  1. Registration
  2. Privacy Consent
  3. Welcome Screen/video
  4. Game Configuration

Tools used for the website UAT:

  • Assistive Technology - NVDA 2019
  • Browser - Firefox (version 72)
  • Operating System - Windows 10

Tools used for the iOS UAT:

  • Assistive Technology - VoiceOver
  • Browser - Pymetrics native iOS app
  • Operating System - iPhone X

End Result #

The results for the UAT for the Pymetrics website demonstrated that use case #1 (Registration) and #4 (Game Configuration) had minor to moderate issues, whereas use case #2 (Privacy consent) and use case #3 (Welcome Screen/video) had more serious usability issues to address.

The results for the UAT for the Pymetrics native iOS app demonstrated that all of the use cases - #1 (Registration), #2 (Privacy Consent), #3 (Welcome Screen/video), and #4 (Game Configuration) - had only minor to moderate usability issues.

Team #

The team for this project included one representative from Pymetrics, plus a project manager, QA contractor, and a developer from Deque. I was responsible for the testing and creating the UAT report based on workflows created by the client and our group from Deque.

Reflection #

This project was the first UAT I conducted using a native mobile app. While there were a lot of similarities between the website and the iOS app, there were some differences in the platforms that I needed to consider during the testing. It was important to distinguish which issues were based on the product being built in a certain way versus user inexperience testing with the platform.