Transcript of Lies: Detective Mystery Game

Bridging Gaming and Accessibility Through Speech-to-Text Technology

Transcript of Lies is an interactive detective mystery game that combines engaging gameplay with accessibility education. Players step into the role of a detective investigating the disappearance of scientists, using a speech-to-text device as their primary tool for gathering and interpreting clues.

Client

Academic Group Project

Services

Speculative Design

XR Prototyping

Product design
Interaction Design
User Research

My Role

Lead Developer & Designer (Primary coder with AI assistance)

Date

Feb - April 2025

PROBLEM

General public lacks understanding of communication challenges faced by speech-to-text users. STT technology has significant accuracy issues with accents, dialects, and environmental noise, requiring users to develop complex error-correction strategies that most people don't realize exist.

SOLUTION

Transcript of Lies

Created a detective mystery where players experience STT challenges firsthand. Detective steps in green substance that simulates speech processing difficulties, forcing reliance on STT device to solve the case and rescue missing scientist.

THE CHALLENGE

Create an entertainment-focused game (not an edugame) that:

Encourages understanding of how STT technologies assist communication

Raises awareness of the limitations and frustrations faced by STT users

Maintains an engaging and enjoyable gameplay experience without invoking pity or turning the experience into a lecture

RESEARCH

My team analyzed 12+ academic sources spanning STT technology, accessibility gaming, and cross-cultural communication barriers. Here are the key research insights we found:

Accuracy Barriers: "Most studies report that although STR technology is useful for learning, a greater accuracy in the system's recognition of speech is required". Accuracy drops significantly with accents, dialects, and background noise.

Cultural Impact: Research shows "different cultural backgrounds or language families" affect STT effectiveness, with "oriental cultural backgrounds less active in learning interaction"