Real-time
Text Translation

THE CHALLENGE

Create an engaging mobile application to showcase HP's new text recognition (OCR) technology.

COMPANY
QUALCOMM, 2014
MY ROLE
Lead Interaction Designer responsible for client management, design, and UX Research
TOOLS
Axure, Adobe Photoshop, MS Visio
PROJECT Kick-OFF

Team workshop

I was the Lead Interaction Designer. My co-conspirator for this project was Shiae, an amazing Visual Designer. To kick-off our project, we met with the engineering team to learn about the new technology, review its capabilities and its constraints, and decide on the user stories to include in the demo.

Important considerations*

For a mobile project like this one, our main considerations were:

* Will this be an internal demo or customer facing proof of concept?We begin each project by understanding its core purpose. For this project, we needed to clarify if the design was for an internal demo, highlighting a specific concept for management, or if it was intended for a customer-facing presentation, acting as a proof of concept for potential technology licensing to external companies.
* Is the operating system relevant?
Is the demo intended to be optimized for a particular mobile OS, such as iOS or Android? Tailoring the design to a specific platform can improve usability and performance, but it also requires extra time and effort. Clarifying this requirement early in the project ensures that our design efforts are focused and aligned with expectations.

* How much generative or evaluative research is needed?
Initially, we decided that primary and secondary user research was not necessary given the small scope and objectives of this demo. As we progressed and defined several novel interface elements, we incorporated two rounds of lean usability testing to evaluate the efficacy of our approach.

* Is adherence to the corporate style guide required?What visual style suits this demo? Do we use the corporate style guide or choose a more generic approach?

* How much UX time and effort is needed for this project?What is the scope of the project in terms of the number of workflows and screens that need to be developed? We use this information to determine which resources (research, interaction design, and visual design) we need to assign to the project, as well as work out the effort, schedule, and overall cost of the project for the statement of work (SOW).

OUR DESIGN GOALS

As we entered the design stage, we broke down the project's main goals into distinct requirements. This approach helped us stay focused on delivering precisely what was needed.

Goal 1: Provide simple help instructions for how to initiate the OCR scan, which may be unfamiliar technology to many users.

Instruction overlay and demo help

Visual instructions were used to introduce the use of the shutter button for translating text.

Onboarding journey map

Goal 2: Selecting the text to translate should be clear and intuitive.

Simple text extraction

We used common and familiar components for the shutter icon and framing target.

Onboarding journey map

Goal 3: Translated text results evoke satisfaction and joy in the technology.

Overlay translated text

Displaying the translated text as an overlay in live view created the visual interest we wanted to showcase this technology.

Onboarding journey map

Goal 4: Provide the basic ability to switch between translation languages to support international clients.

Language selection control

We needed a way to switch languages for our internal testing. We built it using a standard design pattern in order to reduce the risk of interaction issues in a background feature.

Onboarding journey map

Goal 5: Provide easy access for our internal teams to manually run the translation through Google.

Easy access to Google Translate

This secondary feature was requested by the dev team to support testing requirements. We placed it off screen, under the menu, where it could be accessed when needed.

Onboarding journey map
IDEATION

We sketched out ideas for each one of our goals.

Onboarding journey mapOnboarding journey map

wireframes & Specifications

Initial designs and specifications

I created mid-fidelity wireframes to share with the image recognition team and documented all changes and design agreements in this shared document to provide background context for each decision and keep everyone on the same page.

IA diagramIA diagram

Usability testing

Rapid prototype testing

By the end of the week, we had a working version of the mobile app for user testing. We side-loaded the demo .apk onto an Android phone for our test device.

We ran 5 usability sessions with internal employees selected from different departments and roles. We asked each participant to 'think out-loud' as they used the app to translate text found in a series of images we provided.

Final Demo

ART DIRECTION

I partnered closely with a visual designer for all stages of this project. These are the final screens produced from the demo.

Case card viewCase card viewCase card viewDashboard