Artificial Intelligence and UX Design: How We Utilize It in Usability Testing

Written by Anderson Batista & Elisa Zanoni

Artificial Intelligence (AI) has emerged as a powerful tool capable of revolutionizing the way we perform our daily tasks, offering numerous opportunities to optimize processes and routines within companies. Here at Sensorama Design, we are constantly exploring new ways to integrate AI as an ally not only in our projects but also in our UX design process, aiming to accelerate our work.

In this article, we will discuss how we leverage artificial intelligence to create images used in SUM (Single Usability Metric) usability tests. By using AI, we not only increased productivity but also ensured that the prototype was fully faithful to what we needed to test, which was crucial for this type of user experience assessment.

The Challenge: Rebuilding Competing Apps for Usability Testing

We were tasked with conducting usability tests using the SUM metric to compare usability between the client’s product and its competitors. To do this, we used the SUM test method to compare the performance of the client’s app with that of its competitors. Therefore, we had to produce a prototype with interfaces captured through interviews.

In addition to the need to recreate competing products, we also needed to anonymize the images and enhance their quality. Anonymizing the images is extremely important because the information of the interviewees should not appear.

For image quality, it was necessary to ensure the integrity of the usability test since they were captured through screen sharing during video calls. In other words, some components of the software used overlapped the image, posing another pre-production demand for the prototype for usability testing.

How We Used AI to Address Project Challenges

There are various AIs to create images from scratch, such as MidJourney and ChatGPT 4.0. However, they cannot generate identical images with minor adjustments. Therefore, we sought other artificial intelligence tools that could support us in designing areas that needed to be corrected. We succeeded with Adobe’s AI, Firefly, and PicWish.

Adobe Firefly: AI Used to Create Images

Adobe Firefly is a powerful generative artificial intelligence tool that is transforming the way images are generated. With its unique ability to understand and adapt to the specific context of each project, this technology allows us to generate and enhance images with impressive precision and quality.

In essence, it can easily remove items from the screen by simply selecting the desired point with the brush tool and requesting the generation of a new version.

We used this function to solve the first challenge of anonymizing sensitive user information in the screen captures. Then, we continued to select elements on the screen that we wanted to recreate, such as buttons, inputs, and other elements.

As if by magic, we were able to achieve incredible results in minutes, something that would take hours, perhaps even more than a day, to accomplish manually. The most fascinating aspect is that with each modification made with the help of artificial intelligence, the tool suggested three options for us to choose from, the one closest to the desired final result. This feature helped us make the application interface very close to reality.

Enhancing Image Quality with PicWich

Finally, we used the PicWich tool to perform a procedure known as “Photo Enhancer.” This artificial intelligence consists of increasing or restoring image quality. This process was equally crucial, as screenshots tend to lose quality when taken.

How AI Optimized Usability Testing

• Anonymized Sensitive User Information: The Adobe Firefly AI tool allows for easy removal of screen elements, such as names and photos, to ensure the privacy of interview participants.
• Recreated Parts of the Screen with Precision: The Adobe Firefly AI was able to recreate images with the components we needed to ensure the integrity of the application interfaces.
• Improved Image Quality: With the PicWich artificial intelligence tool, we were able to increase resolution and restore the quality of images captured by screenshots, ensuring greater fidelity for usability testing.
• Accelerated Interface Reconstruction Process: The AI tool automates repetitive and complex tasks, allowing the team to complete the work in less time and with more efficiency.
• Suggested Options for the Final Interface: The Adobe Firefly AI tool offers suggestions for different versions of the reconstructed interface, making it easier to select the most suitable option for usability testing.

Results We Obtained by Applying Artificial Intelligence to the Product Design Process

• Increased Quality and Fidelity of Usability Testing: Enhanced images and accurately reconstructed interfaces ensured a more realistic and reliable testing experience for users.
• Reduced Time and Development Costs: The AI tool allowed the team to work faster and more efficiently, optimizing time and available resources.
• Increased Team Productivity: Automating repetitive tasks freed up the team to focus on more strategic and creative activities.

At Sensorama, we are committed to continuously exploring the potential of AI as an ally in UX design, service design, and innovation projects. By using artificial intelligence in the UX design process, we not only make projects more efficient but also pave the way for new opportunities for innovation and excellence in our work.