Flag

We stand with Ukraine and our team members from Ukraine. Here are ways you can help

Home ›› Design ›› Organized Approach to Emotional Response Testing

Organized Approach to Emotional Response Testing

by Nathanael Boehm
3 min read
Share this post on
Tweet
Share
Post
Share
Email
Print

Save

Categorizing feeling words and the Product Reaction Cards to develop custom cards.

Most user experience designers will have heard of the Product Reaction Cards (doc), a set of 118 words and phrases developed for Microsoft by Joey Benedek and Trish Miner in 2002 that can be deployed in a user testing workshop to help people articulate their emotional responses to a product.

The Product Reaction Cards are part of the Desirability Toolkit (doc) that suggests facilitators ask users to choose the cards that “best describe the product or how using the product made them feel” and then ask them to narrow their selection to just five cards. The cards selection process is then followed by an interview where the participant explains why they selected those five cards.

Whilst the 118 card deck seems to work for the creators of the PRC, some people think it’s too much—I posted a question on UX Exchange a few months ago about and received responses like “unnecessarily fiddly” whilst another said they use a subset of the cards. Donna Spencer, author of Card Sorting, commented:

…at the end of the test the last thing a participant wants to do is go through this big pile of cards. It takes quite a lot of time, but I don’t think the gain is worth the pain.

Whilst I support the goals of the cards to prompt people and provide a full vocabulary than might otherwise come to mind during workshop sessions I’ve been wondering if there might be a different approach.

For example, in the book People Skills, Robert Bolton talks about using adverbs to describe the level of intensity as well as grouping feeling words into “families”:

By preceding feeling-word adjectives with appropriate adverbs, you can communicate with some accuracy the degree or intensity of feeling.

You could select adverbs appropriate to the adjective, as in the example Bolton uses:

  • You feel a little sad because your dog died
  • You feel quite sad over your dog’s death
  • You feel very sad that your dog died
  • You feel deeply sad since your dog died

Or you could opt for a normalised Likert scale approach that could be applied to any adjective; although that would require participants to explicitly state their opinion of every feeling word, phrased as questions like, “This product makes me feel stressed: Strongly Disagree, Disagree, Neither Agree or Disagree, Agree or Strongly Agree.”

It’s intensive but it is a more analytical and thorough approach.

The “families” that Bolton refers to is a matrix of categories of feeling words grouped by levels of intensity for example in the category of emotional feeling words for “sadness”:

Strong:

  • Desolate
  • Anguished
  • Despondent
  • Depressed

Mild:

  • Glum
  • Blue
  • Sad
  • Out of sorts

Weak:

  • Below par
  • Displeased
  • Dissatisfied
  • Low

This grouping of feeling words by level of intensity, the use of adverbs or a Likert scale, coupled with the Production Reaction Cards authors’ recommendation to maintain a 60/40 ratio of positive to negative words should provide you with a better framework should you wish to alter or reduce the list of 118 words and phrases whilst ensuring you still cover the full range of emotional responses.

Think of it like a paint palette where the type of emotion is the hue and the intensity is the brightness. You might not need your 16.7 million colours but if you’re going to cull your palette at least take a sensible and logical approach to it.

This is especially important if you want to follow a quantitative approach to reporting on research conducted using the PRC as mentioned in the book Measuring the User Experience by Thomas Tullis and Bill Albert.

What are your experiences with using the Product Reaction Cards—specifically if you culled the list of words and phrases or came up with your own? What technique did you use for developing your custom set of cards and how do you think your choices affected the quality and thoroughness of the emotional response inquiry?

post authorNathanael Boehm

Nathanael Boehm, Nathanael has been working in web application development since 2000. He started as as developer before focusing on front-end design and then giving up coding to specialise in UX design. He has worked primarily in the public sector for Australian Government departments and agencies but also has several years experience in private sector working in e-commerce, e-learning and product development. Nathanael has also been involved with TEDx conferences in Canberra Australia and Christchurch New Zealand as well as organising BarCamp events, Free Australia Wireless, Canberra Coworking and OpenAustralia.

Tweet
Share
Post
Share
Email
Print

Related Articles

ChatGPT can identify and describe human emotions in hypothetical scenarios.

Article by Marlynn Wei
ChatGPT Outperforms Humans in Emotional Awareness Test
  • New research found ChatGPT was able to outperform humans on an emotional awareness test.
  • Emotional awareness is the cognitive ability to conceptualize one’s own and others’ emotions.
  • Given the psychological risks of artificial intimacy, AI augmentation, and human-AI collaboration—keeping humans in the loop—will be a safer and more beneficial approach for now.
Share:ChatGPT Outperforms Humans in Emotional Awareness Test
3 min read

What do Architecture, Computer Science, Agile, and Design Systems have in common?

Article by Kevin Muldoon
A Pattern Language
  • The article explores Christopher Alexander’s impact on diverse fields, from architecture to software development, introducing the concept of design patterns and their influence on methodologies like Agile and the evolution of Design Systems.
Share:A Pattern Language
7 min read

In this article, I’ll share seven incredibly useful design resources that can elevate your skills as a UX designer in 2024 and make you a well-rounded designer overall. These resources not only help you work more efficiently but also automate repetitive tasks and enable you to create outstanding user experiences. So, let’s dive into this without further delay.

Article by Abhi Chatterjee
7 Must-Have Resources for UX Designers in 2024
  • The article explores seven indispensable resources for UX designers in 2024, offering insights into design methodologies, case studies, UX laws, and practical challenges to elevate designers’ skills and efficiency.
Share:7 Must-Have Resources for UX Designers in 2024
3 min read

Did you know UX Magazine hosts the most popular podcast about conversational AI?

Listen to Invisible Machines

This website uses cookies to ensure you get the best experience on our website. Check our privacy policy and