Flag

We stand with Ukraine and our team members from Ukraine. Here are ways you can help

Home ›› Usability ›› Doing More with Remote Research

Doing More with Remote Research

by Brynn Evans, Juliette Melton
4 min read
Share this post on
Tweet
Share
Post
Share
Email
Print

Save

Remote research can help develop a broader view of users in their natural environments.

Chances are, you’ve encountered remote user experience research. Perhaps you’ve read about it in an article or have seen the book. Everyone from the scrappiest startup to the most established corporation is beginning to incorporate remote methods into their research arsenal.

Currently, the most common remote research protocols incorporate screen sharing and task analysis, often employed at a late stage in the product development process. While screen sharing is a relatively new technology, task analysis has been the standard usability method for 30 years. But since then, user habits and behaviors have changed significantly to accommodate the tech-filled world we live in.

Instead of buying a washing machine by walking into Sears, today people can choose from many different washing machines by reading online reviews, asking friends on Facebook for recommendations, or doing head-to head-comparisons across manufacturers. Thus doing a remote research study focusing solely on the Sears website would not capture these other activities that are part of the buying process, even if the purchase is eventually completed on sears.com.

We see real value in the ways remote research can contribute to developing a broader view of what people actually do in their natural environments. Think of it like low-cost field-testing for the purpose of understanding rich and complex real-world experiences. This can be done to a limited degree through screen sharing of website interactions, but as interactions span the physical and digital worlds and have myriad social influences, remote research can be a valuable contributor to understanding these touchpoints as well.

Thus, remote methods are particularly suited for understanding context of use. We should be asking questions that reveal the broader context in which customers are using a website. For example:

  • What brought users to the website, and what will they be doing when they leave?
  • How long have they been doing a given task?
  • What other sources do they use for getting information and how does that influence their experience on our website?
  • Are they making decisions with their friends?
  • Are they doing things offline that contribute to the experience?

These are hard questions to answer even in full-blown field studies. Because remote methods give you access to users in their native environments, it’s much more likely that you’ll gain insight about physical and social contexts in a remote study than in a laboratory study.

Remote research for physical contexts

We recently used remote methods to help LendAround, a London-based startup, learn about potential customers’ DVD sharing habits. LendAround’s platform for peer-to-peer physical media sharing (primarily of DVDs) was in early beta. Needing to move quickly and be frugal meant that in-person field research was not feasible, particularly since the team wanted to focus on participants who lived outside of the Bay Area tech bubble where the research project was based.

The team developed a study that involved remotely recruiting and interviewing people in their homes where their DVD collections were kept. To begin, they posted a survey on Mechanical Turk and paid “Turkers” to complete it. The survey results were used for two purposes: to identify target interview participants and to address some initial research questions.

In the next phase, we conducted research using that most basic of tools—the phone. Our questions covered many aspects of how participants share and borrow DVDs. And since DVDs are physical products that are kept in people’s homes, it was important to interview participants in the environment where they had their DVD collections. When we asked about their sharing habits, they could simply walk over to where they kept their DVDs to look around and estimate how many they had and how many they’d lent to friends. This led to insights about the rich context of how people use and share DVDs that wouldn’t have been captured in an in-person laboratory study.

Remote research for social contexts

We have also used remote methods to learn about online social interactions. One study in particular was focused on how services like Twitter, Facebook, and Flickr help friends connect, discover content, and synthesize new information. Our goal was to understand how social interactions affect perceived content value within a set of friends.

We set up a remote study in which three friends submitted desktop recordings of their online interactions over the course of three weeks. We paid particular attention to times when one participant was referenced by or communicated with another participant, and we asked both of them about the interaction. Also, when multiple participants read the same news item we asked each person whether they remembered the content, whether it was meaningful, and whether other people had talked or commented on that story since.

It became clear that people’s interactions and the value they found in social content were dependent on a number of factors, from context cues they picked up in the interface to social factors such as reputation and trust. For example, participants skimmed Twitter focusing only on avatars, and when they saw an avatar of someone they respected they read the associated tweet more closely and were more likely to share it with others.

Doing this study remotely allowed us to uncover social interaction patterns that would not have been captured in an hour-long screen share/task analysis of a single participant’s desktop.

Conclusion

Though late-stage remote task analysis is valuable, remote methods can also establish an understanding of the unspoken and often unseen contexts, both physical and social, of a product, program, website, interaction, or decision-making process. Creative and thoughtful use of remote research methods can improve product development practices across the board—for startups and large, established companies alike.

post authorBrynn Evans

Brynn Evans, Brynn (@brynn) is obsessed with the intersection of social networks and human behavior. At first she shunned social psychology, finding real joys in neuroscience and dissecting brains. But after a 6-year stint as a neuropsychologist, she switched to understanding how people act and behave (with each other!) in the real world. And when Digg and Facebook and Twitter entered the scene, her work dovetailed again into social interaction design. Today she's the Social Interaction Lead and UX Researcher at Bolt | Peters. In her free time, Brynn enjoys drawing comics and overbooking herself with community events. She runs the Overlap SF meetups and gives out mini-grants to awesome local projects with the Awesome Foundation in SF. She's a judge and advisor to the betacup design competition, which deals with the growing problem of drinking (too much) coffee out of non-recyclable paper cups. Brynn gives talks and workshops on social search, and if you get her talking, she won't shut up about her love for Japanese green tea.

post authorJuliette Melton

Juliette Melton,

Juliette Melton is a design researcher based at IDEO in San Francisco. Her work has spanned a broad range of practices including education leadership, public health research, and digital publishing.

Juliette holds an MEd from the Technology, Innovation, and Education program at the Harvard Graduate School of Education.

When she's not focusing on design research you'll often find her doing portrait photography or chopping vegetables. 

 

 

Tweet
Share
Post
Share
Email
Print

Related Articles

Article by Eleanor Hecks
8 Key Metrics to Measure and Analyze in UX Research
  • The article outlines eight essential metrics for effective UX research, ranging from time on page to social media saturation
  • The author emphasizes the significance of these metrics in enhancing user experience and boosting brand growth.

Share:8 Key Metrics to Measure and Analyze in UX Research
6 min read

Did you know UX Magazine hosts the most popular podcast about conversational AI?

Listen to Invisible Machines

This website uses cookies to ensure you get the best experience on our website. Check our privacy policy and