Flag

We stand with Ukraine and our team members from Ukraine. Here are ways you can help

Get exclusive access to thought-provoking articles, bonus podcast content, and cutting-edge whitepapers. Become a member of the UX Magazine community today!

Home ›› Behavioral Science ›› How To Gain Actionable User Insights Through Simple Observation: A Case Study

How To Gain Actionable User Insights Through Simple Observation: A Case Study

by Lia D. McCabe
3 min read
Share this post on
Tweet
Share
Post
Share
Email
Print

Save

UserInsights_Slider

How do you find actionable insights in this fast-paced environment, where we don’t always have time to recruit, schedule, and moderate testing sessions?

Presented at DCUX 2019 as “Fly On The Wall” talk by Lia D. McCabe

Just-complex-enough concept

If only this worked!

 
I’m sure you’ve all been there. You’ve got a great website but you’re not sure why users are getting frustrated and not engaging with your product. Or perhaps in some instances, your users may be over-engaging; Nonetheless, to create a successful, user-friendly website, we need to take a closer look and focus on actual user behavior. In this fast-paced environment, we don’t always have time to recruit, schedule, and moderate testing sessions. But that’s okay because you can still gain actionable insights by using what I call the Fly-on-the-Wall method. Here are a few tips to get you started.

Tip 1: Use a naturalistic approach
By using a naturalistic approach or ‘in-the-wild’ observation, we can gain qualitative and even quantitative outputs that are more reliable and more likely to encounter true-to-life user frustrations than in a structured setting.

A great approach is using session-replay and heatmaps as a tool for unmoderated remote testing. For instance, at my company, we wanted to know how we could improve our medical Guidelines page to make documents and related materials easier to find. To accomplish this, we utilized a naturalistic approach through observation of recorded user sessions and heat mapping on the Guidelines page. Now there are a lot of great tools out there but there’s one, in particular, I’d recommend, which leads me to tip #2.

Tip 2: Utilize the right tools
It’s important to have tools that work with us…not against us, and in my experience Mouseflow is that tool.

Mouseflow allows us to record-and-replay or live-watch user behavior to identify problems they may encounter. Because it’s just a line of code that’s placed on any website, there is no recruitment or scheduling necessary. You can turn this code on and off at any time and can adjust your sample size at any point. This makes usability testing quick, easy, and flexible. Session-replays let you see exactly what users are doing on the screen while the heatmaps track clicks, mouse movements, scrolling, and other data points to get to the bottom of your research questions. This tool allowed us to gain many actionable insights for our redesign.

Heat Mapping

Heatmapping session utilizing Mouseflow tool (www.mouseflow.com). The white/orange indicates high-level of user activity in the form of clicks.

For instance, when reviewing the video replays on our Guidelines page, we observed that users were struggling to find what they were looking for. This was indicated by users continuously scrolling and clicking the ‘more’ button until ultimately abandoning the page. We also observed users typing in various versions of similar text when seeking related content, which the search was not returning. Some of these sessions lasted as long as 20 minutes. We were able to infer that it was not clear to users what text was a clickable link vs. a title or header, which led to frustration in the form of ‘rage-clicks’.

We also noted that users typically were not interested in or did not notice the triptychs at the top of the page as indicated by the low level of heatmap activity in scrolling, attention, and click categories. This informed our research question and led us to ask follow up questions such as: how can we make the search and browse functionality more efficient? Is the triptychs valuable to users or should we consider removing it? And so this leads to my third and final tip.

Tip 3: Hypothesize & Validate
Considering this data, we formed a new design hypothesis: If we remove the triptychs and pull the content of the guidelines to a landing page in a more easily digestible format, then users would be more likely to find what they need and become less frustrated.

With the knowledge gained through the naturalistic approach, we redesigned the Guidelines page and ran a second Mouseflow test. This time, heatmaps indicated users were often finding what they were looking for right away, typically clicking on pdfs or the latest Guidelines. Sessions were shorter and there were no rage clicks.

In summary, qualitative research can generate lots of ideas for product improvement as it reveals possibilities that aren’t found in quantitative research. So, if you’re short on time and resources, give the Fly-on-the-wall method a chance.

post authorLia D. McCabe

Lia D. McCabe

Lia is a User Experience Researcher at the American College of Cardiology, where she leads the creation of effective user experiences for cardiologists and patients worldwide. She values community volunteerism and has previously served as a board member for UXDC. Tweet her @LiaDMcCabe.

Tweet
Share
Post
Share
Email
Print

Related Articles

Data visualization isn’t just about charts — it’s about telling a clear and compelling story. This article unpacks a wide spectrum of essential principles for making data easy to understand, honest, and engaging. Ready to transform complex numbers into meaningful insights?

Article by Jim Gulsen
The Ultimate Data Visualization Handbook for Designers
  • The article serves as a comprehensive guide for elevating visualization work, combining technical expertise with design principles to help designers transform raw data into meaningful insights.
  • It provides a point of reference for strategies, methods, and best practices to create more effective and impactful data visualizations.
  • The piece recommends tools and resources that design professionals can immediately implement to enhance the clarity and persuasiveness of their data storytelling.
Share:The Ultimate Data Visualization Handbook for Designers
23 min read

Discover how breaking down silos and embracing cross-functional collaboration can lead to smarter, more user-centered design — and better products for everyone.

Article by Rodolpho Henrique
Beyond the Design Silo: How Collaboration Elevates UX
  • The article explores how siloed UX design practices can hinder product success and argues for cross-functional collaboration as essential to creating meaningful user experiences.
  • It outlines the benefits of working closely with product managers, engineers, and stakeholders to align user needs with technical feasibility and business goals.
  • The piece provides real-world collaboration examples across research, prototyping, design systems, and accessibility to show how teamwork leads to more innovative and effective UX outcomes.
Share:Beyond the Design Silo: How Collaboration Elevates UX
4 min read

Designing for AI? Know what your agent can actually do. This guide breaks down the four core capabilities every UX designer must understand to build smarter, safer, and more user-centered AI experiences.

Article by Greg Nudelman
Secrets of Agentic UX: Emerging Design Patterns for Human Interaction with AI Agents
  • The article examines how UX designers can effectively work with AI agents by understanding the four key capability types that shape agent behavior and user interaction.
  • It emphasizes the importance of evaluating an AI agent’s perception, reasoning, action, and learning abilities early in the design process to create experiences that are realistic, ethical, and user-centered.
  • The piece provides practical frameworks and examples — from smart home devices to healthcare bots — to help designers ask the right questions, collaborate cross-functionally, and scope AI use responsibly.
Share:Secrets of Agentic UX: Emerging Design Patterns for Human Interaction with AI Agents
10 min read

Join the UX Magazine community!

Stay informed with exclusive content on the intersection of UX, AI agents, and agentic automation—essential reading for future-focused professionals.

Hello!

You're officially a member of the UX Magazine Community.
We're excited to have you with us!

Thank you!

To begin viewing member content, please verify your email.

Tell us about you. Enroll in the course.

    This website uses cookies to ensure you get the best experience on our website. Check our privacy policy and