Flag

We stand with Ukraine and our team members from Ukraine. Here are ways you can help

Get exclusive access to thought-provoking articles, bonus podcast content, and cutting-edge whitepapers. Become a member of the UX Magazine community today!

Home ›› Artificial Intelligence ›› How User Experience Research (UXR) Cam Help Build Responsible AI Applications

How User Experience Research (UXR) Cam Help Build Responsible AI Applications

by Celine Lenoble
3 min read
Share this post on
Tweet
Share
Post
Share
Email
Print

Save

How User Experience Research (UXR) Can Help Build Responsible AI Applications?

Learn ways user experience research can help build responsible AI applications.

 

Today, Artificial Intelligence (AI) and, more specifically, Machine Learning are pervasive in our daily lives. From Facebook ads to YouTube recommendations, from Siri to Google Assistant, and from an automated translation of device notice to marketing personalization tools, AI now deeply permeates both our work and personal lives.

This article is the second in a series of three (catch up on the first installment here and third here) that advocate for renewed UX research efforts in ML apps.

With ML facing so many users, there is a case to approach the conception and design of ML-powered applications from a UX research perspective.

This lies on three main reasons:

1. Mental models of users haven’t caught up with how ML and AI truly work:

  • UXR can uncover existing mental mentals and help design new ones that are more suited to this new tech.

2. ML and AI can have an insidious and deep impact on all users’ lives:

  • UXR reveals the myriad of intended and unintended effects of apps on people’s life — and help build more ethical AI.

3. ML and AI can have disparate impacts on individuals based on their ethnicity, religion, gender, sexual orientation:

  • UXR can also help address some of the sources of bias.

In this episode, we will focus on the second reason:

How to assess the impact of ML-apps on users and meet AI ethical standards?

Most ML algorithms are supposed to assist humans in their decision-making process but not make the decision themselves. However, more and more, AI systems do not content themselves in making recommendations — they make decisions. This is the case from sifting through resumes to selecting which neighborhoods to patrol for the next policy shift.

Given the scale AI systems operate, the potential impacts on specific individuals, groups, or even society, is deep and wide. While harmful human practices have always existed, they have evolved alongside social and legal guidelines that mitigate them. Not so much for AI-driven systems — yet.

Ethics in AI

Research on ethical AI has been conducted by academic researchers, industries, or governments, and they have produced a series of guidelines.

Microsoft lists 6 principles for a responsible AI: Fairness, reliability & safety, privacy & security, inclusiveness, transparency, and accountability.

And a High-Level Expert Group on Artificial Intelligence published Ethics Guidelines for Trustworthy AI for the European Union in 2019 that explains:

Develop, deploy and use AI systems in a way that adheres to the ethical principles of: respect for human autonomy, prevention of harm, fairness and explicability. Acknowledge and address the potential tensions between these principles.

While the research on these high-level principles is well engaged, there is a gap between policies and guidelines and their implementation. When should data scientists concern themselves with these considerations? How can product managers integrate them into their roadmap? What practical steps can they take to ensure their app will be responsible and trustworthy?

The Partnership for AI, a non-profit that includes industry leaders, universities, and civil society groups, acknowledges that all AI stakeholders need to be actively involved in preventing potential harm resulting from such research:

Through our work, it has become clear that effectively anticipating and mitigating downstream consequences of AI research requires community-wide effort; it cannot be the responsibility of any one group alone. The AI research ecosystem includes both industry and academia, and comprises researchers, engineers, reviewers, conferences, journals, grantmakers, team leads, product managers, administrators, communicators, institutional leaders, data scientists, social scientists, policymakers, and others.

post authorCeline Lenoble

Celine Lenoble

I am Director of UX Research at brainlabs where I lead a team of CRO analysts and UX researchers with diverse backgrounds. I believe in a holistic approach to UX research and design combining all perspectives: Human Computer Interaction, design thinking, psychology, sociology, anthropology and all methods: from big data to ethnographic study. I am particularly interested in the UX of ML-powered products & services. Disclaimer: opinions represented here are personal and do not represent those of brainlabs.

Tweet
Share
Post
Share
Email
Print
Ideas In Brief
  • UXR reveals the myriad of intended and unintended effects of apps on people’s life — and help build more ethical AI
  • The author talks about:
    • How to assess the impact of ML-apps on users and meet AI ethical standards?
    • Ethics in AI

Related Articles

In an industry where clarity is key, why can’t we agree on the language to define what we do? Dive into the evolution of UX, UI, and Product Design — from pioneering generalists of the early web to today’s specialized roles — and discover how our industry’s struggle with terminology may be holding us back.

Article by Andy Budd
The Historical Context of UX, UI, and Product Design
  • This article delves into the historical evolution of UX, UI, and Product Design, tracing their journey from the early days of web design to modern hybrid roles.
  • It examines how the industry’s struggle with clear terminology has impacted its growth, potentially ceding authority to other professions like project management.
Share:The Historical Context of UX, UI, and Product Design
5 min read

The article discusses how we use maturity models in design and argues that “immaturity” frequently reflects smart strategic choices. Instead of trying to reach ideal standards, we should focus on how design aligns with business objectives.

Article by Andy Budd
Just Grow Up: Why Design Maturity Models Might Be Harming Our Industry!
  • The article questions how mature a design is. It states It states that some strategic decisions are called immature.
  • The piece uses budget airlines and luxury carriers as examples. These examples demonstrate that design decisions are based on business strategies, rather than universal standards.
  • The article says we should judge design based on how well it matches business goals, not by strict rules.
Share:Just Grow Up: Why Design Maturity Models Might Be Harming Our Industry!
3 min read

Is consciousness the next frontier of technology? Explore how AI, psychedelics, and philosophy converge to challenge our understanding of awareness, reality, and what it means to be truly alive.

Article by Oliver Inderwildi
Conscious Machines: Impossible Feat, Ethical Nightmare, or Evolution’s Next Step?
  • This article delves into the enigma of consciousness, exploring its emergence, malleability, and the philosophical debate on whether it can exist independently of biological systems.
  • It examines key factors driving consciousness into mainstream discourse, including advancements in AI, the resurgence of psychedelics in mental health, and the influence of popular culture and science literature.
  • The piece critically evaluates the possibility of machine consciousness, contrasting philosophical perspectives on its feasibility and implications for ethics, technology, and our understanding of reality.
Share:Conscious Machines: Impossible Feat, Ethical Nightmare, or Evolution’s Next Step?
13 min read

Join the UX Magazine community!

Stay informed with exclusive content on the intersection of UX, AI agents, and agentic automation—essential reading for future-focused professionals.

Hello!

You're officially a member of the UX Magazine Community.
We're excited to have you with us!

Thank you!

To begin viewing member content, please verify your email.

Tell us about you. Enroll in the course.

    This website uses cookies to ensure you get the best experience on our website. Check our privacy policy and