AI has quietly rewritten the first rule of UX: the user goes first. What happens to design when the machine goes first instead?
Series continuity: why this series, why now
For thirty years, UX has stood on one unshakeable premise: the interface waits. It waits for the click, the tap, the decision. Somewhere in the last eighteen months, without a keynote to mark the occasion, interfaces started acting before we asked them to. This series, Designing the Machine, exists because that premise no longer holds, and over the next ten articles we sit with what that actually means for practitioners—not the marketing version of “AI-powered,” but the version grounded in what’s actually happening to users right now.
“I think AI should best be understood as something like a new digital species.” — Mustafa Suleyman, CEO, Microsoft AI
He wasn’t speaking as a designer. But he named, more precisely than most UX commentary has managed, the discomfort at the center of this series: we are no longer designing objects that sit still until touched. We are designing something closer to a second party in the room.
The core shift: from responding to acting
Every usability heuristic we teach—visibility of system status, the basic principle of undo—was written for a world where the human initiates and the machine executes within that instruction’s boundary. Agentic AI breaks that contract: the system now initiates. It plans a sequence of steps toward a goal, executes several without checking in, and surfaces itself again only once something is done, ambiguous, or wrong. That isn’t a feature update. It’s a redefinition of what “using a product” means.
The statistics nobody in the room wants to say out loud
Gartner projects that 40% of enterprise applications will integrate task-specific AI agents by the end of 2026, up from under 5% in 2025—one of the fastest capability-adoption curves in the history of enterprise software. In India specifically, EY’s AI outlook for 2026 found 24% of business leaders already deploying agentic AI, concurrently with the rest of the world, not years behind it. That pace alone should worry any UX practitioner reading this, because trust in these systems is breaking far faster than it’s being built. A Cotality survey on AI in real estate found that 70% of respondents said a single AI mistake would break their trust in a platform—while the same respondents readily forgave equivalent human error. A separate YouGov survey for ACI Worldwide found that six in ten UK consumers would stop using an AI shopping agent entirely after just one mistake and that 69% don’t trust AI even when it is explicitly following rules the user set themselves. Read those two numbers together, and the shape of the problem is obvious: we are deploying autonomous systems into products faster than users are willing to forgive them, and almost no design team is treating that gap as the primary constraint it actually is.
The India-specific reality: a market built on trust shortcuts
India didn’t build digital trust the way Western credit-card culture did, slowly, over decades. UPI moved an entire nation from cash to instant transfer in under a decade, largely because the interface made trust feel structurally unnecessary—the transaction simply completed, visibly, in seconds. Indian users are already trained to expect systems that act quickly and confirm afterward, visible in how IRCTC’s Tatkal flow made speed itself the entire value proposition. That’s a double-edged advantage. The same country that trusts the UPI confirmation beep has also, in the same decade, learned real fear around digital fraud. When an agentic system here makes a visible mistake, it won’t be read as an amusing glitch to screenshot. It will be read through every fraud warning that user has already internalized—and the ACI Worldwide numbers above suggest that reaction will be swift and largely permanent.
The psychology of control
Psychology has a well-established concept called locus of control—the degree to which a person believes outcomes result from their own actions versus external forces. A system that clearly shows what it’s about to do and lets the user intervene preserves that internal sense of agency even while doing the work for them. A system that simply acts and reports back afterward quietly transfers control outward—and the brain notices, even when it can’t articulate why. This is also where learned helplessness becomes relevant: if a user’s early attempts to intervene are ignored or too difficult to execute in time, they stop trying—not because they trust the system, but because they’ve learned intervention doesn’t work. That looks like adoption. It’s actually resignation. It’s the psychological mechanism sitting directly underneath the 70% and 60% figures above.
Where this is already visible
OpenAI’s ChatGPT Agent lets the model take real actions inside a browser session while requesting permission before consequential moves and letting the user interrupt at any point. Google’s Project Mariner operates only within the active browser tab and requests confirmation before sensitive actions. Salesforce’s Agentforce leans hard into configurable approval gates, because an autonomous agent acting wrongly in sales or service has direct commercial consequences. And in India, Zomato’s and Swiggy’s natural-language ordering layers stay conservative—the agent narrows choices, but a human still confirms the final action. None of these bets is definitively correct. Together, they show that how much the machine does before the human has to look at it is now one of the primary design decisions of our era.
LucyUX applied
- At Listen, the discipline is resisting the temptation to take early AI enthusiasm at face value—structured listening has to probe for the moments a user quietly redid something the agent already completed.
- At Understand, the job is separating stated trust from behavioral trust.
- At Conceptualize, teams have to prototype the interruption experience before the automation experience, because in agentic products the exit is the safety feature, not an afterthought.
- At Yield, success isn’t “did the agent finish the task”—it’s whether the user, a day later, still feels like they were in control of it and whether they’d survive being the one mistake the ACI survey warns about.
Consequences
A confusing button costs a conversion. A confusing agent costs something closer to a relationship. The data above isn’t abstract: it’s a direct warning that most agentic products are operating with almost no margin for error, and most design teams are shipping as if they have plenty.
Up next in the series: “Your AI Is Lying to You (Politely)”—why the real UX failure in most AI products isn’t that they’re wrong. It’s how confident and fluent they sound while being wrong, and what that does to a user’s judgment over time. If Article 1 was about the machine acting without waiting, Article 2 is about what happens when you can no longer tell whether it should have waited.
References & further reading
- “Microsoft Executive Says AI Is a ‘New Kind of Digital Species,’” Suleyman, M
- Rebuilding Broken Trust in the Age of AI, Cotality
- Six in Ten UK Consumers Would Stop Using an AI Shopping Agent After One Mistake, ACI Worldwide/YouGov
- UPI Product Overview, NPCI
- Official Booking Platform, IRCTC
- Introducing ChatGPT Agent, OpenAI
- Project Mariner, Google DeepMind
- Agentforce, Salesforce
- Zomato, Swiggy
- Ten Usability Heuristics, Nielsen Norman Group
- Locus of Control, Learned Helplessness
- LucyUX, UXExpert, DesignImpulse