Artificial intelligence promises to augment human expertise, making our decisions faster and more data-driven. Yet, a growing body of research reveals a hidden paradox. The more we lean on these powerful tools, the more we are exposed to ‘automation bias’—the well-documented tendency to over-trust automated systems, even when they are flawed.
This is a very human thing. It reveals an uncomfortable truth about our evolving relationship with technology and poses one of the most significant, yet least discussed, challenges to strategic leadership in the age of AI.
This week we delve in this paradox: the more sophisticated our AI becomes, the less sophisticated we risk becoming ourselves.
Focus On: The Hidden Cost of Algorithmic Deference
Research from fields spanning aviation to healthcare shows that automation bias affects both novices and experts alike. Years of hard-won experience can evaporate in the face of a confident algorithm.
Consider a study where experienced radiologists’ cancer-detection accuracy plummeted when an AI provided incorrect guidance. This isn’t a failure of technology; it’s a failure of human-machine interaction. This phenomenon creates an ‘expertise paradox’: the very tools designed to augment our capabilities can unintentionally erode them.
As AI graduates from a simple ‘Tool’ to a decision-making ‘Agent’—a maturity model I covered in a previous dispatch from the Gartner Marketing Symposium—the risks multiply. Critical errors slip through because we assume the AI has caught them. Strategic blind spots emerge because teams stop questioning algorithmic recommendations. Innovation stalls as divergent thinking is replaced by algorithmic consensus.
From Passive Acceptance to Active Collaboration
To counter this, leaders must fundamentally redesign the partnership between their teams and their technology. The goal is not just to build smarter AI, but to build systems that make us smarter. Three principles are key:
Demand ‘Glass Box’ Thinking
The most transformative AI systems expose their reasoning, not just their conclusions. When an executive can see an AI’s logic—including confidence intervals and, crucially, what it doesn’t know—engagement shifts from passive acceptance to active deliberation. This isn’t about information overload; it’s about information sovereignty.
Design for Productive Friction
In our efficiency-obsessed culture, this sounds counterintuitive. Yet, the most effective AI systems deliberately introduce friction at critical moments. Imagine AI that automatically generates counter-arguments to its own recommendations, or a system that requires a human assessment before revealing its own conclusion. This isn’t inefficiency; it’s cognitive insurance against premature convergence.
Turn Answer Engines into Question Generators
Perhaps AI’s highest value lies not in providing definitive answers, but in generating better questions. An AI that responds to a strategic query with, “This analysis assumes stable supply chains—what is your contingency for disruption?” preserves and enhances human judgment. As we move towards a future of ‘machine customers’ and autonomous agents, the ability to ask the right questions becomes our most critical advantage.
What if we measured the success of our AI not by the answers it provides, but by the quality of the questions it provokes in our teams?
Your Strategic Imperatives
For leaders navigating this transition, the path forward requires intentional design, not default adoption.
Design for Augmentation, Not Automation: Every AI investment must answer the question: “How does this make our people more capable, not just faster?”
Invest in Cognitive Preservation: Build systems and a culture that reward questioning, require verification, and celebrate the friction that prevents costly errors.
Make Critical Thinking Your Moat: While competitors race toward full automation, build an organisation that combines AI’s computational power with irreplaceable human insight. This is your sustainable competitive advantage.
The enterprises that thrive won’t be those with the most advanced AI. They will be those that most effectively preserve human judgment while leveraging machine intelligence. As you evaluate your next AI initiative, ask yourself: will this system make my team more thoughtful, or merely faster?
Follow me
That’s all for this week. To keep up with the latest in generative AI and its relevance to your digital transformation programs, follow me on LinkedIn or subscribe to this newsletter.
Disclaimer: The views and opinions expressed in Chronicles of Change and on my social media accounts are my own and do not necessarily reflect the official policy or position of S&P Global.