Utopia or Dystopia

The Frictionless Trap: AI’s Greatest Benefit is also a Hidden Risk

I’m a big fan of classic science fiction. I generally avoid dystopian themes, but some are just too good to ignore, from A Boy and his Dog to Hunger Games. When ChatGPT started getting all that popular press a few years back, I was looking forward to finally living in that shiny future promised by Heinlein, Asimov, Clarke, and Roddenberry finally coming true, maybe even a flying car (the current prototypes still aren’t there yet, BTW). But the news of the last few years has had more Brave New World and 1984 vibes.

So when I read a recent NPR report on AI in schools, it felt like another example of how we are engineering frustration out of the human experience. The report describes software that is so sensitive to a student’s frustration that it pivots the curriculum before they even have a chance to get annoyed. On paper, it is a triumph of user experience; in practice, it might be a silent deletion of the very thing that makes a mind grow.

The Lesson of the Eloi

When H.G. Wells sent his Time Traveller into the year 802,701, he didn’t find a high-tech utopia or a charred wasteland. He found the Eloi: beautiful, peaceful, and intellectually vacant creatures living in a world of total automation.

Wells’ speculation in his passage on [suspicious link removed] hits quite close to home in the age of generative AI:

“Strength is the outcome of need; security sets a premium on feebleness.”

The Eloi weren’t born “slow” because of biology. They were essentially optimized into that state by an environment that removed every possible hurdle. They had won the game of civilization so thoroughly that they lost the ability to play it.

The parallel to AI-driven education isn’t that the technology is failing, but that it is succeeding too well. If the machine handles every productive struggle (sensing your confusion and immediately smoothing the path), it isn’t just teaching you. It is doing the mental heavy lifting on your behalf. You don’t get stronger by watching your trainer lift the weights, even if the trainer is a hyper-personalized LLM.

The Mirror of “Useful” Atrophy

It isn’t just about the classroom; AI is becoming a universal solvent for friction. History suggests that when we remove friction, we usually lose the muscle that was meant to overcome it.

  • The GPS Effect: We traded the frustration of paper maps for a blue dot that tells us where to turn. The result is that our internal spatial awareness is basically a legacy system. We can get anywhere, but we often have no idea where we are.

  • The Calculator Trade-off: We offloaded long division to a chip. This was a fair trade for most, but it established the precedent: if a machine can do it, the human brain is officially off the clock for that specific skill.

  • The Infinite Search: We stopped memorizing facts because we treat our devices as an external hard drive for our personalities.

Not all of that has been a bad thing, unless we get to live one of those post-EMP stories (which I avoid reading to avoid remembering it isn’t that far-fetched). I, for one, am glad that Einstein said “Never memorize something that you can look up,” because rote memorization is a struggle for me, but I really do enjoy exercising mental muscle memory. Which is where using AI the wrong way will lead to an atrophy that doesn’t need a major solar event to make us realize things went too far. It doesn’t just provide answers; it simulates the thinking.

The Verdict: Designing for Resistance

We should be optimistic about AI’s potential to amplify us, but we have to be wary of the passenger mindset. If we use these tools to abolish difficulty, we aren’t empowering ourselves. Instead, we are prepping for a very comfortable life as Eloi.

The challenge for educators, and for anyone using an AI “intern” in their daily workflow, is to intentionally design productive friction back into the system. We need AI that makes the work more meaningful and not just more invisible.

Mastery requires resistance. If the road is perfectly flat and the bike pedals itself, you aren’t traveling; you are just being delivered.

If you found this interesting, please share.

© Scott S. Nelson

Why Bigger Companies Move Faster than You in the AI Adoption Race

It’s not because they are more innovative.

There is a common myth in tech that smaller, nimbler companies always win the adoption race. But with Generative AI, we are seeing the opposite. While startups are still “tinkering,” enterprises are productionizing. According to recent data shared by Nathaniel Whittemore (a.k.a. NLW, host of the AI Daily Brief & CEO, Super.ai) at the at the AI Engineer World’s Fair, full production deployment of AI agents in billion-dollar enterprises jumped from 11% to 42% in just the first three quarters of 2024 [03:15]. Why? It comes down to a brutal reality of economics, automation, and what I call the “2% vs. 20% ROI Gap.”

AI is Automation (Just Less Consistent)

Many AI enthusiasts argue that automation isn’t AI. That’s true in the sense that not all fruits are apples, but all apples are fruits. AI is automation. The primary difference? Traditional automation is deterministic (consistent); AI is probabilistic (less consistent, but more capable). Smaller companies are already masters of traditional automation because they have to be. They use it to survive with fewer people. But for a massive corporation, the “low-hanging fruit” of basic automation hasn’t even been picked yet. This creates a massive opportunity for Information Gain—the ability to apply AI to “messy” processes that were previously too expensive to automate.

The Math: The 2% vs. 20% Rule

The biggest “moat” for big business isn’t their data or their brand—it’s their Scale ROI. Because a large company doesn’t need significantly more resources than a small company to build a single AI agent or workflow, the math of deployment looks very different:

  • For the Small Business: To pay for the initial R&D and resource overhead, a new AI tool might need to deliver a 20% improvement in efficiency just to break even.
  • For the Enterprise: Because they are applying that tool across thousands of employees or millions of transactions, a mere 2% improvement creates an ROI that justifies the entire department.

Furthermore, as NLW points out, these large organizations are moving toward Systemic Adoption [17:00]. They aren’t just doing “spot experiments”; they are thinking cross-disciplinarily. They can afford to go slower, spend more on high-quality resources, and leverage volume discounts that drive their production costs down even further.

The “Risk Reduction” Transformation

Interestingly, while most companies start with “Time Savings” (the default ROI metric), the real “transformational” wins are happening elsewhere. NLW’s study found that Risk Reduction—while the least common primary goal—was the most likely to result in “transformational” impact [14:59]. Large companies have massive back-office, compliance, and risk burdens. AI can handle the sheer volume of these tasks in ways a human team never could [15:17]. This is a “moat” that small businesses simply don’t have to worry about yet.

The Cycle: From Moat to Commodity

This scale is the moat that gives big business a temporary advantage. But here is the irony: The more they use that advantage, the faster the moat shrinks. As enterprises productionize these efficiencies, they effectively commoditize them. What cost a Fortune 500 company $1 million to develop today will be a $20/month SaaS plugin for a small business tomorrow. We are in a cycle of:

  1. Hype: Everyone talks.
  2. Value: Big companies productionize at scale.
  3. Cheap: The tech becomes a commodity.
  4. Reverse Leverage: Small, disruptive players use those same cheap tools to move faster and out-innovate the giants.

The giants are winning the production race today, but they are also building the very tools that the next generation of “disruptors” will use to tear them down.

If you found this interesting, please share.

© Scott S. Nelson