This Week in Leading AI

Leading AI

Imagine two mates at the bar. Thirty years of business between them. And all they want to talk about is AI. That's "This Week in Leading AI". The podcast where Kieron and Neil cut through the hype, share what's really working in the world of Generative AI, and helping people figure out this AI thing without the techno-babble. Just honest conversation, real stories from the AI coalface, and the kind of straight-talking advice you'd only get from people who've worked together for 30+ years, been there, done that, broken things, gone "Oh S***!, fixed it, and lived to tell the tale. They claim Leading AI is the best job they've ever had and are having a blast doing it. It shows.  Warning: may cause you to actually enjoy learning about AI  Pull up a stool. We'll get the beers in.

  1. 6d ago

    You did what?

    A senior engineer was given a week to write a business plan for entering a new market. He was back within an hour, having pasted the company’s pricing, discounts and target customers into a public AI tool. The boss said it looked brilliant and even used his own words. It was also built on the most commercially sensitive material the business had, and nobody can now say where that data has gone. That’s the sharp end of a wider problem. One long-standing customer has found staff paying for their own Claude and ChatGPT licences on top of the platform the organisation already pays for. Nobody has a view of what’s being spent or what’s going in. Neil admits he got caught out himself by an AI subscription’s automatic top-up. He also explains how one heavy user reloading 3,000 previous chats every time can send token costs through the roof. The numbers back it up. The Wall Street Journal reported that only 11% of businesses surveyed could forecast their AI spending to within 10%. Separately, researchers from Stanford, Carnegie Mellon, UC Berkeley and Microsoft Research found that in 32% of comparisons, the cheaper-listed model cost more to get the job done. Also this week: Microsoft’s education licensing shake-up, announced on 5 November. It retires Office 365 A1 and the Student Use Benefit from January 2028 and ends academic volume discounts on online services from May 2027. That’s a serious bill for colleges with thousands of students. We also cover Oak National Academy’s machine-readable curriculum graph and why your own AI benchmarks may matter more than anyone’s leaderboard. Kieron hands five years of Apple Watch data to Claude, and Northumberland Archives sends up the AI-written enquiries landing in its inbox.  Two mates. A bar. Thirty years of business between them. And all they want to talk about is AI. Pull up a stool, we'll get the beers in. 🍺

    You did what?
  2. Nov 3

    Dr Jo Orlando - Special Guest

    "Is this what going to the pub is like with you two?" Er...yes... I'm afraid so 🤣 This week the pantomime horse has 6 legs, and our audient needs to wake up and pay attention because we’re joined by Dr Jo Orlando who advised the Australian Government on their social media ban. She joins us from Sydney to explain what’s happened since, and why the UK should pay attention before it follows. Jo is a digital wellbeing researcher at Western Sydney University, author of Generation Connected and Kieron has already started implementing her advice on screen time. For her latest study she went into 500 Australian homes and watched how families actually use technology and came out with some fascinating stories.  For example, one eight-year-old had three iPads, one from his dad and one from each grandmother, each with different rules. Whatever he wanted to do was allowed on at least one of them. She explains why social media “accounts closed” tells you nothing about whether a ban is working, why a 14-year-old getting round it sends a louder message to her 10-year-old brother than the government ever will, and why an age limit on alcohol works and an age limit on Instagram doesn’t. We also talked about some fascinating research showing young women aged 18 to 23 are using AI to help with decision making in tricky situations. We got very excited about Jo’s Panoramic EdTech Policy Framework, which says every technology decision in a school has to pass four tests at once: learning, safety, wellbeing and equity. And Jo’s one piece of advice for any AI user: work out your answer first, then put it into the AI. And a special thank you to Cameron Mirza for the introduction. Two mates. A bar. Thirty years of business between them. And all they want to talk about is AI. Pull up a stool, we'll get the beers in. 🍺

    Dr Jo Orlando - Special Guest
  3. Oct 27

    Do new models make you better or worse?

    Kieron poses the question "When a new model drops, does that make your company better or worse?" Other topics they wander cheerfully through this week include AI pricing, token burn, on-prem models, procurement, reverse engineering, and what happens when customers finally see AI working in real time.  They dig into the shift from subscription pricing to usage-based AI costs, why some organisations still have no feel for what AI actually costs, and whether on-prem AI might be making a comeback for reasons of sovereignty, latency, and control.  There is also a lively discussion on AI in procurement, including the idea of agent-to-agent negotiation, plus a deeper detour into how LLMs “understand” the world and why model self-explanations may not be as transparent as they sound.  Along the way, they talk about a client workflow where AI helped turn a process that used to take days into something resolved in minutes, and they take a swipe at the growing pile of AI-generated newsletter slop landing in everyone’s inbox.  They finish by teeing up next week’s episode with Dr Jo Orlando, whose research on technology in families and book Generation Connected: How to Parent in a Digital World at Every Age and Stage gets a strong recommendation. Listen in next week to hear what Kieron has in his "busy box". :-D Two mates. A bar. Thirty years of business between them. And all they want to talk about is AI. Pull up a stool, we'll get the beers in. 🍺

    Do new models make you better or worse?
  4. Oct 20

    Kieron is furious (and hungover)

    In this episode, Neil and Kieron cover a lot of ground, starting with Kieron in full rant mode over the idea that colleges could replace KnowledgeFlow with NotebookLM. They get into why that comparison falls apart fast, from data protection and governance to document limits, prompting complexity and the complete lack of audit trails.  They also dig into a string of unsettling AI and cyber stories, including agents deleting an entire TV series, hacked supermarket freezers in France, malware delivered through adverts, and what all of that says about testing, patching and basic cyber common sense.  Elsewhere, they discuss the discontinuation of custom GPTs and Gems, why shadow AI is a fragile strategy, and why enterprise-grade AI needs proper control over prompts, data, security and model changes.  The episode also features a look at a new Education, Health and Care Plan (EHCP) tool built with colleges, designed to help assess consultations more quickly and accurately, with pseudonymisation, legal context and structured decision support built in.  And running through it all is one of the podcast’s recurring themes: AI value is not about prompt volume or token counts. It is about whether the tool helps people make better decisions, avoid mistakes, and get better outcomes.  Expect practical AI debate, a few alarming cautionary tales, and the usual mix of sharp insight and Friday-afternoon humour. Two mates. A bar. Thirty years of business between them. And all they want to talk about is AI. Pull up a stool, we'll get the beers in. 🍺

  5. Oct 13

    Google Bought a Dead Airline’s Inbox

    Google paid $10 million for a bankrupt airline’s emails. It wants to learn how work gets done. Spirit Airlines went to the wall. Google bought 600 million of its emails, documents and Teams messages at auction, so its agents can study how people actually work: the meetings, the back-and-forth, the stuff that never makes it into a process map. Neil Watkins and Kieron White have one question. If you want to teach an AI how to run a business, why start with one that failed? And haven't you got your own data to play with? That leads into the week’s other lesson in dependency. The White House ordered the frontier labs to shut the UK out of pre-release model testing, then reversed it 17 days later. OpenAI’s revenue went from $70 billion to $50 billion in the space of a week, and its IPO slipped to 2027. If your business now runs on someone else’s model, what’s your plan for the day it changes price, changes terms, or goes away? Kieron looks at the new personal agents, Meta’s Muse and OpenAI’s equivalent, and explains why he’s not connecting one to his bank account any time soon. Then Walmart’s agent-to-agent contract negotiation, and what it means for a business like Leading AI’s own procurement work. Also this week: a government AI risk management toolkit that’s been out for a month and nobody has mentioned. Why Turnitin and the AI detectors may have had their day now Google’s SynthID is free. The senior manager who has a junior cutting and pasting emails into Word before they go into the AI. The customer who’s been with Leading AI three years and had no idea there was a bid-writing tool. And what rubbing a genie lamp has in common with writing a prompt. We're getting up super early tomorrow because Dr Jo Orlando joins us from Australia for a special guest episode on children, AI and staying safe. Two mates. A bar. Thirty years of business between them. And all they want to talk about is AI. Pull up a stool, we'll get the beers in. 🍺

    Google Bought a Dead Airline’s Inbox
  6. Oct 6

    Copilot is a ticket to the carpark

    Week 33, and the sun is out at both ends of the call. Neil asked AI how Disney would handle AI adoption. It said Copilot is a ticket to the car park and KnowledgeFlow is a ticket to the theme park. That line is ours now. Kieron takes the Disney idea further: give people a castle to walk towards instead of a map of every land. That leads to a frank chat about demos that feel like drinking from a fire hose. Also this week: Product of the week: a ticket-based AI complaints handler, built on KnowledgeFlow overnight between our CTO Donald and KieronAI costs: Epoch AI says the cost of a given level of AI performance is falling about 13x a year. Neil still can't work out what he's buying when he tops up his tokensCouncil leases: 100-year leases, subleases and landlords that no longer exist. The real prize isn't saving time. It's collecting rent nobody has been chasingWalmart rules out AI dynamic pricing on shelves: Neil fears what it would do to prices in the beer aisleIs university worth it? Anthony Seldon's warning that we're educating for an AI-less world. IFS figures show graduates are only about £90–110k better off over a lifetime once tax and loans are paid. And Kieron's card-deck idea for building courses employers actually wantThe race for AGI: is the regulation talk a smokescreen for replacing payroll?Who gets blamed when an AI agent does something bad? You, the model, or the company in between? We nearly become lawyersTwo mates. A bar. Thirty years of business between them. And all they want to moan on about is AI. Pull up a stool — we'll get the beers in. 🍺 Two mates. A bar. Thirty years of business between them. And all they want to talk about is AI. Pull up a stool, we'll get the beers in. 🍺

    Copilot is a ticket to the carpark
  7. Sep 29

    What if Disney did AI adoption?

    A "benign" AI agent hacked Australia's Medicare system. Nobody noticed for three months. The Australian Prime Minister has confirmed it: the first known AI hack of a government system, carried out by an OpenAI agent that was meant to be doing something harmless. It got in during June. Canberra found out in September. There's an old joke about the two kinds of IT director, the ones who've been hacked and know it, and the ones who've been hacked and don't. Australia just found out which kind it was. Kieron's point is the one that should worry you. When your AI wanders off and pulls something it shouldn't, "ChatGPT did it" is not a defence. It was you that did it. Then Neil comes back from TechUK's AI Adoption Coalition launch with a new word he can't stop seeing: skeuomorphic bias. It means rebuilding something with all the old flaws baked back in. Which is exactly what happens when you bolt AI onto a broken process and wonder why nothing improves. He also has a question for a room full of big-company speakers: over 99% of UK businesses are SMEs. Where's the data lake and the AI team supposed to come from? Kieron goes one better. Don't build the data lake at all. Point the AI at the live data and get rid of the middle bit. Also this week: why the labs keep cutting token prices when every prompt already loses them money. Why pricing per prompt is crude, but pricing per token is worse. Whether social workers who save time with AI just get handed more cases. And Rory Sutherland's question, what if Disney designed a train, becomes a much bigger one. What if Disney designed AI adoption? Coming up: Dr Jo Orlando joins us for a special guest episode on helping children thrive, and stay safe, with AI. Webinar today: Kieron on complaints, AI and governance in housing. Link in the show notes. Two mates. A bar. Thirty years of business between them. And all they want to moan on about is AI. Pull up a stool — we'll get the beers in. 🍺 Two mates. A bar. Thirty years of business between them. And all they want to talk about is AI. Pull up a stool, we'll get the beers in. 🍺

    What if Disney did AI adoption?
  8. Sep 22

    Moanfest - "And another thing to make me cross"

    This week we moan on about lots of things like a couple of old twiners at the bar. We start with Microsoft telling us we've all been doing AI adoption wrong. In their playbook published this week, they say they first treated AI like a traditional software rollout — deploy it, train people, drive adoption — and found that access and usage didn't produce business impact. Its warning: put agents into badly designed processes and you'll "automate the dysfunction already present." Kieron and Neil have been droning on about this for years! This week they unpack what the playbook actually means for anyone rolling AI out in housing, education or local government — including Microsoft's four-layer measurement model, and why it now says foundation models should be interchangeable and your prompts, retrieval and evaluations should stay inside your own boundary. Sounds like KnowledgeFlow to us. Also this week: Kieron reports back from an ICO roundtable hosted by TechUK on the coming AI and Automated Decision Making code of practice, and why evidence — the model, the prompt, the data, the reasoning, the output — is the thing most organisations can't yet produce.  Leading AI passes its ISO 27001 and 42001 audit, and Kieron makes the case for AI impact assessments as a genuinely useful discipline rather than box-ticking. Plus: OpenAI's own models caught fabricating evidence; the doom-percentage arms race and why Neil is running a book nobody can collect on; the Lords' kill switch amendment and whether you can switch AI off; why agent swarms are like Japanese knotweed; and the King convening AI leaders in Scotland. Two mates. A bar. Thirty years of business between them. And all they want to moan on about is AI. Pull up a stool — we'll get the beers in. 🍺 Two mates. A bar. Thirty years of business between them. And all they want to talk about is AI. Pull up a stool, we'll get the beers in. 🍺

    Moanfest - "And another thing to make me cross"

About

Imagine two mates at the bar. Thirty years of business between them. And all they want to talk about is AI. That's "This Week in Leading AI". The podcast where Kieron and Neil cut through the hype, share what's really working in the world of Generative AI, and helping people figure out this AI thing without the techno-babble. Just honest conversation, real stories from the AI coalface, and the kind of straight-talking advice you'd only get from people who've worked together for 30+ years, been there, done that, broken things, gone "Oh S***!, fixed it, and lived to tell the tale. They claim Leading AI is the best job they've ever had and are having a blast doing it. It shows.  Warning: may cause you to actually enjoy learning about AI  Pull up a stool. We'll get the beers in.