2d ago

Moanfest - "And another thing to make me cross"

This week we moan on about lots of things like a couple of old twiners at the bar. We start with Microsoft telling us we've all been doing AI adoption wrong. In their playbook published this week, they say they first treated AI like a traditional software rollout — deploy it, train people, drive adoption — and found that access and usage didn't produce business impact. Its warning: put agents into badly designed processes and you'll "automate the dysfunction already present." Kieron and Neil have been droning on about this for years! This week they unpack what the playbook actually means for anyone rolling AI out in housing, education or local government — including Microsoft's four-layer measurement model, and why it now says foundation models should be interchangeable and your prompts, retrieval and evaluations should stay inside your own boundary. Sounds like KnowledgeFlow to us. Also this week: Kieron reports back from an ICO roundtable hosted by TechUK on the coming AI and Automated Decision Making code of practice, and why evidence — the model, the prompt, the data, the reasoning, the output — is the thing most organisations can't yet produce. Leading AI passes its ISO 27001 and 42001 audit, and Kieron makes the case for AI impact assessments as a genuinely useful discipline rather than box-ticking. Plus: OpenAI's own models caught fabricating evidence; the doom-percentage arms race and why Neil is running a book nobody can collect on; the Lords' kill switch amendment and whether you can switch AI off; why agent swarms are like Japanese knotweed; and the King convening AI leaders in Scotland. Two mates. A bar. Thirty years of business between them. And all they want to moan on about is AI. Pull up a stool — we'll get the beers in. 🍺

Sep 15

Will AI kill us all?

Both Kieron and Neil have been gallivanting round the country all week, both are recording on a Friday afternoon with the pub in sight, and Neil has already had a text from a mate asking where he is. Housing Community Summit — a full room, and one uncomfortable answer Kieron was back in Liverpool, this time speaking solo to a breakout session of CEOs and chairs. The stats he opened with tell the whole story of AI in housing right now: 76% of housing staff say they use AI. 69% of the public don't know AI is being used in public services at all, and don't trust it. 87% rate their own AI skills as low. And 44% of organisations still have no AI policy. Enormous usage, by people who'll openly tell you they don't know much about it, with nothing written down about what they should or shouldn't be doing. Then he asked the room how they know they can trust their AI's responses. The headline answer: we don't know. So he sent them five questions to take back to their teams: Which documents does it read, and who keeps those current? Can it show its sources, so an answer can be checked rather than just trusted? Who built it, who signed it off, and who reviews it? What happens when a policy changes — does the agent change with it? Would you be comfortable if this answer reached a resident, the regulator, or the ombudsman? If you can't answer those, you've got work to do. The complaint that came back from its own reply Neil was chatting to a friend (in a bar, obvs) who lives in a housing association property. He'd put in a complaint last week, ten pages, written with the help of AI. He got a response but couldn't tell whether it was AI or not. That's good because the housing association is a Leading AI customer so there's a reasonable chance KnowledgeFlow wrote the reply. Complaints in housing are up 90%, and one report this week says they've doubled since ChatGPT. The genuinely good side: people who'd struggle to write a compelling complaint can now represent themselves properly. The difficult side for housing thought is there's no change to statutory response times so they're having to deal with twice the volume and ten times the size. "Which bit of stupid is that?" A customer emailed Neil to explain they'd been busy so hadn't moved their AI adoption on, but mentioned in passing that one of the team had put a load of confidential information into a public AI tool to produce a three-page report which they thought was "great". This is an organisation that has a private, secure AI assistant built specifically so that wouldn't happen. Dumb. The formatting was lovely, apparently. Are we all going to die? A 10% chance, apparently Kieron got asked about the Anthropic researcher's resignation on a webinar with the Moving On Up team and gave the honest answer "You're about as qualified to assess that number as I am." The more useful point came from a Radio 4 interview which said you can't buy a sandwich, board a plane, or ride in a lift without a regulatory framework, and yet you can build superintelligence, and the only real constraint is investment. The companies themselves are asking to be regulated. Nobody's going to stop first in a trillion-dollar race. A Singaporean government minister running his life on a $15 Raspberry Pi He uses a Raspberry PI with 8GB of RAM, a small local model, and it manages his schedule, drafts his speeches, and briefs him before visits. Which raises the trillion-dollar question: if that's all most people actually need, has everybody placed their bets in the wrong place? Meanwhile Nvidia posted $96.2 billion of revenue in a single quarter, up 106% year on year. And Kieron's mum is currently a data centre protester in Devon, banners up outside the house and everything. Watermarking, properly explained Donald got under the skin of how Claude's watermarking actually works. It isn't a label, it's a pattern woven through the way tokens are assembled, detectable if you hold the right key. Very clever, but easy to bypass by pasting the text into a different model and asking it to rewrite while retaining everything. So much for the end of the AI detector industry. Also: Daniel Susskind's book on teaching in an era of AI. PISA scores have fallen and haven't recovered post-pandemic, and his answer is to train children both with AI and without it so they understand the difference. Kieron tells the story of the 1890s New York horse manure crisis (he so full of **** 🤣). And the discovery that China's clampdown on AI companions applies only to Chinese citizens. Their companies are free to sell AI boyfriends and girlfriends abroad, though Neil doesn't think Mrs Watkins will allow him to have one and Kieron's worried about spending too much time on a screen without that kind of distraction. It's been one of those weeks... Two mates. A bar. Thirty years of business between them. And all they want to talk about is AI. Pull up a stool — we'll get the beers in. 🍺

Sep 8

Why don't they press the button?

There's a button that does the work for you. But nobody presses it. Why is that? Neil spent this week with a customer struggling with AI adoption, and got something you rarely get: time with the leadership team, the managers, and the people actually doing the job. The leadership were saying all the right things. Investing in AI. Making people's lives easier. Pushing forward. The managers were under time pressure, so they quietly revert to the old way of doing things. And the frontline staff were entering the same information into four separate systems and losing patience with all of it. Sitting in the middle of that is a Know Your Customer button. Press it, and it pulls together everything about that customer, summarises it, and shows you its sources. Ten seconds. This is an organisation talking to forty or fifty customers a day. Almost nobody uses it. That gap — between what the board thinks is happening and what's happening at a desk on a Tuesday — is the real AI adoption problem. Not the technology. Not the cost. Not whether the tool works. It works. It's the fact that under pressure, people fall back on what they've always done, and nobody in the middle has been given the room or the mandate to change that. Which is why the thing we most want to learn from the JISC pilot that launched today — ten colleges and universities, three months, all starting together — isn't which of our tools they liked best. It's what actually makes adoption work. Capture that properly across ten institutions and it's useful to the whole sector, whatever AI they end up buying. Also in this week's episode: KnowledgeFlow can now make live API calls into your systems, which changes complaints handling completely — one place, one version of the truth, with an evidence pack underneath proving exactly what was used. The £100m Sovereign AI Fund announcement that came with almost no information attached. And a Healthwatch England report on GP AI scribes making errors that patients are the ones catching — including one that dropped the word "no" from a diagnosis. Two mates. A bar. Thirty years of business between them. And all they want to talk about is AI. Pull up a stool — we'll get the beers in. 🍺

Sep 1

Keep on ********* on

It's a famous quote from Winston Churchill, but Kieron uses it about this podcast. Six months in, and nearly three years of Leading AI. Some of the challenges have changed markedly. Some haven't changed at all. Complaints are now a token war. The BBC published a piece this week on AI-driven complaints escalating across public services. The detail that stopped us: a grievance about uncollected bins came in between 19 and 27 pages with case law attachments. That would have been a phone call five years ago. The nuance Kieron draws out is the important bit though — AI has levelled the playing field for people whose complaints used to be ignored because they weren't well written. That's genuinely good. The workload consequences are genuinely brutal. And if organisations answer AI complaints with AI responses, which the complainant then feeds back into their AI — whose budget wins? The expert witness who got subpoenaed. A US trial where the judge spotted AI in an expert witness's report and subpoenaed his ChatGPT history. The whole thing had been generated start to finish, including the prompt asking it to argue the defendant bore zero percent responsibility. Shadow AI is moving into the foreground — and it lands squarely on the evidence pack work Leading AI has been building. Harari on AI consciousness, and China's ban. Neil read an Economist interview with Yuval Noah Harari, whose position is blunt: one definition of consciousness is the capacity to suffer, and an AI will tell you it suffers because that's what it's trained to do. The more urgent point is what happens when people believe it. China has now forced companies to strip the personality hooks out of their AI products — and people are complaining, because their AI partner always listened. As Neil puts it: when one of the most authoritarian countries in the world decides something is a bad idea for its citizens, the West might want to at least ask why. Forward deployed engineers and the last mile. The new Silicon Valley job title commanding $350,000 salaries, because embedding AI into an actual workflow turns out to be the hardest part of the whole thing. Three skills required: deep domain knowledge, technical ability, and process design. Which is precisely why the customer who insists the output must have the spelling mistakes in that box, in that font, in that colour is such a difficult problem — you're shoehorning AI onto a process nobody would design from scratch today. Watermarking, and the grey areas nobody thought through. Claude has watermarked all its models since 1 August. Kieron's first thought was that this ends the AI detector industry overnight. His second was harder: if you wrote the essay yourself and used AI for spelling and grammar, it's watermarked identically to one you never touched. Same flag, entirely different work. Nobody appears to have thought about that in advance. And in Glasgow, where they're currently filming Batman using the city as Gotham, the security teams have to sweep the set every morning for Irn-Bru cans the locals have hidden overnight. Keep an eye out when it's released. Two mates. A bar. Thirty years of business between them. And all they want to talk about is AI. Pull up a stool — we'll get the beers in. 🍺

Aug 25

Juliana Smith on doing something that actually helps humanity.

Six legs on the pantomime horse, and this time we didn't have to explain what a pantomime is because Juliana Smith who is from Brazil, now lives in Manchester and has a seven-year-old in a Manchester primary school, so she's already sat through Aladdin. Juliana's route here is unlike anyone we've had on. She's from Salvador on the northeast coast of Brazil, studied oceanography and physics, and started out validating ocean circulation forecasts for a South Atlantic research project run with the Brazilian Navy and Petrobras. Then years offshore as a navigator in oil and gas, including getting halfway through a crane operator certification because offshore you can't helicopter someone in to do it for you so someone had to drive the crane, and that someone was Juliane. An injury ended the navigating, and she arrived in Manchester with one obvious problem: I'm an oceanographer. There is no ocean here. Then AI arrived and she shut down completely. This is the bit that will resonate with anyone managing a resistant colleague. Juliana had done machine learning. She'd been building and validating models for years. And when the hype hit, her reaction was, why is everyone talking as if we've just invented the wheel? She stopped reading about it entirely. What brought her back wasn't a demo or a business case, it was the ethics. Transparency, principles, responsible design. That's what made her curious again. The question nobody asks about vibe coding. Juliana now builds tools with Lovable and Claude Code. But her point is one we hadn't heard put this clearly: you can vibe code anything — and you cannot see the back end. Export the code and you still won't understand it. So how do you know it's ethical? Her answer is properly practical. She asked the model which functions might unintentionally capture user data, got a list, and wrote a prompt to strip them out. No tracking, no ads. And she states publicly on her site that the tool was built with AI, and that no AI runs inside it — because she assumes her user doesn't know what that means unless she tells them. Why accessibility is personal. The injury left her with nerve damage in both hands and reduced dexterity. Back at work she was handed a standard mouse she physically couldn't use. She talks about the day she got new glasses after a year of blurry vision and could see people's faces again, and makes the point that you can explain that shift to someone for an entire day and they'll sympathise but never quite get it. Which is why she gives her accessibility work away free: charging for the features people depend on penalises the people who need them most. Also, the red-amber-green problem and why you can't find three colours that survive greyscale. Being told "you're not very technical, are you — you just do design," and building open-source tools partly to answer that. The mortality-rate spikes she assumed were data errors until she matched them to a Haitian earthquake. Fortran 77, MATLAB, VBA and why transferable skills still matter more than any one language. Her charity work as a trustee of Technology Books for Children. And Kieron's four hours in Salvador, courtesy of a 747 that diverted with a medical emergency and then couldn't find a fuel nozzle that fitted. Her line on the whole thing: we should spend less time trying to do bad things with AI, and more time doing something that actually helps humanity. Two mates and a new friend on the third stool. A bar. And all they want to talk about is AI. Pull up a stool — we'll get the beers in. 🍺

Aug 18

Su Belagodu and The Human in the Loop

Six legs on the pantomime horse again — and this time we had to explain what a pantomime horse actually is. Su Belagodu joins us from Winchester, Massachusetts (yes, we compared notes on the other Winchester), introduced by our previous guest Nicole Alos. Her first question after the explanation: "Are you the head or the back?" Kieron's answer: Neil's very firmly in the front. He's at the back, but driving. Su started in computer science until a manager told her she asked too many questions and wasn't a very good coder, so she should go into product. For Su that was a blessing in disguise. She's led healthcare startups, co-founded an AI-native company in 2024 when she didn't yet know what "agentic" meant, and now advises companies on the thing everyone gets wrong. The warm body problem. Everyone knows you need a human in the loop. So organisations drop a programme manager at the end of a workflow, tell them to approve things, and call it governance. Su's research, built on 40-plus interviews into a Human in the Loop Maturity Model, found what actually happens. After the first 20 or 30 approvals, confidence in the AI rises, fatigue sets in, and people start rubber-stamping. One human at the end of a workflow isn't oversight. It's poor design. Trust, quantified. Accountability × transparency × accuracy. Accountability means someone answerable who can actually change things. And the answer can never be "it was the AI." Perhaps her most incisive line in the chat was that enterprises aren't buying AI, they're buying confidence that AI won't add risk. That's why they don't adopt. Not cost. Not scepticism. Risk appetite. One-way doors and two-way doors. Taco Bell's AI took an order for "lots of water" and added 99 bottles. Annoying, reversible. Get a gas boiler enquiry wrong and it could have life-changing consequences. Design the checkpoints around which door you're walking through. Su also talked about pathology study where humans scored 97%, AI scored 98%, and the two together hit 99.8%. That's co-intelligence in one number. Safeguarding is a big topic for us and today Su explains why she tells her sixth-grader's AI class don't humanise it. Alexa and Siri trained us into blind trust, and no chatbot should replace a teacher or a counsellor. Management agents that supervise swarms of other agents (a callback to Kieron's son and his arguing bots). And Su turns the tables at the end to ask what AI adoption actually looks like in the UK, which gets us into the sovereign LLM problem, the Azure Foundry queue where Sweden gets everything first, and Kieron's line that deploying Copilot as your AI strategy is like handing everyone Excel and calling it data analytics. We've promised her a return at Christmas. In an actual pantomime horse outfit. She says she'll hold us to it. Two mates and a third stool with a new friend on. A bar. And all they want to talk about is AI. Pull up a stool — we'll get the beers in. 🍺

Aug 11

Cameron Mirza and the Learning Scientists

Some university leaders believe AI is free. Not cheap. Free. That's one of the findings from research by our special guest this week — Cameron Mirza, who leads major education projects in Jordan for IREX, the NGO working in over 100 countries, and who has just surveyed university AI readiness across 25 countries. Three-quarters of the respondents came from the Middle East and Africa, a perspective you rarely hear in the UK AI conversation. The headline numbers deserve a moment: Only 34% of institutions have a clear AI strategy. Only 39% have approved AI policies. Universities have grand AI ambitions — Cameron hears them in every president's office, complete with impressive PowerPoints — but ask a simple question like "can you give me an example of how you've used it?" and the fundamentals fall away. No strategy. No budget. No staff literacy. And in some cases, a genuine belief that the whole thing costs nothing. His diagnosis will sound familiar to anyone who's listened to this podcast: ambition driven by fear of missing out, budgets that don't match the rhetoric, and a rush to buy tools before anyone has worked out what problem they're solving. But the conversation goes much further than the survey. We get into why the Fable ban has made AI sovereignty the topic in every university leadership meeting from Nairobi to Abu Dhabi. Why offline LLMs and low-bandwidth design might matter more for global education equity than any frontier model. The Stanford research showing students achieve far more with a teacher plus AI than with AI alone. And Cameron's framing of the future of the profession, which Neil announced on air he was stealing: teachers as learning scientists — part educator, part data analyst, part behavioural scientist. Oh — and the story of how Cameron once collected four months of unpaid salary in cash, in carrier bags he had to fetch from the car, then hid it in suit pockets and under his mattress because the bank wouldn't take it all at once. You'll have to listen for the full glory of that one. We've known Cam for over 25 years, since the three of us fought the millennium bug together in Ford and then went on to the Department for Education. This one was a genuine pleasure. Two mates and an old friend. A bar. And all they want to talk about is AI. Pull up a stool — we'll get the beers in. 🍺 #AI #HigherEducation #AIinEducation #AISovereignty #EdTech #InternationalDevelopment #Podcast #AIStrategy #FutureOfWork

Aug 4

Donald Allison - The Big D, the brains behind KnowledgeFlow

Six legs on the pantomime horse this week. This time the third stool goes to the man who started it all, the on, the only Donald Allison, CTO and architect of KnowledgeFlow. The origin story is better than any of us remembered. In June 2022 Neil was getting ready to retire. Donald said don't do it because I've built this exciting thing with AI. In August, Kieron and Neil went to the biggest AI conference in the world in Vegas, got hideously sunburned, avoided the gaming tables, and had a minor incident in the Bellagio bar that remains permanently classified. They came back, went to see Donald, and a month later Leading AI existed. Donald had built a private ChatGPT before RAG had a name. Everyone he showed it to said the same thing: that's magic. Nobody believed it could do what it did. Three years on, this is the conversation about what's actually under the bonnet. It's the most technical episode we've done, but hopefully everyone will learn something from it. Why KnowledgeFlow lives in your Azure tenancy. Donald's answer is the cleanest argument for it we've heard: your security is already there. Role-based access, the lot. So why would you break that barrier and drag your board minutes, CVs and medical notes somewhere else — just to make the software easier to write? Better to write software that complements your security posture than one that dismantles it. The safeguarding filter that catches the question, not the answer. Edge devices filter what comes back. But if a student asks how to build a bomb, the LLM refuses — so the edge device sees nothing, and nobody ever knows the question was asked. Donald built it the other way round. Catch it before the LLM ever sees it. The browser extension nobody talks about. Use Azure or OpenAI APIs directly and internet retrieval goes out through their connection — quietly bypassing every firewall and filter you've got at the edge of your network. KnowledgeFlow routes it through the user's own browser, own gateway, own firewall. Kieron's summary: "So we're even more secure than Azure." The hardest thing he's ever built. The hardest thing to do in AI isn't unstructured date (like 700-page legal packs, or 1,00 PDFs). It's structured date like spreadsheets. A SQL database with 50,000 rows is harder than a library, because the differences between line 1 and line 427 are minuscule — and LLMs are built for unstructured data. As Kieron puts it: it knows the difference between a kettle and a car, but 10 and 11 look basically identical. The BidWriter argument. A customer handed it back this week. Kieron asks the uncomfortable question: should we retire some of the early tools? Neil defends it hard — 60% of a bid in two hours versus two weeks — and reminds everyone of the 190-question spreadsheet he cut and pasted for two days before Donald said "I can fix that" and built the button. Donald's verdict, and the line of the episode: give me a trowel and a pile of bricks and ask me to build a house — imagine what that's going to look like. Plenty of people can prompt. Most can't. That's who the tool is for. And the thing Kieron caught him building. Automated downtime alerts started pinging from something called "KnowledgeFlow for Procurement." Donald's response on air: "I don't know what you're talking about." Then, after a pause: "So, I've started to put the building blocks together." What's he most proud of after three years? Not the tech. The daily 09:30 team call. The team is scattered across the country, still here, still moving, working on things that help people who need it. As he puts it: we make a difference. Two mates and the man who built it. A bar. And all they want to talk about is AI. Pull up a stool — we'll get the beers in. 🍺

This Week in Leading AI

Moanfest - "And another thing to make me cross"

Will AI kill us all?

Why don't they press the button?

Keep on ********* on

Juliana Smith on doing something that actually helps humanity.

Su Belagodu and The Human in the Loop

Cameron Mirza and the Learning Scientists

Donald Allison - The Big D, the brains behind KnowledgeFlow

About

Information

This Week in Leading AI

Episodes

Moanfest - "And another thing to make me cross"

Will AI kill us all?

Why don't they press the button?

Keep on ********* on

Juliana Smith on doing something that actually helps humanity.

Su Belagodu and The Human in the Loop

Cameron Mirza and the Learning Scientists

Donald Allison - The Big D, the brains behind KnowledgeFlow

About

Information