Aggregator

๐Ÿ“„ Balancing ambition and caution in LGR

3 days 12 hours ago
Chatting with Clare this morning about all things digital and local government reorganisation, I came to the conclusion that it really is all a balancing act. The risks of things going wrong are huge, and the importance of being ‘safe and legal’ is vital… but at the same time this is a generational opportunity for ... Keep reading
Dave

๐Ÿ“… Daily Note: June 5, 2025

1 week 4 days ago
Really helpful stuff from Jason Kitcat at the Department for Business and Trade on matrix working. # – micropost 22920 Some interesting notes on the issues around the software market for local government. # – micropost 22934 My general take these days is that the local gov software market isn’t necessarily broken – it’s probably ... Keep reading
Dave

๐Ÿ’ป New Mac, new setup (June 2025)

1 week 6 days ago
I’ve recently moved into an office in the garden – a fancy shed, in other words. Doing so exposed a weakness in my tech setup, based as it was on a Mac Mini. When I returned to the house, I couldn’t access my computer! Now, wellness gurus would probably be yelling “GOOD!” at me at ... Keep reading
Dave

๐Ÿ“… Daily Note: June 3, 2025

1 week 6 days ago
Nice, insightful set of principles around how Martin Wright writes his weeknotes: I write about whatโ€™s stuck with me when I sit down to write my weeknote. I donโ€™t want to assume whatโ€™s important, or interesting enough to weeknote while itโ€™s happening, so I donโ€™t take notes during the week to feature in my weeknote. ... Keep reading
Dave

๐Ÿ“… Daily Note: May 21, 2025

3 weeks 5 days ago
Eddie Copeland writes helpfully and convincingly on the future of local government digital leadership following the mention of it in the government digital blueprint. Tried to pull out a bit for a quote but couldnโ€™t it was all good. In all the research work I have done in the last year or so, leadership comes ... Keep reading
Dave

Small language models: a big idea for the public sector?

1 month 1 week ago

It's likely there are hundreds of solutions that utilise generative artificial intelligence (GenAI) already in use across the public sector. Where I work we're already using AI for a variety of tasks, from drafting reports using i.AI's pilot of Minute, or writing job applications which we developed ourselves.

Under the surface of these solutions you'll find many have at least one thing in common; They are essentially user interfaces for large language models (LLMs) owned by OpenAI, Amazon, Google, or Meta.

We've seen a lot about scaling up the use of AI in the public sector recently, and this letter from the Department of Science, Innovation, and Technology states that the Government calculated their efficiency targets using the assumption that 100% of routine tasks could be automated.

Whether that's achievable is a question for another time, but even if half of that target was reached, that's 50% of UK public sector tasks essentially outsourced to US tech giants.

A Small Language Model (SLM) is a compact, efficient version of a LLM, designed to perform well with fewer computational resources.

Unlike LLM  such as OpenAI's GPT-4 (with trillion-scale parameters), SLMs typically range from a few million to around 10 billion parameters, making them faster, cheaper, and easier to deploy especially for specialised tasks.

Most interaction with the public sector is for a single simple task; renewing a passport, ordering a new bin, making a doctor's appointment, and so on.  I know this is true in local government having looked at councils' website analytics. There will always be users who need help from multiple teams or organisations, but that sort of requirement wouldn't be a routine task.

So here's my notion: small language models could save the public sector.

Lets take planning for example. Generative AI for planning doesn't need a LLM that's been trained on the collective works of Shakespeare, the laws of thermodynamics, and the synopsis of every episode of Friends, it just needs a SLM that's been trained on UK planning law, planning application formats, planning report formats and so on.

Using a LLM is like trying to do your weekly shop in a monster truck. Sure if you can make it road legal (or in AI terms, get it through a governance process) it's probably possible, but you'll take up much more space and use far more fuel that you actually need.

SLMs could be built, or commissioned, hosted, and owned by the UK Government, the NHS, or local government, therefore retaining control here, and could be updated quickly when UK legislation changes.

I would love to know if this approach is already being thought of, or even adopted in the UK, or anywhere else in the world, and as always, I welcome your comments below.


Phil Rumens