Why LLMs make things up

Because we taught them that guessing pays. Picture a multiple-choice exam with no negative marking. Right answer, one mark. Wrong answer, nothing. Leave it blank, nothing. Any student worth their salt guesses every time. You can never do worse. In September 2025 a group of OpenAI researchers argued that this is how language models are …

Lawyers are small language models

We were doing this long before the machines. Think about how a junior learns. Years of reading judgments, heads, pleadings, affidavits. Nobody hands you the rules for how a court writes. You soak it up. After a while you can guess what the next paragraph of a judgment will say before you turn the page. …

How OCR works, and why it never tells you it guessed

A scan is a photograph of words. OCR is the bit that tries to turn it back into words. When you scan a page, the computer does not get words. It gets a picture. Millions of dots, some dark, some light. To you it says “the respondent is not liable”. To the computer it is …

I am not a coder. This is how I started.

I missed the first AI wave because I assumed it was for people who understand terminals. It isn’t. I am an advocate in Johannesburg, about 25 years in. We have a referral profession here: I work for my own account and take instructions from attorneys, not directly from clients. But the work will look familiar …

Names of non-existent cases are not law

The usual AI horror story has counsel in the dock. This time the fake case was in the judgment. We have all read the stories by now. Counsel files heads, the other side cannot find a case, the court goes looking, and a very uncomfortable costs hearing follows. Legal Twitter enjoys it. The rest of …

The PDF is not your friend

It will secretly betray you. Lawyers and PDFs go together like – choose your preferred comparison. We can’t help it, they are everywhere in our working lives. And by and large they work really well, except when Adobe turns random pages upside down. But that’s an obvious problem. This note is about the hidden dangers …