Anyone used an AI package to decipher handwritten text?

WIAWSNB

I've come across Transkribus, and will be giving it a shot.

Curious as to whether anyone has used any of these, and how well it worked?

Ta.

elsien

Not AI, but I have used whatever package is on our work software to change handwriting to text.

This may be a reflection on my handwriting, but the outcome is terrible.

Farway

I used Gemini to decipher, transcribe, and translate, handwritten Old [1917] German handwriting. It worked a treat.

I made sure to tell it not to guess or insert other words

Took photo and inserted that in Gemini with instruction to transcribe and translate

Not only did it do as asked, it also gave, unasked, historical background on the details contained within the text

Nothing to lose & it's free. I was vey impressed.

WIAWSNB

https://forums.moneysavingexpert.com/discussion/comment/81918460#Comment_81918460

Thanks, but it has to be waaay more sophisticated than OCR. If your handwriting is terrible this one is diabolical…

WIAWSNB

https://forums.moneysavingexpert.com/discussion/comment/81918501#Comment_81918501

Interesting, thank you. I'll give that a bash too.

I'll make sure to scan and keep it as crisp as possible.

Edit: OH MAAA GAAAWD! It is incredible!

Farway

https://forums.moneysavingexpert.com/discussion/comment/81918543#Comment_81918543

Go on, let us out of our misery, did it work wonders for you?

WIAWSNB

https://forums.moneysavingexpert.com/discussion/comment/81918799#Comment_81918799

Not only did it fully decipher what was the most spidery and scrawny of handwriting - I am genuinely saying that half of it was illegible, and the rest painful - but it provided an introduction of the content, a conclusion, and unravelled acronyms. It even pointed out that some of the writing had a squiggly line drawn through it, and suggested reasons for this.

My jaw is still on the floor.

HillStreetBlues

https://forums.moneysavingexpert.com/discussion/comment/81918799#Comment_81918799

Double Diamond use to for me.

LightFlare

just to play devils advocate- it handwriting is illegible, then how do you know if any translation is correct

The AI is probably just performing a best guess based on grammar,sentence structure and subject

Whilst it may be impressive - I probably would t 100% rely on it

WIAWSNB

https://forums.moneysavingexpert.com/discussion/comment/81921168#Comment_81921168

Very valid point.

The handwriting is very difficult to read - it's slow work - and some words have been indecipherable unless studied repeatedly, and obviously in context.

It could be done manually - by eyeball - but it's not tenable as the time taken would be excessive.

With the translation, it's relatively easy to go back and compare, and it's then obvious whether it got it right.

Most of the stuff isn't important, but it'll certainly help to find the parts that are.

I will have a story to tell at some point.

AstonSmith

I have also had lots of success using Gemini to decipher handwriting on old GRO certificates. Copilot was giving me very weird answers, so I don't recommend that.