Irish speech to text. The most accurate in GASTON
Our own speech-to-text model for Irish, trained on about 1,890 hours of Irish speech. It turns radio, podcasts, parliament debates and interviews into searchable text, with timestamps for every word.
Word error rate counts the words that differ from a careful human transcript. Lower is better.
About half the word errors of ElevenLabs Scribe v2
We ran ElevenLabs Scribe v2, set to Irish, and BuzzASR, the public Irish fine-tune of OpenAI Whisper, on the same four public test sets and scored all of them the same way. Averaged over the four sets, our model gets 24.3% of words wrong, Scribe v2 46.2%.
The gap is widest on parliament speech and on dialect recordings. Stock OpenAI Whisper has no Irish option at all: forced to transcribe Irish, its error rate is above 100%.
Tested in November 2026 on 4,680 clips (about 14 hours), the full public test sets. Scribe v2 ran through the ElevenLabs API with the language set to Irish. 95% confidence intervals for our lead over Scribe v2: 21 to 22 points (Oireachtas), 29 to 34 (Canúint), 10 to 12 (FLEURS), 22 to 25 (Common Voice). Commercial models change over time.
* BuzzASR is not scored on Common Voice: its training data contains the sentences of that test set.
Accuracy by kind of audio
Besides the four public test sets, we measure two harder, non-public ones: Irish YouTube videos and spontaneous conversation recorded in Mayo. Those two stay in-house, so only our own model is scored on them.
Scored against partly condensed subtitles, so this figure is too high.
The hardest kind of Irish audio we test.
Word error rate in percent, on normalised text, decoded with beam search 5.
Best on clear speech that is mostly Irish
A usable transcript. Roughly 1 word in 5 to 8 is wrong, and often only in its spelling or ending, for example bhí instead of bhíomar.
Much rougher: up to 1 word in 2 can be wrong. Treat these transcripts as a best-effort draft.
What went into it
We started from OpenAI Whisper large-v3 and fine-tuned the whole model on Irish speech: parliament committees, dialect recordings, read sentences, podcasts, radio and YouTube.
Audio from the test sets was kept out of every training version.
Training clips are randomly altered this way, so the model copes with real uploads, not only studio audio.
What you get
The model runs inside the Gaston transcription service, so every Irish recording becomes a transcript you can search, translate, bookmark and export.
- •Spontaneous conversation and strong dialect
- •Old archive recordings
- •English passages inside Irish audio
- •Word endings and initial mutations
How we measured
- Decoded the way the production service runs it, with beam search 5, and scored on normalised text.
- The six test sets were frozen in October 2026 and kept out of every training version.
- The public Common Voice training split contains sentences from its own test split. We removed 5,373 of them from training, so that score is not inflated.
| Test set | Kind of audio |
|---|---|
Common Voice ga-IE Mozilla · CC0 |
Short read sentences |
FLEURS ga_ie Google · CC-BY-4.0 |
Read Wikipedia sentences, many speakers |
Oireachtas Houses of the Oireachtas |
Parliament committees, checked against the official record |
Canúint canuint.ie |
Dialect archive, older recordings |
abairt.com abairt.com |
Spontaneous conversation, Mayo dialect |
YouTube Gaston |
Vlogs, interviews, multi-speaker video, scored against partly condensed subtitles |
Credits
This model builds on openly shared Irish speech data and tools. Thank you to everyone who built and shared them.
- Based on OpenAI Whisper large-v3 (MIT)
- Houses of the Oireachtas (official record of proceedings)
- Google FLEURS, CC-BY-4.0
- Mozilla Common Voice, CC0
- jimregan/wav2vec2-large-xlsr-irish-basic (word timestamps)
- MUSAN corpus (background noise)
Try it on your own Irish recordings
Upload a file or paste a YouTube link, and Gaston does the rest.
Create an account