Benchmarks
Measuring the dimension the incumbents do not
Nobody benchmarks 8 kHz African telephony audio with local surnames, regional currencies and code-switched dialects in it. So nobody optimises for it, so everybody is bad at it — and a buyer with exactly that problem has nowhere to go for a number they can trust.
African Telephony Speech Benchmark
In development8 kHz narrowband, code-switched, entity-dense. Every existing African speech benchmark measures clean audio, which is why every system scores well on them and badly on a phone call.
Key regional languages · 2,400 utterances · named entities and local currencies labelled
African Named-Entity Accuracy Suite
In developmentPerson names, bank and fintech names, place names and currency, scored separately from the surrounding speech. Frontier systems run 40–70% WER here against 25–35% overall, and no public benchmark isolates it.
4,000+ entities · Surface forms across high-traffic African language clusters
Low-Resource Translation Benchmark
PlannedDomain-matched rather than scripture-matched. A large share of available African-language text is religious, news or government notice, and none of it resembles a support conversation.
Financial services, healthcare and civic domains
Dialect Recognition Benchmark
PlannedDialect identification within a language, which is where collection cost and model behaviour actually diverge — and which almost nothing measures.
Dialect clusters across East, West, and Southern African languages