# Researchers test Typed-Decision models on Indonesian regional languages

Digest AI · Research · published 2026-10-14T04:00:00Z

Canonical: https://digestai.news/story/researchers-test-typed-decision-models-on-indonesian-regional-language

## Summary

A new study evaluates typed-decision models—fast, low-cost systems that return labels and probabilities in one step—on Indonesian regional languages. The paper, posted on arXiv, compares the commercial **Jev** model and the open-source **Laya-multilingual** model using two datasets: **NusaX sentiment** (12 languages) and **NusaTranslation sentiment and emotion** (7 languages).

The findings show **Jev** performs better on sentences closer to Indonesian but struggles with distant languages, where accuracy improves by up to **37.2 points** when given human Indonesian translations. While its calibration error remains stable, its ability to self-rank errors weakens. Retraining classifiers requires **more than 500 labels per language** to match **Jev**’s zero-shot performance in nine of ten **NusaX** languages. A hybrid approach—routing **Jev**’s least confident decisions (10–30%) to a local **IndoBERT** classifier—matches or exceeds the best system at **24–77% lower API cost** than routing to an LLM. Five other commercial LLMs (three **Claude** and three **GPT** models) outperform **Jev** by **4–14 points** but cost hundreds of times more.

## Key points

- Typed-decision models like **Jev** and **Laya-multilingual** tested on 12+ Indonesian regional languages using **NusaX** and **NusaTranslation** datasets
- **Jev**’s accuracy rises by up to **37.2 points** with Indonesian translations for distant languages, but self-error ranking degrades
- A hybrid cascade (routing low-confidence outputs to **IndoBERT**) matches LLM performance at **24–77% lower cost**

## Why it matters

Proves typed-decision models can generalize beyond English, offering a cheaper alternative for low-resource languages if calibrated with translations.

## Sources

1. [Does System One Transfer? Calibrated Typed-Decision Models, Label Budgets, and Translation for Indonesian Regional Languages](https://arxiv.org/abs/2610.14112) (arXiv cs.CL, 2026-10-14, primary source)

## Cite

Digest AI, "Researchers test Typed-Decision models on Indonesian regional languages", 14 October 2026, https://digestai.news/story/researchers-test-typed-decision-models-on-indonesian-regional-language

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/researchers-test-typed-decision-models-on-indonesian-regional-language.json