Shufti-Sphere-Website-Banner
burger-menu cross-icon-2

Resources

us

216.73.216.52

Non-Latin Document Verification: What Western-Trained Models Cost You in Asia.

TL;DR

  • Asian IDs in Arabic, Thai, Vietnamese, Chinese, and South Asian scripts routinely fail verification models built on Latin-centric training data.
  • A single misread dot in Arabic script can transform one valid name into a completely different valid name, causing a legitimate customer to fail onboarding.
  • Vietnam mandates ISO 30107-3 liveness and biometric verification for all digital banking transactions from July 1, 2026.
  • Failing non-Latin documents creates four compounding costs: lost customers, fraud exposure, operational overhead, and regulatory non-compliance.
  • Document models trained natively on non-Latin scripts from the start outperform retrofitted Latin-based systems on accuracy and edge-case handling.

A compliance operations lead at a Jakarta-based neobank is reviewing Q1 drop-off data. The abandonment numbers are high, and they cluster around one step: document capture. The OCR model was processing standard fields without issue on straightforward IDs. It was failing on the Javanese script elements common in older Indonesian national IDs and on the Arabic-script components present in some regional KTP variants. The model returned low-confidence scores. The session flagged, the user hit a third retry screen and then they left.

The model was not broken. It was built for documents that look nothing like the ones the bank’s customers carry.

This is the non-Latin tax. Every time a Latin-trained verification model encounters Arabic, Thai, Vietnamese, Chinese, Devanagari, or Cyrillic script on a government-issued ID, it runs against a training gap. The output is not a clean error, it is a degraded result that costs you in conversion, fraud exposure, and compliance standing, simultaneously. This piece maps each cost and explains why the cause is not fixable with a post-hoc rule layer bolted onto an existing model.

What makes non-Latin document verification structurally different?

Non-Latin document verification is not OCR in a different alphabet. The failure modes are structural, and they require different training data and parsing logic, not a translation layer on top of a Latin-trained system.

Script complexity that breaks the Latin spatial model

Latin OCR works on a model where characters are discrete, left-to-right, and space-separated. The character inventory is small, and errors are recoverable because wrong letters are usually visually distinct. That model does not transfer to non-Latin scripts, each of which violates at least one of those assumptions in a different way.

Arabic script carries meaning through diacritical dots attached to base characters. A single dot  added, removed, or displaced changes one valid Arabic letter into a different valid letter, and one valid name into a completely different valid name. The same base shape with a dot below the character reads as one identity; with a dot above, it reads as another. A model without native Arabic training has no error signal here because it reads a valid character. The mismatch surfaces only when the extracted name fails to reconcile with the applicant’s record in an external system, by which point the session has already been flagged or rejected.

Chinese IDs have no spaces between data fields. The model must infer where a name ends and a date of birth begins using positional heuristics calibrated to standard document layouts. Those heuristics hold on common formats and degrade on older provincial IDs, laminated cards with worn field lines, or regional variants where the spatial layout differs from the training baseline.

Japanese national IDs combine three writing systems on a single card: kanji, hiragana, and katakana. One name can legitimately appear in all three. The machine-readable zone renders the Latin transliteration. The visual zone carries kanji. When the transliteration model is imprecise on a less common name variant, the system generates an internal mismatch on a document with no errors.

South Asian scripts Devanagari, Tamil, Bengali use syllabic clusters where vowel marks attach to consonant bases in positions above, below, and around the base character. The meaningful unit is the cluster, not the individual character. A model trained on character-level Latin OCR has no representation for this structure, which produces segmentation failures: names split mid-cluster, vowel marks are dropped, and long compound names get truncated at the point where the model runs out of pattern.

The multi-source reconciliation problem

A standard verification flow compares information from at least four sources: the visual text zone, the machine-readable zone, any embedded NFC chip, and the user’s self-reported input. For Latin-script IDs, all four agree on naming because they share an alphabet and a transliteration convention. For non-Latin IDs, the same identity is represented differently across those sources.

A Vietnamese user’s name appears as “Nguyễn Văn An” in the visual zone, “NGUYEN VAN AN” in the MRZ, and “Nguyen Van An” in the onboarding form. All three are correct. A model without native awareness of Vietnamese diacritic rules flags a mismatch. A model trained on those rules reconciles them. This is not a configuration option, it is a training decision made when the model was built, years before the session runs.

What does the tax look like in practice?

The non-Latin gap produces four distinct costs. They do not arrive separately.

False rejection: The conversion cost

A legitimate user presents a valid document. The OCR fails a field read or returns low confidence on a diacritic or cluster. The system flags the session. The user retries, encounters the same result, and abandons at the third attempt. You lose a real customer who did nothing wrong and had no way to fix the problem. For operations running across Vietnam, Indonesia, the Gulf, or South Asia, this is not an edge case, it is a repeating drag on every onboarding cohort in those markets.

False approval: The fraud exposure

A document with a deliberately altered non-Latin field, a changed dot in Arabic, a substituted character in a Devanagari name passes the OCR check because the model reads a valid character, just not the intended one. The altered identity may not match the applicant’s real record in downstream checks, but the OCR layer already produced an approved extraction. Subsequent verification steps are running from the wrong starting point. The fraud is invisible to a model that cannot distinguish the correct character from a substitution because it was never trained to.

Operational overhead: The scaling constraint

Every low-confidence OCR read that does not fully reject goes to a human review queue. In markets with high non-Latin document volumes, review teams spend a disproportionate share of their time resolving sessions that a natively trained model would process automatically. This is not a compliance event you can log, it is a scaling constraint that compounds with growth. The cost per verification rises as volume increases, which inverts the usual economics of automated onboarding.

Regulatory breach: the newest liability

Regulators in Southeast Asia are moving from voluntary digital identity guidance to mandatory technical standards. Vietnam’s State Bank Circular 50/2024/TT-NHNN requires face biometric verification conforming to ISO/IEC 30107-3 Presentation Attack Detection for digital banking transactions of VND 10 million or above, effective July 1, 2026. Indonesia’s Financial Services Authority mandates risk-tiered eKYC under OJK Circular No. 12/SEOJK.03/2022 across all regulated fintechs, payment processors, and P2P lenders. The Financial Action Task Force’s June 2025 Guidance on Financial Inclusion and AML/CFT measures reinforced that digital verification must function for underserved populations. In these markets, non-Latin document holders are not an edge population they are the majority. A model that cannot verify them accurately is not making a neutral technical tradeoff. It is producing a structural exclusion that regulators are now pricing into enforcement frameworks.

The markets where this matters most right now.

The highest intersection of non-Latin script density, regulatory deadline pressure, and digital onboarding growth currently sits in five markets. The failure modes are script-specific. The direction of regulatory travel is identical in all five.

Market

Script family

Key regulatory pressure

Primary failure mode

Vietnam

Vietnamese diacritic Latin hybrid

Circular 50/2024/TT-NHNN — biometric + ISO 30107-3 liveness, effective July 2026

Diacritic misread; name mismatch across visual zone, MRZ, and user input

Indonesia

Bahasa / regional Arabic and Javanese script on KTPs

OJK Circular 12/SEOJK.03/2022 — risk-tiered eKYC mandate for all regulated fintechs

Field-boundary ambiguity on regional and older ID variants

Thailand

Thai script

Bank of Thailand biometric guideline (2023); PDPA enforcement from 2022

Syllabic cluster segmentation errors; MRZ vs. visual zone conflict

Gulf / MENA

Arabic

UAE NESA, Saudi PDPL, GCC AML/CTF directives

Single-character dot substitution; right-to-left parsing failures

India / South Asia

Devanagari, Tamil, Bengali on Aadhaar and state IDs

RBI digital KYC framework; DPDPA 2023 data residency requirements

Syllabic cluster truncation on long compound names

 

Vietnam moved from voluntary biometric adoption to mandatory ISO-standard liveness compliance in under 24 months. Indonesia’s OJK regime covers not just banks but every licensed fintech and payments operator in the country. A verification model that cannot read local documents accurately enough to produce a compliant outcome is not just a product limitation it is a regulatory liability that grows with each enforcement cycle.

How Shufti handles non-Latin document verification.

If your users are in Vietnam, Indonesia, South Asia, or the Gulf, you have seen the gap at the session level. The typical failure pattern is a model that produced a result extracted a name, compared fields, returned a status  and the result was wrong because the model had no native representation of the script it was processing.

Shufti’s document intelligence was trained on 10,000+ document types across 220+ countries from the start, with proprietary OCR covering 150+ languages natively. Arabic diacritic rules, Vietnamese tone markers, Thai syllabic clusters, and Devanagari vowel-consonant binding are first-class training targets, not post-hoc additions. Binance relies on Shufti for non-Latin documents across global markets where accuracy requirements exceed what standard solutions can deliver. ByteDance expanded Shufti into Japan, Brazil, and LATAM specifically for non-Latin and unstructured document accuracy, across 432,000+ verifications. The coverage is structural  trained natively, not retrofitted.

See what Shufti’s document verification accuracy looks like on your actual document mix request a demo.

Blog banner image prompt

A wide-format 16:9 editorial composition, center of gravity weighted left. Navy #0D1428 background fills two-thirds of the frame. On the left, a vertical stack of abstract passport-shaped rectangular silhouettes rendered in translucent fragmented layers — edges dissolving and breaking apart, suggesting incomplete reads rather than damage or forgery. On the right third, the same document shapes rendered in clean solid sky blue #539FF9, complete and intact. A single thin vertical line in red #F24348 separates the two zones — not a barrier, a threshold. No human figures. No readable characters, text, or letters on any surface. No flags, country symbols, screens, or UI elements. Mood: editorial, restrained, confident, modern. Abstract geometric illustration style.

No embedded text, no typography, no letters, no real people, no identifiable faces. No competitor brand cues. No literal product UI or dashboards. No stock-photo clichés (handshake, padlock-on-screen, hooded hacker, fingerprint-on-circuit, faceless suit, magnifying glass).

Frequently Asked Questions

What is non-Latin document verification and why does it matter?

Non-Latin document verification is the process of authenticating government-issued IDs written in scripts outside the Latin alphabet, including Arabic, Chinese, Thai, Vietnamese, Devanagari, and Cyrillic. Most commercial OCR models were trained primarily on Latin-script IDs. In markets where non-Latin scripts dominate, those models produce higher false rejection and false approval rates compared to systems trained natively on those scripts.

Which Asian markets have the strictest eKYC requirements in 2026?

Vietnam is the most active. The State Bank's Circular 50/2024/TT-NHNN requires face biometric verification conforming to ISO/IEC 30107-3 for digital banking transactions of VND 10 million or above, effective July 1, 2026. Indonesia's OJK has mandated risk-tiered eKYC across all regulated fintechs since 2022. Thailand's Bank of Thailand published biometric guidance in 2023. All three require technical standards that Latin-trained models consistently struggle to meet on local document types.

How does OCR fail specifically on Arabic identity documents?

Arabic OCR typically fails at the diacritical dot level. A single dot added to or removed from a base character produces a different valid Arabic letter and a different valid name, with no visual anomaly a character-agnostic model would detect. The model reads a valid character, extracts a valid name, and returns a result that is technically processed and factually wrong.

What is the difference between a natively trained and a retrofitted verification model?

A natively trained model was built from the start on the scripts and document formats it will encounter in production. A retrofitted model was originally trained on Latin-script data and extended through additional training or rule-based post-processing. The performance gap is most visible on low-frequency characters, regional document variants, and documents combining multiple writing systems on the same card exactly the documents common across Southeast Asia and the Gulf.

Related Posts

Blog

Stop Trusting Identity Verification Accuracy Claims. Start Testing Them

Stop Trusting Identity Verification Accuracy Claims. Start Testing Them

Explore More

Blog

The KYC vendor evaluation checklist: how to actually test accuracy claims.

The KYC vendor evaluation checklist: how to actually test accuracy claims.

Explore More

Blog

One Platform, Every Market: A Global KYC Onboarding Playbook

One Platform, Every Market: A Global KYC Onboarding Playbook

Explore More

Blog

How Your Identity Verification Vendor is Costing You Customers You Don’t Know You’ve Lost

How Your Identity Verification Vendor is Costing You Customers You Don’t Know You’ve Lost

Explore More

Blog

Non-Latin Document Verification: What Western-Trained Models Cost You in Asia.

Non-Latin Document Verification: What Western-Trained Models Cost You in Asia.

Explore More

Blog

Identity Verification Conversion: Why KYC Fails in Hard Markets

Identity Verification Conversion: Why KYC Fails in Hard Markets

Explore More

Blog

The 1% problem: what a single point of KYC pass rate is worth

The 1% problem: what a single point of KYC pass rate is worth

Explore More

Blog

Stop Trusting Identity Verification Accuracy Claims. Start Testing Them

Stop Trusting Identity Verification Accuracy Claims. Start Testing Them

Explore More

Blog

The KYC vendor evaluation checklist: how to actually test accuracy claims.

The KYC vendor evaluation checklist: how to actually test accuracy claims.

Explore More

Blog

One Platform, Every Market: A Global KYC Onboarding Playbook

One Platform, Every Market: A Global KYC Onboarding Playbook

Explore More

Blog

How Your Identity Verification Vendor is Costing You Customers You Don’t Know You’ve Lost

How Your Identity Verification Vendor is Costing You Customers You Don’t Know You’ve Lost

Explore More

Blog

Non-Latin Document Verification: What Western-Trained Models Cost You in Asia.

Non-Latin Document Verification: What Western-Trained Models Cost You in Asia.

Explore More

Blog

Identity Verification Conversion: Why KYC Fails in Hard Markets

Identity Verification Conversion: Why KYC Fails in Hard Markets

Explore More

Blog

The 1% problem: what a single point of KYC pass rate is worth

The 1% problem: what a single point of KYC pass rate is worth

Explore More

Take the next steps to better security.

Contact us

Get in touch with our experts. We'll help you find the perfect solution for your compliance and security needs.

Contact us

Request demo

Get free access to our platform and try our products today.

Get started