Articles in this section

RLI Languages

Avatar
Jason Stevens
  • Updated
Follow

Using its standard language-detection procedure, RLI can identify the language, writing script, and encoding of data in any of the following language-script-encoding combinations. When using short-string analysis, RLI only supports Java strings, which it reports as UTF-16BE.

Language (ISO 639-3)

Script (ISO 15924)

Short-String Detection

Encodings

Albanian (sqi)

Latin (Latn)

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

Arabic (ara)

Arabic (Arab)

✓

ISO-8859-6, UTF-16BE, UTF-16LE, UTF-8, windows-1256, windows-720

Arabic (ara)

Latin (Latn)

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252, windows-1256

Bengali (ben)

Bengali (Beng)

ISCII-Bengali, UTF-16BE, UTF-16LE, UTF-8

Bulgarian (bul)

Cyrillic (Cyrl)

ISO-8859-5, KOI8-R, UTF-16BE, UTF-16LE, UTF-8, windows-1251

Catalan (cat)

Latin (Latn)

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

Chinese (zho)

Han, Simplified (Hans)

✓[a]

GB18030, GB2312, HZ-GB-2312, ISO-2022-CN, UTF-16BE, UTF-16LE, UTF-8

Chinese (zho)

Han, Traditional (Hant)

✓[a]

Big5, UTF-16BE, UTF-16LE, UTF-8

Croatian (hrv)

Latin (Latn)

ISO-8859-2, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1250

Czech (ces)

Latin (Latn)

✓

ISO-8859-2, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1250

Danish (dan)

Latin (Latn)

✓

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

Dutch (nld)

Latin (Latn)

✓

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

English Uppercase (uen[b])

Latin (Latn)

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

English (eng)

Latin (Latn)

✓

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

Estonian (est)

Latin (Latn)

ISO-8859-13, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1257

Finnish (fin)

Latin (Latn)

✓

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

French (fra)

Latin (Latn)

✓

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

German (deu)

Latin (Latn)

✓

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

Greek (ell)

Greek (Grek)

✓

ISO-8859-7, UTF-16BE, UTF-16LE, UTF-8, windows-1253

Gujarati (guj)

Gujarati (Gujr)

ISCII-Gujarati, UTF-16BE, UTF-16LE, UTF-8

Hebrew (heb)

Hebrew (Hebr)

✓

ISO-8859-8, UTF-16BE, UTF-16LE, UTF-8, windows-1255

Hindi (hin)

Devanagari (Deva)

ISCII-Devanagari, UTF-16BE, UTF-16LE, UTF-8

Hungarian (hun)

Latin (Latn)

✓

ISO-8859-2, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1250

Icelandic (isl)

Latin (Latn)

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

Indonesian (ind)

Latin (Latn)

✓

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

Italian (ita)

Latin (Latn)

✓

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

Japanese (jpn)

Japanese [Han + Hiragana + Katakana] (Jpan)

✓

EUC-JP, ISO-2022-JP, Shift_JIS, Shift_JIS-2004, UTF-16BE, UTF-16LE, UTF-8

Japanese (jpn)

Katakana (Kana)

EUC-JP, Shift_JIS, Shift_JIS-2004, UTF-16BE, UTF-16LE, UTF-8

Kannada (kan)

Kannada (Knda)

ISCII-Kannada, UTF-16BE, UTF-16LE, UTF-8

Korean (kor[c][d])

Korean [Hangul + Han] (Kore)

✓

EUC-KR, ISO-2022-KR, UTF-16BE, UTF-16LE, UTF-8

Kurdish (kur)

Arabic (Arab)

UTF-16BE, UTF-16LE, UTF-8, windows-1256

Kurdish (kur)

Latin (Latn)

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252, windows-1256

Latvian (lav)

Latin (Latn)

ISO-8859-13, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1257

Lithuanian (lit)

Latin (Latn)

ISO-8859-13, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1257

Macedonian (mkd)

Cyrillic (Cyrl)

ISO-8859-5, UTF-16BE, UTF-16LE, UTF-8, windows-1251

Malay (msa[e])

Latin (Latn)

✓

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

Malayalam (mal)

Malayalam (Mlym)

ISCII-Malayalam, UTF-16BE, UTF-16LE, UTF-8

North Korean (qkp[d])

Korean [Hangul + Han] (Kore)

✓

UTF-8

Norwegian (nor)

Latin (Latn)

✓

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

Persian (fas)

Arabic (Arab)

✓

UTF-16BE, UTF-16LE, UTF-8, windows-1256

Persian (fas)

Latin (Latn)

✓

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252, windows-1256

Polish (pol)

Latin (Latn)

ISO-8859-2, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1250

Portuguese (por)

Latin (Latn)

✓

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

Pashto (pus)

Arabic (Arab)

✓

UTF-16BE, UTF-16LE, UTF-8, windows-1256

Pashto (pus)

Latin (Latn)

✓

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252, windows-1256

Romanian (ron)

Latin (Latn)

✓

ISO-8859-2, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1250

Russian (rus)

Cyrillic (Cyrl)

✓

IBM866, ISO-8859-5, KOI8-R, UTF-16BE, UTF-16LE, UTF-8, windows-1251, x-mac-cyrillic

Serbian (srp)

Cyrillic (Cyrl)

ISO-8859-5, UTF-16BE, UTF-16LE, UTF-8, windows-1251

Serbian (srp)

Latin (Latn)

ISO-8859-2, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1250

Slovak (slk)

Latin (Latn)

ISO-8859-2, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1250

Slovenian (slv)

Latin (Latn)

ISO-8859-2, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1250

Somali (som)

Latin (Latn)

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

South Korean (qkr[d])

Korean [Hangul + Han] (Kore)

✓

UTF-8

Spanish (spa)

Latin (Latn)

✓

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

Swedish (swe)

Latin (Latn)

✓

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

Tagalog (tgl)

Latin (Latn)

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252

Tamil (tam)

Tamil (Taml)

ISCII-Tamil, UTF-16BE, UTF-16LE, UTF-8

Telugu (tel)

Telugu (Telu)

ISCII-Telugu, UTF-16BE, UTF-16LE, UTF-8

Thai (tha)

Thai (Thai)

✓

UTF-16BE, UTF-16LE, UTF-8, windows-874

Turkish (tur)

Latin (Latn)

✓

ISO-8859-9, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1254

Ukrainian (ukr)

Cyrillic (Cyrl)

ISO-8859-5, KOI8-R, UTF-16BE, UTF-16LE, UTF-8, windows-1251

Urdu (urd)

Arabic (Arab)

UTF-16BE, UTF-16LE, UTF-8, windows-1256

Urdu (urd)

Latin (Latn)

ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252, windows-1256

Uzbek (uzb)

Cyrillic (Cyrl)

ISO-8859-5, KOI8-R, UTF-16BE, UTF-16LE, UTF-8, windows-1251

Uzbek (uzb)

Latin (Latn)

US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1251

Vietnamese (vie)

Latin (Latn)

TCVN, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, VIQR, VISCII, VNI, VPS

Unknown (xxx[b])[f]

[Any script]

✓

[a] For Chinese, short-string analysis returns Han script.

[b] Non-standard language code.

[c] For Korean, short-string analysis returns Hangul script.

[d] North Korean and South Korean are enabled only if koreanDialects is true. Korean is enabled only if koreanDialects is false.

[e] The short string algorithm uses the language code zsm for Malaysian.

[f] Returned if analysis cannot identify a language.

Related articles

Comments

0 comments

Article is closed for comments.





Powered by Zendesk