RLI Languages

Using its standard language-detection procedure, RLI can identify the language, writing script, and encoding of data in any of the following language-script-encoding combinations. When using short-string analysis, RLI only supports Java strings, which it reports as UTF-16BE.

Language (ISO 639-3)	Script (ISO 15924)	Short-String Detection	Encodings
Albanian (sqi)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
Arabic (ara)	Arabic (Arab)	✓	ISO-8859-6, UTF-16BE, UTF-16LE, UTF-8, windows-1256, windows-720
Arabic (ara)	Latin (Latn)		ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252, windows-1256
Bengali (ben)	Bengali (Beng)	✓	ISCII-Bengali, UTF-16BE, UTF-16LE, UTF-8
Bulgarian (bul)	Cyrillic (Cyrl)	✓	ISO-8859-5, KOI8-R, UTF-16BE, UTF-16LE, UTF-8, windows-1251
Catalan (cat)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
Chinese (zho)	Han, Simplified (Hans)	✓^[a]	GB18030, GB2312, HZ-GB-2312, ISO-2022-CN, UTF-16BE, UTF-16LE, UTF-8
Chinese (zho)	Han, Traditional (Hant)	✓^[a]	Big5, UTF-16BE, UTF-16LE, UTF-8
Croatian (hrv)	Latin (Latn)	✓	ISO-8859-2, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1250
Czech (ces)	Latin (Latn)	✓	ISO-8859-2, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1250
Danish (dan)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
Dutch (nld)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
English Uppercase (uen^[b])	Latin (Latn)		ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
English (eng)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
Estonian (est)	Latin (Latn)	✓	ISO-8859-13, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1257
Finnish (fin)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
French (fra)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
German (deu)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
Greek (ell)	Greek (Grek)	✓	ISO-8859-7, UTF-16BE, UTF-16LE, UTF-8, windows-1253
Gujarati (guj)	Gujarati (Gujr)	✓	ISCII-Gujarati, UTF-16BE, UTF-16LE, UTF-8
Hebrew (heb)	Hebrew (Hebr)	✓	ISO-8859-8, UTF-16BE, UTF-16LE, UTF-8, windows-1255
Hindi (hin)	Devanagari (Deva)	✓	ISCII-Devanagari, UTF-16BE, UTF-16LE, UTF-8
Hungarian (hun)	Latin (Latn)	✓	ISO-8859-2, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1250
Icelandic (isl)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
Indonesian (ind)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
Italian (ita)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
Japanese (jpn)	Japanese [Han + Hiragana + Katakana] (Jpan)	✓	EUC-JP, ISO-2022-JP, Shift_JIS, Shift_JIS-2004, UTF-16BE, UTF-16LE, UTF-8
Japanese (jpn)	Katakana (Kana)	✓	EUC-JP, Shift_JIS, Shift_JIS-2004, UTF-16BE, UTF-16LE, UTF-8
Kannada (kan)	Kannada (Knda)	✓	ISCII-Kannada, UTF-16BE, UTF-16LE, UTF-8
Korean (kor^[c]^[d])	Korean [Hangul + Han] (Kore)	✓	EUC-KR, ISO-2022-KR, UTF-16BE, UTF-16LE, UTF-8
Kurdish (kur)	Arabic (Arab)	✓	UTF-16BE, UTF-16LE, UTF-8, windows-1256
Kurdish (kur)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252, windows-1256
Latvian (lav)	Latin (Latn)	✓	ISO-8859-13, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1257
Lithuanian (lit)	Latin (Latn)	✓	ISO-8859-13, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1257
Macedonian (mkd)	Cyrillic (Cyrl)	✓	ISO-8859-5, UTF-16BE, UTF-16LE, UTF-8, windows-1251
Malay, Standard (zsm)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
Malayalam (mal)	Malayalam (Mlym)	✓	ISCII-Malayalam, UTF-16BE, UTF-16LE, UTF-8
North Korean (qkp^[d])	Korean [Hangul + Han] (Kore)	✓	UTF-8
Norwegian (nor)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
Persian (fas)	Arabic (Arab)	✓	UTF-16BE, UTF-16LE, UTF-8, windows-1256
Persian (fas)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252, windows-1256
Polish (pol)	Latin (Latn)	✓	ISO-8859-2, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1250
Portuguese (por)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
Pashto (pus)	Arabic (Arab)	✓	UTF-16BE, UTF-16LE, UTF-8, windows-1256
Pashto (pus)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252, windows-1256
Romanian (ron)	Latin (Latn)	✓	ISO-8859-2, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1250
Russian (rus)	Cyrillic (Cyrl)	✓	IBM866, ISO-8859-5, KOI8-R, UTF-16BE, UTF-16LE, UTF-8, windows-1251, x-mac-cyrillic
Serbian (srp)	Cyrillic (Cyrl)	✓	ISO-8859-5, UTF-16BE, UTF-16LE, UTF-8, windows-1251
Serbian (srp)	Latin (Latn)	✓	ISO-8859-2, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1250
Slovak (slk)	Latin (Latn)	✓	ISO-8859-2, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1250
Slovenian (slv)	Latin (Latn)	✓	ISO-8859-2, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1250
Somali (som)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
South Korean (qkr^[d])	Korean [Hangul + Han] (Kore)	✓	UTF-8
Spanish (spa)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
Swedish (swe)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
Tagalog (tgl)	Latin (Latn)	✓	ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252
Tamil (tam)	Tamil (Taml)	✓	ISCII-Tamil, UTF-16BE, UTF-16LE, UTF-8
Telugu (tel)	Telugu (Telu)	✓	ISCII-Telugu, UTF-16BE, UTF-16LE, UTF-8
Thai (tha)	Thai (Thai)	✓	UTF-16BE, UTF-16LE, UTF-8, windows-874
Turkish (tur)	Latin (Latn)	✓	ISO-8859-9, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1254
Ukrainian (ukr)	Cyrillic (Cyrl)	✓	ISO-8859-5, KOI8-R, UTF-16BE, UTF-16LE, UTF-8, windows-1251
Urdu (urd)	Arabic (Arab)	✓	UTF-16BE, UTF-16LE, UTF-8, windows-1256
Urdu (urd)	Latin (Latn)		ISO-8859-1, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1252, windows-1256
Uzbek (uzb)	Cyrillic (Cyrl)	✓	ISO-8859-5, KOI8-R, UTF-16BE, UTF-16LE, UTF-8, windows-1251
Uzbek (uzb)	Latin (Latn)	✓	US-ASCII, UTF-16BE, UTF-16LE, UTF-8, windows-1251
Vietnamese (vie)	Latin (Latn)	✓	TCVN, US-ASCII, UTF-16BE, UTF-16LE, UTF-8, VIQR, VISCII, VNI, VPS
Unknown (xxx^[b])^[e]	[Any script]	✓
^[a] For Chinese, short-string analysis returns Han script. ^[b] Non-standard language code. ^[c] For Korean, short-string analysis returns Hangul script. ^[d] North Korean and South Korean are enabled only if `koreanDialects` is true. Korean is enabled only if `koreanDialects` is false. ^[e] Returned if analysis cannot identify a language.

Articles in this section

Comments

Articles in this section

Related articles