Japanese language in EBCDIC

Add links
Source: Wikipedia, the free encyclopedia.
"KEIS" redirects here. For other uses, see Qays and Kai Islands.

Several mutually incompatible versions of the Extended Binary Coded Decimal Interchange Code (

basic Latin letters are often not preserved in their usual locations.[2]

The characters which are found in the double-byte Japanese code used with EBCDIC by IBM, but not found in the first edition of

Windows code page 932.[3]

Single-byte codes

Similarly to JIS X 0201 (itself incorporated into Shift JIS), Japanese EBCDIC encodings often include a set of single-byte katakana. Several different variants of the single-byte EBCDIC code are used in the Japanese locale, by different vendors; a given vendor may also define two different single-byte codes, one favoured for half-width katakana and one favoured for Latin script. Variants of EBCDIC favoured by a given vendor for use for katakana are sometimes referred to as EBCDIK, standing for Extended Binary-Coded Decimal Interchange Kana code.[1][4]

Code pages incorporating half-width kana are an exception to IBM's EBCDIC invariant character set, which specifies a set of characters which are usually encoded the same across all EBCDIC code pages. Most notably, they sometimes include katakana characters at code points which are used for

Basic Latin alphabet in the invariant set.[2]
Encoding of lowercase letters when katakana characters are included at those locations, and encoding of katakana characters when lowercase letters are retained in their usual locations, can vary between vendors, as shown below.

Microsoft Windows implements two Japanese single-byte EBCDIC variants, with code page numbers 20000 higher than IBM's code page numbers for its variants, as code pages 20290 (documented as IBM290, "IBM EBCDIC Japanese Katakana Extended")[5] and 21027 ("Extended/Ext Alpha Lowercase"). Code page 21027 as implemented in Windows is an incomplete implementation, lacking two-way mappings for several letters and kana,[6] and is currently deprecated.[5]

IBM's code pages were later updated to include the Euro sign at 0xE1, retaining their original CPGID numbers, but being assigned new CCSID numbers. Hence, the CCSID 290 refers to the original version of code page 290, while the version of code page 290 with the Euro sign is also known as CCSID 8482.[7] Similarly, CCSID 1027 refers to the original version of code page 1027, while the version of CPGID 1027 with the Euro sign is given the CCSID 5123.[8]

Alongside versions of IBM's double-byte Japanese DBCS-Host code page (CPGID 300, CCSID 300 or 16684) as a double-byte component, IBM code page 290 is used as the single-byte component of the multi-byte code page IBM-930[9][10] and (as the Euro-updated CCSID 8482) the updated version IBM-1390.[11][12] IBM code page 1027 is used as the single-byte component of the multi-byte code page IBM-939[13][14] and (as the Euro-updated CCSID 5123) the updated version IBM-1399.[15][16]

In the following table, conformance to the invariant set is marked with green; collision with the invariant set is marked with red.

Single-byte codes in Japanese EBCDIC variants (excluding control codes)
Hexadecimal Lowercase in invariant locations, kana absent or displaced Lowercase absent or displaced by kana
Fujitsu EBCDIC[17] Hitachi EBCDIC[18] HP EBCDIK[19] IBM 298[20] IBM 1027
[13][15][21][22] 		IBM 1031[23] Fujitsu EBCDIK[17] Hitachi EBCDIK[18]
IBM 1136[24] 		NEC EBCDIC[25][26] IBM 290
[9][11][27][28] 		IBM 887[29] IBM 1030[30]
0x40 SP SP SP SP SP SP SP SP SP SP SP SP
0x41 ｡ ｡ ｡ ｡ ｡ ｡
0x42 ｡ ｡ ｡ ｡ ｡ ｢ ｢ ｢ ｢ ｢ ｢
0x43 ｢ ｢ ｢ ｢ ｢ ｣ ｣ ｣ ｣ ｣ ｣
0x44 ｣ ｣ ｣ ｣ ｣ ､ ､ ､ ､ ､ ､
0x45 ､ ､ ､ ､ ､ ･ ･ ･ ･ ･ ･
0x46 ･ ･ ･ ･ ･ ｦ ｦ ｦ ｦ ｦ ｦ
0x47 ｦ ｦ ｦ ｦ ｦ ｧ ｧ ｧ ｧ ｧ ｧ
0x48 ｧ ｧ ｧ ｧ ｧ ｨ ｨ ｨ ｨ ｨ ｨ
0x49 ｨ ｨ ｨ ｨ ｨ ｩ ｩ ｩ ｩ ｩ ｩ
0x4A £ [ ¢ ¢ ¢ £ [ [ £ £ £
0x4B . . . . . . . . . . . .
0x4C < < ) < < < < < < < < <
0x4D ( ( [ ( ( ( ( ( ( ( ( (
0x4E + + < + + + + + + + + +
0x4F | ! | | | | ! ! | | |
0x50 & & + & & & & & & & & &
0x51 ｩ ｩ ｩ ｩ ｩ ｪ ｪ ｪ ｪ ｪ ｪ
0x52 ｪ ｪ ｪ ｪ ｪ ｫ ｫ ｫ ｫ ｫ ｫ
0x53 ｫ ｫ ｫ ｫ ｫ ｬ ｬ ｬ ｬ ｬ ｬ
0x54 ｬ ｬ ｬ ｬ ｬ ｭ ｭ ｭ ｭ ｭ ｭ
0x55 ｭ ｭ ｭ ｭ ｭ ｮ ｮ ｮ ｮ ｮ ｮ
0x56 ｮ ｮ ｮ ｮ ｮ ｯ ｯ ｯ ｯ ｯ ｯ
0x57 ｯ ｯ ｯ ｯ ｯ a
0x58 ｰ ｰ ｰ ｰ ｰ ｰ ｰ ｰ ｰ ｰ ｰ
0x59 ｱ ｱ ｱ ｱ ｱ a b
0x5A ! ] ! ! ! ! ] ] ! ! !
0x5B \ ¥ $ $ $ $ \ ¥ \ ¥ ¥ ¥
0x5C * * * * * * * * * * * *
0x5D ) ) ] ) ) ) ) ) ) ) ) )
0x5E ; ; ; ; ; ; ; ; ; ; ; ;
0x5F ¬ ^ ¬ ¬ ¬ ¬ ^ ^ ¬ ¬ ¬
0x60 - - - - - - - - - - - -
0x61 / / / / / / / / / / / /
0x62 ｲ ｲ ｲ ｲ ｲ b c a a
0x63 ｳ ｳ ｳ ｳ ｳ c d b b
0x64 ｴ ｴ ｴ ｴ ｴ d e c c
0x65 ｵ ｵ ｵ ｵ ｵ e f d d
0x66 ｶ ｶ ｶ ｶ ｶ f g e e
0x67 ｷ ｷ ｷ ｷ ｷ g h f f
0x68 ｸ ｸ ｸ ｸ ｸ h i g g
0x69 ｹ ｹ ｹ ｹ ｹ i j h h
0x6A ¦ | | ¦ | |
0x6B , , , , , , , , , , , ,
0x6C % % ( % % % % % % % % %
0x6D _ _ _ _ _ _ _ _ _ _ _ _
0x6E > > ¥ > > > > > > > > >
0x6F ? ? ? ? ? ? ? ? ? ? ?
0x70 ｺ ｺ ｺ ｺ ｺ j k [ [
0x71 ｻ ｻ ｻ ｻ ｻ k l i i
0x72 ｼ ｼ ｼ ｼ ｼ l m j j
0x73 ｽ ｽ ｽ ｽ ｽ m n k k
0x74 ｾ ｾ ｾ ｾ ｾ n o l l
0x75 ｿ ｿ ｿ ｿ ｿ o p m m
0x76 ﾀ ﾀ ﾀ ﾀ ﾀ p q n n
0x77 ﾁ ﾁ ﾁ ﾁ ﾁ q r o o
0x78 ﾂ ﾂ ﾂ ﾂ ﾂ r s p p
0x79 ` ` ` ` ` ` ` ` ` ` `
0x7A : : : : : : : : : : :
0x7B # # = # # # # # # # # #
0x7C @ @ ' @ @ @ @ @ @ @ @ @
0x7D ' ' : ' ' ' ' ' ' ' ' '
0x7E = = > = = = = = = = = =
0x7F " " " " " " " " " " " "
0x80 ﾃ ﾃ ﾃ s t ] ]
0x81 a a a a a a ｱ ｱ ｱ ｱ ｱ ｱ
0x82 b b b b b b ｲ ｲ ｲ ｲ ｲ ｲ
0x83 c c c c c c ｳ ｳ ｳ ｳ ｳ ｳ
0x84 d d d d d d ｴ ｴ ｴ ｴ ｴ ｴ
0x85 e e e e e e ｵ ｵ ｵ ｵ ｵ ｵ
0x86 f f f f f f ｶ ｶ ｶ ｶ ｶ ｶ
0x87 g g g g g g ｷ ｷ ｷ ｷ ｷ ｷ
0x88 h h h h h h ｸ ｸ ｸ ｸ ｸ ｸ
0x89 i i i i i i ｹ ｹ ｹ ｹ ｹ ｹ
0x8A ﾄ ﾄ ﾄ ﾃ ﾃ ｺ ｺ ｺ ｺ ｺ ｺ
0x8B ﾅ ﾅ ﾅ ﾄ ﾄ t u q q
0x8C ﾆ ﾆ ﾆ ﾅ ﾅ ｻ ｻ ｻ ｻ ｻ ｻ
0x8D ﾇ ﾇ ﾇ ﾆ ﾆ ｼ ｼ ｼ ｼ ｼ ｼ
0x8E ﾈ ﾈ ﾈ ﾇ ﾇ ｽ ｽ ｽ ｽ ｽ ｽ
0x8F ﾉ ﾉ ﾉ ﾈ ﾈ ｾ ｾ ｾ ｾ ｾ ｾ
0x90 ﾊ ﾊ ﾊ ｿ ｿ ｿ ｿ ｿ ｿ
0x91 j j j j j j ﾀ ﾀ ﾀ ﾀ ﾀ ﾀ
0x92 k k k k k k ﾁ ﾁ ﾁ ﾁ ﾁ ﾁ
0x93 l l l l l l ﾂ ﾂ ﾂ ﾂ ﾂ ﾂ
0x94 m m m m m m ﾃ ﾃ ﾃ ﾃ ﾃ ﾃ
0x95 n n n n n n ﾄ ﾄ ﾄ ﾄ ﾄ ﾄ
0x96 o o o o o o ﾅ ﾅ ﾅ ﾅ ﾅ ﾅ
0x97 p p p p p p ﾆ ﾆ ﾆ ﾆ ﾆ ﾆ
0x98 q q q q q q ﾇ ﾇ ﾇ ﾇ ﾇ ﾇ
0x99 r r r r r r ﾈ ﾈ ﾈ ﾈ ﾈ ﾈ
0x9A ﾋ ﾋ ﾋ ﾉ ﾉ ﾉ ﾉ ﾉ ﾉ ﾉ ﾉ
0x9B ﾌ ﾌ ﾌ ﾊ ﾊ u v r r
0x9C ﾍ ﾍ ﾍ ﾋ ﾋ v w
0x9D ﾎ ﾎ ﾎ ﾌ ﾌ ﾊ ﾊ ﾊ ﾊ ﾊ ﾊ
0x9E ﾏ ﾏ ﾏ ﾍ ﾍ ﾋ ﾋ ﾋ ﾋ ﾋ ﾋ
0x9F ﾐ ﾐ ﾐ ﾎ ﾎ ﾌ ﾌ ﾌ ﾌ ﾌ ﾌ
0xA0 ﾑ ﾑ ﾑ ¯ ¯ w x ~ ~
0xA1 ~ ~ ¯ ~ ~ ~ ~ ~ ~ ¯ ¯ ¯
0xA2 s s s s s s ﾍ ﾍ ﾍ ﾍ ﾍ ﾍ
0xA3 t t t t t t ﾎ ﾎ ﾎ ﾎ ﾎ ﾎ
0xA4 u u u u u u ﾏ ﾏ ﾏ ﾏ ﾏ ﾏ
0xA5 v v v v v v ﾐ ﾐ ﾐ ﾐ ﾐ ﾐ
0xA6 w w w w w w ﾑ ﾑ ﾑ ﾑ ﾑ ﾑ
0xA7 x x x x x x ﾒ ﾒ ﾒ ﾒ ﾒ ﾒ
0xA8 y y y y y y ﾓ ﾓ ﾓ ﾓ ﾓ ﾓ
0xA9 z z z z z z ﾔ ﾔ ﾔ ﾔ ﾔ ﾔ
0xAA ﾒ ﾒ ﾒ ﾏ ﾏ ﾕ ﾕ ﾕ ﾕ ﾕ ﾕ
0xAB ﾓ ﾓ ﾓ ﾐ ﾐ x y s s
0xAC ﾔ ﾔ ﾔ ﾑ ﾑ ﾖ ﾖ ﾖ ﾖ ﾖ ﾖ
0xAD ﾕ ﾕ ﾕ [ [ ﾗ ﾗ ﾗ ﾗ ﾗ ﾗ
0xAE ﾖ ﾖ ﾖ ﾒ ﾒ ﾘ ﾘ ﾘ ﾘ ﾘ ﾘ
0xAF ﾗ ﾗ ﾗ ﾓ ﾓ ﾙ ﾙ ﾙ ﾙ ﾙ ﾙ
0xB0 ﾘ ﾘ ﾘ ^ ^ y z ^ ^
0xB1 ﾙ ﾙ ﾙ £ £ z ¢ ¢
0xB2 ﾚ ﾚ ﾚ ¥ ¥ \ \
0xB3 ﾛ ﾛ ﾛ ﾔ ﾔ t t
0xB4 ﾜ ﾜ ﾜ ﾕ ﾕ u u
0xB5 ﾝ ﾝ ﾝ ﾖ ﾖ v v
0xB6 ﾞ ﾞ ﾞ ﾗ ﾗ w w
0xB7 ﾟ ﾟ ﾟ ﾘ ﾘ x x
0xB8 ﾙ ﾙ y y
0xB9 ﾚ ﾚ z z
0xBA ﾛ ﾛ ﾚ ﾚ ﾚ ﾚ ﾚ ﾚ
0xBB ﾜ ﾜ ﾛ ﾛ ﾛ ﾛ ﾛ ﾛ
0xBC ﾝ ﾝ ﾜ ﾜ ﾜ ﾜ ﾜ ﾜ
0xBD ] ] ﾝ ﾝ ﾝ ﾝ ﾝ ﾝ
0xBE ﾞ ﾞ ﾞ ﾞ ﾞ ﾞ ﾞ ﾞ
0xBF ﾟ ﾟ ﾟ ﾟ ﾟ ﾟ ﾟ ﾟ
0xC0 { { ? { { { { { { { {
0xC1 A A A A A A A A A A A A
0xC2 B B B B B B B B B B B B
0xC3 C C C C C C C C C C C C
0xC4 D D D D D D D D D D D D
0xC5 E E E E E E E E E E E E
0xC6 F F F F F F F F F F F F
0xC7 G G G G G G G G G G G G
0xC8 H H H H H H H H H H H H
0xC9 I I I I I I I I I I I I
0xCA ┼ ┼
0xCB ┴ ┴
0xCC ┬ ┬
0xCD └ ℄ └
0xCE ┌ ┌
0xCF ┘ ┘
0xD0 } } ! } } } } } } } }
0xD1 J J J J J J J J J J J J
0xD2 K K K K K K K K K K K K
0xD3 L L L L L L L L L L L L
0xD4 M M M M M M M M M M M M
0xD5 N N N N N N N N N N N N
0xD6 O O O O O O O O O O O O
0xD7 P P P P P P P P P P P P
0xD8 Q Q Q Q Q Q Q Q Q Q Q Q
0xD9 R R R R R R R R R R R R
0xDA ┐ ┐
0xDB ─ ° ─
0xDC ±
0xDD
0xDE ⌴
0xDF ↧
0xE0 $ $ ¥ \ \ $ $ $ $ $ $
0xE1 € €
0xE2 S S S S S S S S S S S S
0xE3 T T T T T T T T T T T T
0xE4 U U U U U U U U U U U U
0xE5 V V V V V V V V V V V V
0xE6 W W W W W W W W W W W W
0xE7 X X X X X X X X X X X X
0xE8 Y Y Y Y Y Y Y Y Y Y Y Y
0xE9 Z Z Z Z Z Z Z Z Z Z Z Z
0xEA
0xEB ├ ⌀ ├
0xEC ┤ ┤
0xED ≤
0xEE ≥
0xEF Ω
0xF0 0 0 0 0 0 0 0 0 0 0 0 0
0xF1 1 1 1 1 1 1 1 1 1 1 1 1
0xF2 2 2 2 2 2 2 2 2 2 2 2 2
0xF3 3 3 3 3 3 3 3 3 3 3 3 3
0xF4 4 4 4 4 4 4 4 4 4 4 4 4
0xF5 5 5 5 5 5 5 5 5 5 5 5 5
0xF6 6 6 6 6 6 6 6 6 6 6 6 6
0xF7 7 7 7 7 7 7 7 7 7 7 7 7
0xF8 8 8 8 8 8 8 8 8 8 8 8 8
0xF9 9 9 9 9 9 9 9 9 9 9 9 9
0xFA │ │
0xFB
0xFC ⌵
0xFD µ
0xFE ⋅

Double-byte codes

See also: IBM Kanji System

There are three double-byte character codes used for Japanese with EBCDIC:

ideographic space, but not as part of any other double-byte code.[1][33]

In the IBM version of the DBCS-Host code, the code 0x0F switches to single-byte mode and the code 0x0E switches to double-byte mode,

Johab for Korean.[34] In contrast to KEIS and JEF, the layout of IBM code page 300 is unrelated to JIS X 0208, and conversion between the two must be done via a table;[31] however, its character repertoire has been kept up-to-date with successive revisions of JIS X 0208 so as to remain a superset of JIS X 0208's repertoire.[3] Lead bytes 0x41 through 0x44 are used for non-Kanji characters, lead bytes 0x45 through 0x68 are used for Kanji characters, and lead bytes 0x69 through 0x89 are used for UDC (user-defined characters).[33]

The existence of IBM's Japanese DBCS-Host code had impact beyond EBCDIC systems, since IBM also defined variants of

not sign ￢ were later added to JIS X 0208 in 1983). These are referred to as "IBM-selected" characters and are included as extensions in, for example, Windows code page 932.[3]

Some newer revisions of the IBM-300 code page add additional Kanji with lead bytes 0xB8 through 0xD5 and additional non-Kanji with lead bytes 0xD6 through 0xE9.[33] This revision updated the set for JIS X 0213, including the Euro sign and, while retaining the CPGID 300, was assigned the new CCSID 16684.[35] The code pages IBM-930 (with code page 290 as the single-byte set),[9] IBM-931 (with code page 37 as the single-byte set), and IBM-939 (with code page 1027 as the single-byte set)[13] exclude these additions, while IBM-1390 (with the Euro sign version of code page 290 / CCSID 8482)[11] and IBM-1399 (with the Euro sign version of code page 1027 / CCSID 5123)[15] include them.

In Hitachi KEIS

EUC-JP, i.e. with both bytes being between 0xA1 and 0xFE inclusive. This results in duplicate encodings for the ideographic space—0x4040 per the DBCS-Host code structure, and 0xA1A1 as in EUC-JP. However, the lead byte range is extended back to 0x59, out of which the lead bytes 0x81–A0 are designated for user-defined characters,[1] and the remainder are used for corporate-defined characters, including both kanji and non-kanji.[3]

In Fujitsu JEF

kuten purposes, although row 162 (lead byte 0x7E) is unused.[1][3] Rows 101 through 148 are used for extended kanji, while rows 149 through 163 are used for extended non-kanji.[3]

Footnotes

  1. ^ These hexadecimal forms of these shift sequences match the decimal forms (10 65 and 10 66) listed by Lunde.[1] Lunde lists the hexadecimal forms for both shifts as 0xA0 0x42, seemingly in error.

References

  1. ^
    ISBN 978-0-596-51447-1
    .
  2. ^ a b "Invariant character set". IBM i 7.1 Documentation. IBM. 14 August 2018.
  3. ^
    ISBN 978-0-596-51447-1
    .
  4. ^ "EBCDIK: Extended Binary Coded Decimal Interchange Kana Code". 通信用語の基礎知識.
  5. ^ a b "Code Page Identifiers". Windows Dev Center. Microsoft.
  6. ^ Steele, Shawn. "Code Page 21027 "Extended/Ext Alpha Lowercase"". Microsoft.
  7. ^ "CCSID 8482". Coded character set identifiers. IBM. Archived from the original on 2014-11-29.
  8. ^ "CCSID 5123". Coded character set identifiers. IBM. Archived from the original on 2014-11-29.
  9. ^ a b c d "ibm-930_P120-1999". International Components for Unicode. Unicode Consortium.
  10. ^ "CCSID 930". Coded character set identifiers. IBM. Archived from the original on 2014-12-01.
  11. ^ a b c d "ibm-1390_P110-2003". International Components for Unicode. Unicode Consortium.
  12. ^ "CCSID 1390". Coded character set identifiers. IBM. Archived from the original on 2014-11-29.
  13. ^ a b c d "ibm-939_P120-1999". International Components for Unicode. Unicode Consortium.
  14. ^ "CCSID 939". Coded character set identifiers. IBM. Archived from the original on 2014-12-01.
  15. ^ a b c d "ibm-1399_P110-2003". International Components for Unicode. Unicode Consortium.
  16. ^ "CCSID 1399". Coded character set identifiers. IBM. Archived from the original on 2014-11-29.
  17. ^ a b c d e Izuno, Hidekatsu (20 October 2021). "jef4j: JEF charset support for Java". GitHub.
  18. ^ a b "EBCDIC／EBCDIKのコード表". Hitachi. Archived from the original on 2021-06-03. Retrieved 2021-05-29.
  19. ^ "JIS/EBCDIK Conversion Table". FCOPY Reference Manual. Hewlett-Packard. [1] Note: table in source maps all input bytes, sometimes to codes not actually defined in JIS X 0201, but is asymmetric and does not always round-trip. Characters shown here are those where the tables in the source round-trip map characters to codes actually defined in JIS X 0201.
  20. ^ "Code Page 00298" (PDF). IBM. Archived from the original (PDF) on 2015-07-08.
  21. ^ "Code Page 01027" (PDF). REGISTRY: Graphic Character Sets and Code Pages. IBM. 1999.
  22. ^ "Code Page 01027" (PDF). IBM. Archived from the original (PDF) on 2015-07-08.
  23. ^ "Code Page 01031" (PDF). IBM. Archived from the original (PDF) on 2015-07-08.
  24. ^ "Code Page 01136" (PDF). IBM. Archived from the original (PDF) on 2015-07-08.
  25. ^ "EBCDICカナ文字からの変換". コード変換 マニュアル - はじめに (HULFT8) (in Japanese). Saison Information Systems.
  26. ^ Koizumi, Moriyoshi. "EBCDIC-kana".
  27. ^ "Code Page 00290" (PDF). REGISTRY: Graphic Character Sets and Code Pages. IBM. 1999.
  28. ^ "Code Page 00290" (PDF). IBM. Archived from the original (PDF) on 2015-07-08.
  29. ^ "Code Page 00887" (PDF). IBM. Archived from the original (PDF) on 2015-07-08.
  30. ^ "Code Page 01030" (PDF). IBM. Archived from the original (PDF) on 2015-07-08.
  31. ^ a b c d e "付録K.3 文字コード変換". Hitachi.
  32. ^ "2 Codesets and Codeset Conversion". DIGITAL UNIX Technical Reference for Using Japanese Features. Compaq.
  33. ^ a b c d "IBM Japanese Graphic Character Set, Kanji" (PDF). IBM. 1999. IBM Corporate Specification C-H 3-3220-024.
  34. ^ "ibm-1364_P110-2007". International Components for Unicode. Unicode Consortium.
  35. ^ "CCSID 16684". Coded character set identifiers. IBM. Archived from the original on 2014-11-29.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Japanese_language_in_EBCDIC&oldid=1193206459"