EBCDIC

Source: Wikipedia, the free encyclopedia.

EBCDIC encoding family
Classification8-bit
basic Latin encodings (non‑ASCII)
Preceded byBCD

Extended Binary Coded Decimal Interchange Code

MCP and ICL VME
.

History

Punched card with the Hollerith encoding of the 1964 EBCDIC character set. Contrast at the top is enhanced to show the printed characters. The "number" punches (0-9) directly translate to the lower 4 bits of EBCDIC, though the upper 4 bits of EBCDIC are more complex.

EBCDIC was devised in 1963 and 1964 by

punched cards into six bits. The distinct encoding of 's' and 'S' (using position 2 instead of 1) was maintained from punched cards where it was desirable not to have hole punches too close to each other to ensure the integrity of the physical card.[4][failed verification
]

While IBM was a chief proponent of the ASCII standardization committee,

ICL System 4
, and Fujitsu FACOM, thus so did EBCDIC.

All IBM's mainframe operating systems, and its IBM i operating system for midrange computers, use EBCDIC as their inherent encoding[6] (with toleration for ASCII, for example, ISPF in z/OS can browse and edit both EBCDIC and ASCII encoded files). Software can translate to and from encodings, and modern mainframes (such as IBM Z) include processor instructions, at the hardware level, to accelerate translation between character sets.

There is an EBCDIC-oriented

Unicode Transformation Format called UTF-EBCDIC proposed by the Unicode Consortium, designed to allow easy updating of EBCDIC software to handle Unicode, but not intended to be used in open interchange environments. Even on systems with extensive EBCDIC support, it has not been popular. For example, z/OS supports Unicode (preferring UTF-16
specifically), but z/OS only has limited support for UTF-EBCDIC.

Not all operating systems running on IBM hardware use EBCDIC;

Linux on Power all use ASCII, as did all operating systems on the IBM Personal Computer
and its successors.

Compatibility with ASCII

There were numerous difficulties to writing software that would work in both ASCII and EBCDIC.

Code page layout

There are hundreds of EBCDIC code pages based on the original EBCDIC character encoding; there are a variety of EBCDIC code pages intended for use in different parts of the world, including code pages for non-Latin scripts such as Chinese, Japanese (e.g., EBCDIC 930, JEF, and KEIS), Korean, and Greek (EBCDIC 875). There is also a huge number of variations with the letters swapped around for no discernible reason.[citation needed]

The table below shows the "invariant subset"[9] of EBCDIC, which are characters that should have the same assignments on all EBCDIC code pages that use the Latin alphabet. (This includes most of the ISO/IEC 646 invariant repertoire, except the exclamation mark.) It also shows (in gray) missing ASCII and EBCDIC punctuation, located where they are in Code Page 37 (one of the code page variants of EBCDIC). The blank cells are filled with region-specific characters in the variants, but the characters in gray are often swapped around or replaced as well. Like ASCII, the invariant subset works only for languages using the ISO basic Latin alphabet, such as English (excluding loanwords and some uncommon orthographic variations) and Dutch (if the "ij" and "IJ" ligatures are written as two characters).

EBCDIC
0 1 2 3 4 5 6 7 8 9 A B C D E F
0x NUL SOH STX
ETX
SEL  
HT
 
RNL DEL  GE  SPS RPT  
VT
 
 
FF
 
 CR   
SO
 
 
SI
  
1x DLE DC1 DC2 DC3 RES/
ENP
 NL    BS  POC CAN  EM  UBS CU1  
IFS
 
IGS
 
IRS
IUS/
ITB
2x  DS  SOS  FS  WUS BYP/
INP
 
LF
 
ETB
ESC  SA  SFE  SM/
SW
CSP MFA ENQ
ACK
BEL
3x
SYN
  IR   PP  TRN NBS
EOT
SBS   IT  RFF CU3 DC4
NAK
SUB
4x  
SP
 
¢
. <
(
+
|
5x &
!
$
*
)
;
¬
6x -
/
¦
,
%
_ >
?
7x
`
: #
@
' =
"
8x a b c d e f g h i
±
9x j k l m n o p q r
Ax
~
s t u v w x y z
Bx
^
[
]
Cx
{
A B C D E F G H I
Dx
}
J K L M N O P Q R
Ex
\
S T U V W X Y Z
Fx 0 1 2 3 4 5 6 7 8 9  EO 

Definitions of non-ASCII EBCDIC controls

Following are the definitions of EBCDIC control characters which either do not map onto the ASCII control characters, or have additional uses. When mapped to Unicode, these are mostly mapped to C1 control character codepoints in a manner specified by IBM's Character Data Representation Architecture (CDRA).[10][11]

Although the default mapping of New Line (NL) corresponds to the ISO/IEC 6429 Next Line (NEL) character (the behaviour of which is also specified, but not required, in Unicode Annex 14),

ISO/IEC 10646 (Unicode)).[15]

Besides U+0085 (Next Line), the Unicode Standard does not prescribe an interpretation of C1 control characters, leaving their interpretation to higher level protocols (it suggests, but does not require, their ISO/IEC 6429 interpretations in the absence of use for other purposes),[16] so this mapping is permissible in, but not specified by, Unicode.

Mnemonic EBCDIC CDRA pairing[10][11] Name Description[17]
SEL 04 009C Select Device control character taking a single-byte parameter.
PF Punch Off Listed in this location by GOST 19768-93.[18]
RNL 06 0086 Required New Line Line-break resetting Indent Tab mode
LC Lower Case Listed in this location by GOST 19768-93.[18]
GE 08 0097 Graphic Escape Non-locking shift that changes the interpretation of the following character (see e.g.
Code page 310). Compare ISO/IEC 6429's SS2
(008E).
SPS 09 008D Superscript Begin superscript or undo subscript. Compare ISO/IEC 6429's PLU (008C).
RPT 0A 008E Repeat Switch to an operation mode repeating a print buffer
SMM Start of Manual Message Listed in this location by GOST 19768-93.[18]
RES/ENP 14 009D Restore, Enable Presentation Resume output (after BYP/INP)
NL 15 0085 (000A) New Line Line break. Default mapping (0085) matches ISO/IEC 6429's NEL. Mappings sometimes swapped with Line Feed (EBCDIC 0x25) in accordance with UNIX line breaking convention.[10]
POC 17 0087 Program Operator Communication Followed by two one-byte operators that identify the specific function, for example a light or function key. Contrast with ISO/IEC 6429's
CSI (009B), OSC (009D) and APC
(009F).
IL Idle Listed in this location by GOST 19768-93.[18]
UBS 1A 0092 Unit Backspace A fractional backspace.
CC Cursor Control Listed in this location by GOST 19768-93.[18]
CU1 1B 008F Customer Use One Not used by IBM; for customer use.
IUS/ITB 1F 001F Interchange Unit Separator, Intermediate Transmission Block Either used as an information separator to terminate a block called a "unit" (as
in ASCII; see also IR
), or used as a transmission control code to delimit the end of an intermediate block.
DS 20 0080 Digit Select Used by S/360 CPU edit (ED) instruction
SOS 21 0081 Start of Significance Used by S/360 CPU edit (ED) instruction. (Note: different from ISO/IEC 6429's SOS; where distinguishing them is necessary, IBM abbreviates Start of Significance as SOS. (with a dot) and Start of String as SOS, otherwise they are abbreviated the same.)[19]
FS,[17] FDS[18] 22 0082 Field Separator Used by S/360 CPU edit (ED) instruction. (Note:
(Interchange) File Separator, as abbreviated FS in ASCII, is at 0x1C and abbreviated IFS.)[17]
WUS 23 0083 Word Underscore Underscores the immediately preceding word. Contrast with ISO/IEC 6429's SGR.
BYP/INP 24 0084 Bypass, Inhibit Presentation De-activates output, i.e. ignores all graphical characters and control characters besides transmission control codes and RES/ENP, until the next RES/ENP.
SA 28 0088 Set Attribute Marks the beginning of a fixed-length device specific control sequence. Deprecated in favour of CSP.
SFE 29 0089 Start Field Extended Marks the beginning of a variable-length device specific control sequence. Deprecated in favour of CSP.
SM/SW 2A 008A Set Mode, Switch Device specific control that sets a mode of operation, such as a buffer switch.
CU2 2B 008B Customer Use Two This appears in some specifications, such as GOST 19768-93;[18] newer IBM specifications for EBCDIC control codes list only CU1 and CU3 as customer-use, and use this position for CSP.[17]
CSP Control Sequence Prefix Marks the beginning of a variable-length device specific control sequence. Followed by a class byte specifying a category of control function, a count byte giving the sequence length (including count and type bytes, but not the class byte or initial CSP), a type byte identifying a control function within that category, and zero or more parameter bytes. Contrast with ISO/IEC 6429's
CSI
(009B).
MFA 2C 008C Modify Field Attribute Marks the beginning of a variable-length device specific control sequence. Deprecated in favour of CSP.
30 0090 (reserved) Reserved for future use by IBM
31 0091 (reserved) Reserved for future use by IBM
IR 33 0093 Index Return Either move to start of next line (see also NL), or terminate an information unit (see also IUS/ITB).
PP 34 0094 Presentation Position Followed by two one-byte parameters (firstly function, secondly number of either column or line) to set the current position. Contrast with ISO/IEC 6429's CUP and HVP.
PN Punch On Listed in this location by GOST 19768-93.[18]
TRN 35 0095 Transparent Followed by one byte parameter that indicates the number of bytes of transparent data that follow.
RST Reader Stop Listed in this location by GOST 19768-93.[18]
NBS 36 0096 Numeric Backspace Move backward the width of one digit.
UC Upper Case Listed in this location by GOST 19768-93.[18]
SBS 38 0098 Subscript Begin subscript or undo superscript. Compare ISO/IEC 6429's PLD (008B).
IT 39 0099 Indent Tab Indents the current and all following lines, until RNL or RFF is encountered.
RFF 3A 009A Required Form Feed Page-break resetting Indent Tab mode.
CU3 3B 009B Customer Use Three Not used by IBM; for customer use.
3E 009E (reserved) Reserved for future use by IBM
EO FF 009F Eight Ones All ones character used as filler

Code pages with Latin-1 character sets

The following code pages have the full

ISO 8859-15
)

Different countries have different code pages because these code pages originated as code pages with country-specific character repertoires, and were later expanded to contain the entire ISO 8859-1 repertoire, meaning that a given ISO 8859-1 character may have different code point values in different code pages. They are known as Country Extended Code Pages (CECPs).[20]

CCSID Euro
update
Countries
037 1140 Australia, Brazil, Canada, New Zealand, Portugal, South Africa, USA
273 1141 Austria, Germany
277 1142 Denmark, Norway
278 1143 Finland, Sweden
280 1144 Italy
284 1145 Latin America, Spain
285 1146 Ireland, United Kingdom
297 1147 France
500 1148 International
871 1149 Iceland
1047 924 Open Systems (
C
compiler)

Criticism and humor

Open-source software advocate and software developer Eric S. Raymond writes in his Jargon File that EBCDIC was loathed by hackers, by which he meant[21] members of a subculture of enthusiastic programmers. The Jargon File 4.4.7 gives the following definition:[22]

EBCDIC: /eb´s@·dik/, /eb´see`dik/, /eb´k@·dik/, n. [abbreviation, Extended Binary Coded Decimal Interchange Code] An alleged character set used on IBM dinosaurs. It exists in at least six mutually incompatible versions, all featuring such delights as non-contiguous letter sequences and the absence of several ASCII punctuation characters fairly important for modern computer languages (exactly which characters are absent varies according to which version of EBCDIC you're looking at). IBM adapted EBCDIC from punched card code in the early 1960s and promulgated it as a customer-control tactic (see

connector conspiracy), spurning the already established ASCII standard. Today, IBM claims to be an open-systems
company, but IBM's own description of the EBCDIC variants and how to convert between them is still internally classified top-secret, burn-before-reading. Hackers blanch at the very name of EBCDIC and consider it a manifestation of purest evil.

— The Jargon file 4.4.7

EBCDIC design was also the source of many jokes. One such joke, found in the Unix

4.3BSD Reno (1990)[23]
went:

Professor: "So the American government went to IBM to come up with an encryption standard, and they came up with—"
Student: "EBCDIC!"

References to the EBCDIC character set are made in the 1979 computer game series

Zork II
, EBCDIC is used to imply an incomprehensible language:

This is a large room full of assorted heavy machinery, whirring noisily. The room smells of burned resistors. Along one wall are three buttons which are, respectively, round, triangular, and square. Naturally, above these buttons are instructions written in EBCDIC...

In 2021, it became public that a Belgian bank was still using EBCDIC internally in 2019. This came to attention because a customer insisted that the correct spelling of his surname included an umlaut, which the bank omitted. The customer filed a complaint citing the guarantee in the General Data Protection Regulation of the right to timely "rectification of inaccurate personal data." The bank argued in part that it could not comply because its computer system was only compatible with EBCDIC, which does not support umlauted letters. The appeals court ruled in favor of the customer.[24][25]

See also

References

  1. ^
    LCCN 77-90165
    . Retrieved 2022-04-06.
  2. .
  3. ^ a b Bemer, Bob. "EBCDIC and the P-Bit (The Biggest Computer Goof Ever) - Computer History Vignettes". Archived from the original on 2018-05-13. Retrieved 2013-07-02. ...but their printers and punches were not ready to handle ASCII, and IBM just HAD to announce.
  4. ^ "Doug Jones's punched card codes". homepage.cs.uiowa.edu. Retrieved 2023-01-14.
  5. ^ "X3.4-1963". 1963. p. 4. (NB. IBM had four staff members on the final 21-member ASA X3.2 sub-committee.)
  6. ^ IBMnt (2008). "IBM confirms the use of EBCDIC in their mainframes as a default practice". Archived from the original on 2013-01-03. Retrieved 2008-06-16.
  7. ^ "Rationale for International Standard – Programming Languages – C" (PDF). Revision 5.10. April 2003. § MSE.4: Support for invariant ISO/IEC 646. Archived (PDF) from the original on 2016-06-06. Retrieved 2022-11-24.
  8. ^ PDP-10 Reference Handbook, Book 2: Assembling the Source Program (PDF). Digital Equipment Corporation. p. 221.
  9. ^ "Invariant character set". IBM Knowledge Center. 2018-08-14.
  10. ^ a b c Umamaheswaran, V.S. (1999-11-08). "3.3 Step 2: Byte Conversion". UTF-EBCDIC. Unicode Consortium. Unicode Technical Report #16. The 64 control characters...the ASCII DELETE character (U+007F)...are mapped respecting EBCDIC conventions, as defined in IBM Character Data Representation Architecture, CDRA, with one exception -- the pairing of EBCDIC Line Feed and New Line control characters are swapped from their CDRA default pairings to ISO/IEC 6429 Line Feed (U+000A) and Next Line (U+0085) control characters
  11. ^ a b Steele, Shawn (1996-04-24). "cp037_IBMUSCanada to Unicode table". Microsoft/Unicode Consortium.
  12. ^ Heninger, Andy (2019-02-15). "NL: Next Line (A) (Non-tailorable)". Unicode Line Breaking Algorithm. Revision 43. Unicode Consortium. Unicode Standard Annex #14.
  13. ISO-IR-124.{{citation}}: CS1 maint: numeric names: authors list (link
    )
  14. ^ ISO/IEC International Register of Coded Character Sets To Be Used With Escape Sequences (PDF), ITSCJ/IPSJ, ISO-IR
  15. ISO. pp. 19–20. ISO/IEC 10646. For other C0 or C1 sets, the final octet F shall be obtained from the International Register of Coded Character Sets....If such an escape sequence appears within a code unit sequence conforming to this International Standard, it shall be padded in accordance with Clause 11.{{citation}}: CS1 maint: numeric names: authors list (link
    )
  16. .
  17. ^ on 2018-09-11.
  18. ^ a b c d e f g h i j GOST (1993). "Информационная технология. Наборы 8-битных кодированных символов. Двоичный код обработки информации" [Information technology. 8-bit coded character sets. Binary code for information processing] (in Russian). GOST 19768-93.
  19. ^ IBM. "Character Data Representation Architecture (CDRA)". IBM. p. 327. The mnemonic for the Start of Significance control character in EBCDIC has been modified to include a dot (.) at the end (SOS.). This has been done to distinguish it from the SOS mnemonic used in ISO-8 for the Start of String control character. The dot does not alter the property of the control in any way.
  20. Kermit project / Columbia University
    .
  21. ^ Raymond, Eric S. (1997). "The New Hacker's Dictionary". p. 310.
  22. ^ "EBCDIC". Jargon File. Archived from the original on 2018-05-13. Retrieved 2018-05-13.
  23. ^ 4.3BSD-Reno/share/games/fortune/fortunes
  24. ^ "Court of Appeal of Brussels - 2019/AR/1006 - GDPRhub".
  25. .

External links

This page is based on the copyrighted Wikipedia article: EBCDIC. Articles is available under the CC BY-SA 3.0 license; additional terms may apply.Privacy Policy