Word (computer architecture)

Short description: Base memory unit handled by a computer

In computing, a word is the natural unit of data used by a particular processor design. A word is a fixed-sized datum handled as a unit by the instruction set or the hardware of the processor. The number of bits or digits in a word (the word size, word width, or word length) is an important characteristic of any specific processor design or computer architecture.

The size of a word is reflected in many aspects of a computer's structure and operation; the majority of the registers in a processor are usually word-sized and the largest datum that can be transferred to and from the working memory in a single operation is a word in many (not all) architectures. The largest possible address size, used to designate a location in memory, is typically a hardware word (here, "hardware word" means the full-sized natural word of the processor, as opposed to any other definition used).

Documentation for older computers with fixed word size commonly states memory sizes in words rather than bytes or characters. The documentation sometimes uses metric prefixes correctly, sometimes with rounding, e.g., 65 kilowords (KW) meaning for 65536 words, and sometimes uses them incorrectly, with kilowords (KW) meaning 1024 words (2¹⁰) and megawords (MW) meaning 1,048,576 words (2²⁰). With standardization on 8-bit bytes and byte addressability, stating memory sizes in bytes, kilobytes, and megabytes with powers of 1024 rather than 1000 has become the norm, although there is some use of the IEC binary prefixes.

Several of the earliest computers (and a few modern as well) use binary-coded decimal rather than plain binary, typically having a word size of 10 or 12 decimal digits, and some early decimal computers have no fixed word length at all. Early binary systems tended to use word lengths that were some multiple of 6-bits, with the 36-bit word being especially common on mainframe computers. The introduction of ASCII led to the move to systems with word lengths that were a multiple of 8-bits, with 16-bit machines being popular in the 1970s before the move to modern processors with 32 or 64 bits. Special-purpose designs like digital signal processors, may have any word length from 4 to 80 bits.

The size of a word can sometimes differ from the expected due to backward compatibility with earlier computers. If multiple compatible variations or a family of processors share a common architecture and instruction set but differ in their word sizes, their documentation and software may become notationally complex to accommodate the difference (see Size families below).

Uses of words

Depending on how a computer is organized, word-size units may be used for:

Fixed-point numbers

Holders for fixed point, usually integer, numerical values may be available in one or in several different sizes, but one of the sizes available will almost always be the word. The other sizes, if any, are likely to be multiples or fractions of the word size. The smaller sizes are normally used only for efficient use of memory; when loaded into the processor, their values usually go into a larger, word sized holder.

Floating-point numbers

Holders for floating-point numerical values are typically either a word or a multiple of a word.

Addresses

Holders for memory addresses must be of a size capable of expressing the needed range of values but not be excessively large, so often the size used is the word though it can also be a multiple or fraction of the word size.

Registers

Processor registers are designed with a size appropriate for the type of data they hold, e.g. integers, floating-point numbers, or addresses. Many computer architectures use general-purpose registers that are capable of storing data in multiple representations.

Memory–processor transfer

When the processor reads from the memory subsystem into a register or writes a register's value to memory, the amount of data transferred is often a word. Historically, this amount of bits which could be transferred in one cycle was also called a catena in some environments (such as the Bull Bull Gamma 60|GAMMA 60 (fr)). In simple memory subsystems, the word is transferred over the memory data bus, which typically has a width of a word or half-word. In memory subsystems that use caches, the word-sized transfer is the one between the processor and the first level of cache; at lower levels of the memory hierarchy larger transfers (which are a multiple of the word size) are normally used.

Unit of address resolution

In a given architecture, successive address values almost always designate successive units of memory; this unit is the unit of address resolution. In most computers, the unit is either a character (e.g. a byte) or a word. (A few computers have used bit resolution.) If the unit is a word, then a larger amount of memory can be accessed using an address of a given size at the cost of added complexity to access individual characters. On the other hand, if the unit is a byte, then individual characters can be addressed (i.e. selected during the memory operation).

Instructions

Machine instructions are normally the size of the architecture's word, such as in RISC architectures, or a multiple of the "char" size that is a fraction of it. This is a natural choice since instructions and data usually share the same memory subsystem. In Harvard architectures the word sizes of instructions and data need not be related, as instructions and data are stored in different memories; for example, the processor in the 1ESS electronic telephone switch has 37-bit instructions and 23-bit data words.

Word size choice

When a computer architecture is designed, the choice of a word size is of substantial importance. There are design considerations which encourage particular bit-group sizes for particular uses (e.g. for addresses), and these considerations point to different sizes for different uses. However, considerations of economy in design strongly push for one size, or a very few sizes related by multiples or fractions (submultiples) to a primary size. That preferred size becomes the word size of the architecture.

Character size was in the past (pre-variable-sized character encoding) one of the influences on unit of address resolution and the choice of word size. Before the mid-1960s, characters were most often stored in six bits; this allowed no more than 64 characters, so the alphabet was limited to upper case. Since it is efficient in time and space to have the word size be a multiple of the character size, word sizes in this period were usually multiples of 6 bits (in binary machines). A common choice then was the 36-bit word, which is also a good size for the numeric properties of a floating point format.

After the introduction of the IBM System/360 design, which uses eight-bit characters and supports lower-case letters, the standard size of a character (or more accurately, a byte) becomes eight bits. Word sizes thereafter are naturally multiples of eight bits, with 16, 32, and 64 bits being commonly used.

Variable-word architectures

Early machine designs included some that used what is often termed a variable word length. In this type of organization, an operand has no fixed length. Depending on the machine and the instruction, the length might be denoted by a count field, by a delimiting character, or by an additional bit called, e.g., flag, or word mark. Such machines often use binary-coded decimal in 4-bit digits, or in 6-bit characters, for numbers. This class of machines includes the IBM 702, IBM 705, IBM 7080, IBM 7010, UNIVAC 1050, IBM 1401, IBM 1620, and RCA 301.

Most of these machines work on one unit of memory at a time and since each instruction or datum is several units long, each instruction takes several cycles just to access memory. These machines are often quite slow because of this. For example, instruction fetches on an IBM 1620 Model I take 8 cycles (160 μs) just to read the 12 digits of the instruction (the Model II reduced this to 6 cycles, or 4 cycles if the instruction did not need both address fields). Instruction execution takes a variable number of cycles, depending on the size of the operands.

Word, bit and byte addressing

The memory model of an architecture is strongly influenced by the word size. In particular, the resolution of a memory address, that is, the smallest unit that can be designated by an address, has often been chosen to be the word. In this approach, the word-addressable machine approach, address values which differ by one designate adjacent memory words. This is natural in machines which deal almost always in word (or multiple-word) units, and has the advantage of allowing instructions to use minimally sized fields to contain addresses, which can permit a smaller instruction size or a larger variety of instructions.

When byte processing is to be a significant part of the workload, it is usually more advantageous to use the byte, rather than the word, as the unit of address resolution. Address values which differ by one designate adjacent bytes in memory. This allows an arbitrary character within a character string to be addressed straightforwardly. A word can still be addressed, but the address to be used requires a few more bits than the word-resolution alternative. The word size needs to be an integer multiple of the character size in this organization. This addressing approach was used in the IBM 360, and has been the most common approach in machines designed since then.

When the workload involves processing fields of different sizes, it can be advantageous to address to the bit. Machines with bit addressing may have some instructions that use a programmer-defined byte size and other instructions that operate on fixed data sizes. As an example, on the IBM 7030 ("Stretch"), a floating point instruction can only address words while an integer arithmetic instruction can specify a field length of 1-64 bits, a byte size of 1-8 bits and an accumulator offset of 0-127 bits.

In a byte-addressable machine with storage-to-storage (SS) instructions, there are typically move instructions to copy one or multiple bytes from one arbitrary location to another. In a byte-oriented (byte-addressable) machine without SS instructions, moving a single byte from one arbitrary location to another is typically:

1. LOAD the source byte
2. STORE the result back in the target byte

Individual bytes can be accessed on a word-oriented machine in one of two ways. Bytes can be manipulated by a combination of shift and mask operations in registers. Moving a single byte from one arbitrary location to another may require the equivalent of the following:

1. LOAD the word containing the source byte
2. SHIFT the source word to align the desired byte to the correct position in the target word
3. AND the source word with a mask to zero out all but the desired bits
4. LOAD the word containing the target byte
5. AND the target word with a mask to zero out the target byte
6. OR the registers containing the source and target words to insert the source byte
7. STORE the result back in the target location

Alternatively many word-oriented machines implement byte operations with instructions using special byte pointers in registers or memory. For example, the PDP-10 byte pointer contained the size of the byte in bits (allowing different-sized bytes to be accessed), the bit position of the byte within the word, and the word address of the data. Instructions could automatically adjust the pointer to the next byte on, for example, load and deposit (store) operations.

Powers of two

Different amounts of memory are used to store data values with different degrees of precision. The commonly used sizes are usually a power of two multiple of the unit of address resolution (byte or word). Converting the index of an item in an array into the memory address offset of the item then requires only a shift operation rather than a multiplication. In some cases this relationship can also avoid the use of division operations. As a result, most modern computer designs have word sizes (and other operand sizes) that are a power of two times the size of a byte.

Size families

As computer designs have grown more complex, the central importance of a single word size to an architecture has decreased. Although more capable hardware can use a wider variety of sizes of data, market forces exert pressure to maintain backward compatibility while extending processor capability. As a result, what might have been the central word size in a fresh design has to coexist as an alternative size to the original word size in a backward compatible design. The original word size remains available in future designs, forming the basis of a size family.

In the mid-1970s, DEC designed the VAX to be a 32-bit successor of the 16-bit PDP-11. They used word for a 16-bit quantity, while longword referred to a 32-bit quantity; this terminology is the same as the terminology used for the PDP-11. This was in contrast to earlier machines, where the natural unit of addressing memory would be called a word, while a quantity that is one half a word would be called a halfword. In fitting with this scheme, a VAX quadword is 64 bits. They continued this 16-bit word/32-bit longword/64-bit quadword terminology with the 64-bit Alpha.

Another example is the x86 family, of which processors of three different word lengths (16-bit, later 32- and 64-bit) have been released, while word continues to designate a 16-bit quantity. As software is routinely ported from one word-length to the next, some APIs and documentation define or refer to an older (and thus shorter) word-length than the full word length on the CPU that software may be compiled for. Also, similar to how bytes are used for small numbers in many programs, a shorter word (16 or 32 bits) may be used in contexts where the range of a wider word is not needed (especially where this can save considerable stack space or cache memory space). For example, Microsoft's Windows API maintains the programming language definition of WORD as 16 bits, despite the fact that the API may be used on a 32- or 64-bit x86 processor, where the standard word size would be 32 or 64 bits, respectively. Data structures containing such different sized words refer to them as:

• WORD (16 bits/2 bytes)
• DWORD (32 bits/4 bytes)
• QWORD (64 bits/8 bytes)

A similar phenomenon has developed in Intel's x86 assembly language – because of the support for various sizes (and backward compatibility) in the instruction set, some instruction mnemonics carry "d" or "q" identifiers denoting "double-", "quad-" or "double-quad-", which are in terms of the architecture's original 16-bit word size.

An example with a different word size is the IBM System/360 family. In the System/360 architecture, System/370 architecture and System/390 architecture, there are 8-bit bytes, 16-bit halfwords, 32-bit words and 64-bit doublewords. The z/Architecture, which is the 64-bit member of that architecture family, continues to refer to 16-bit halfwords, 32-bit words, and 64-bit doublewords, and additionally features 128-bit quadwords.

In general, new processors must use the same data word lengths and virtual address widths as an older processor to have binary compatibility with that older processor.

Often carefully written source code – written with source-code compatibility and software portability in mind – can be recompiled to run on a variety of processors, even ones with different data word lengths or different address widths or both.

Table of word sizes

key: bit: bits, c: characters, d: decimal digits, w: word size of architecture, n: variable size, wm: word mark
Year	Computer architecture	Word size w	Integer sizes	Floating­point sizes	Instruction sizes	Unit of address resolution	Char size
1837	Babbage Analytical engine	50 d	w	—	Five different cards were used for different functions, exact size of cards not known.	w	—
1941	Zuse Z3	22 bit	—	w	8 bit	w	—
1942	ABC	50 bit	w	—	—	—	—
1944	Harvard Mark I	23 d	w	—	24 bit	—	—
1946 (1948) {1953}	ENIAC (w/Panel #16) {w/Panel #26}	10 d	w, 2w (w) {w}	—	— (2 d, 4 d, 6 d, 8 d) {2 d, 4 d, 6 d, 8 d}	— — {w}	—
1948	Manchester Baby	32 bit	w	—	w	w	—
1951	UNIVAC I	12 d	w	—	​1⁄2w	w	1 d
1952	IAS machine	40 bit	w	—	​1⁄2w	w	5 bit
1952	Fast Universal Digital Computer M-2	34 bit	w?	w	34 bit = 4-bit opcode plus 3×10 bit address	10 bit	—
1952	IBM 701	36 bit	​1⁄2w, w	—	​1⁄2w	​1⁄2w, w	6 bit
1952	UNIVAC 60	n d	1 d, ... 10 d	—	—	—	2 d, 3 d
1952	ARRA I	30 bit	w	—	w	w	5 bit
1953	IBM 702	n c	0 c, ... 511 c	—	5 c	c	6 bit
1953	UNIVAC 120	n d	1 d, ... 10 d	—	—	—	2 d, 3 d
1953	ARRA II	30 bit	w	2w	​1⁄2w	w	5 bit
1954 (1955)	IBM 650 (w/IBM 653)	10 d	w	— (w)	w	w	2 d
1954	IBM 704	36 bit	w	w	w	w	6 bit
1954	IBM 705	n c	0 c, ... 255 c	—	5 c	c	6 bit
1954	IBM NORC	16 d	w	w, 2w	w	w	—
1956	IBM 305	n d	1 d, ... 100 d	—	10 d	d	1 d
1956	ARMAC	34 bit	w	w	​1⁄2w	w	5 bit, 6 bit
1956	LGP-30	31 bit	w	—	16 bit	w	6 bit
1958	UNIVAC II	12 d	w	—	​1⁄2w	w	1 d
1958	SAGE	32 bit	​1⁄2w	—	w	w	6 bit
1958	Autonetics Recomp II	40 bit	w, 79 bit, 8 d, 15 d	2w	​1⁄2w	​1⁄2w, w	5 bit
1958	ZEBRA	33 bit	w, 65 bit	2w	w	w	5 bit
1958	Setun	6 trit (~9.5 bits)	up to 6 tryte		up to 3 trytes		4 trit?
1958	Electrologica X1	27 bit	w	2w	w	w	5 bit, 6 bit
1959	IBM 1401	n c	1 c, ...	—	1 c, 2 c, 4 c, 5 c, 7 c, 8 c	c	6 bit + wm
1959 (TBD)	IBM 1620	n d	2 d, ...	— (4 d, ... 102 d)	12 d	d	2 d
1960	LARC	12 d	w, 2w	w, 2w	w	w	2 d
1960	CDC 1604	48 bit	w	w	​1⁄2w	w	6 bit
1960	IBM 1410	n c	1 c, ...	—	1 c, 2 c, 6 c, 7 c, 11 c, 12 c	c	6 bit + wm
1960	IBM 7070	10 d	w, 1-9 d	w	w	w, d	2 d
1960	PDP-1	18 bit	w	—	w	w	6 bit
1960	Elliott 803	39 bit
1961	IBM 7030 (Stretch)	64 bit	1 bit, ... 64 bit, 1 d, ... 16 d	w	​1⁄2w, w	bit (integer), ​1⁄2w (branch), w (float)	1 bit, ... 8 bit
1961	IBM 7080	n c	0 c, ... 255 c	—	5 c	c	6 bit
1962	GE-6xx	36 bit	w, 2 w	w, 2 w, 80 bit	w	w	6 bit, 9 bit
1962	UNIVAC III	25 bit	w, 2w, 3w, 4w, 6 d, 12 d	—	w	w	6 bit
1962	Autonetics D-17B Minuteman I Guidance Computer	27 bit	11 bit, 24 bit	—	24 bit	w	—
1962	UNIVAC 1107	36 bit	​1⁄6w, ​1⁄3w, ​1⁄2w, w	w	w	w	6 bit
1962	IBM 7010	n c	1 c, ...	—	1 c, 2 c, 6 c, 7 c, 11 c, 12 c	c	6 b + wm
1962	IBM 7094	36 bit	w	w, 2w	w	w	6 bit
1962	SDS 9 Series	24 bit	w	2w	w	w
1963 (1966)	Apollo Guidance Computer	15 bit	w	—	w, 2w	w	—
1963	Saturn Launch Vehicle Digital Computer	26 bit	w	—	13 bit	w	—
1964/1966	PDP-6/PDP-10	36 bit	w	w, 2 w	w	w	6 bit 7 bit (typical) 9 bit
1964	Titan	48 bit	w	w	w	w	w
1964	CDC 6600	60 bit	w	w	​1⁄4w, ​1⁄2w	w	6 bit
1964	Autonetics D-37C Minuteman II Guidance Computer	27 bit	11 bit, 24 bit	—	24 bit	w	4 bit, 5 bit
1965	Gemini Guidance Computer	39 bit	26 bit	—	13 bit	13 bit, 26	—bit
1965	IBM 1130	16 bit	w, 2w	2w, 3w	w, 2w	w	8 bit
1965	IBM System/360	32 bit	​1⁄2w, w, 1 d, ... 16 d	w, 2w	​1⁄2w, w, 1​1⁄2w	8 bit	8 bit
1965	UNIVAC 1108	36 bit	​1⁄6w, ​1⁄4w, ​1⁄3w, ​1⁄2w, w, 2w	w, 2w	w	w	6 bit, 9 bit
1965	PDP-8	12 bit	w	—	w	w	8 bit
1965	Electrologica X8	27 bit	w	2w	w	w	6 bit, 7 bit
1966	SDS Sigma 7	32 bit	​1⁄2w, w	w, 2w	w	8 bit	8 bit
1969	Four-Phase Systems AL1	8 bit	w	—	?	?	?
1970	MP944	20 bit	w	—	?	?	?
1970	PDP-11	16 bit	w	2w, 4w	w, 2w, 3w	8 bit	8 bit
1971	CDC STAR-100	64 bit	​1⁄2w, w	​1⁄2w, w	​1⁄2w, w	bit	8 bit
1971	TMS1802NC	4 bit	w	—	?	?	—
1971	Intel 4004	4 bit	w, d	—	2w, 4w	w	—
1972	Intel 8008	8 bit	w, 2 d	—	w, 2w, 3w	w	8 bit
1972	Calcomp 900	9 bit	w	—	w, 2w	w	8 bit
1974	Intel 8080	8 bit	w, 2w, 2 d	—	w, 2w, 3w	w	8 bit
1975	ILLIAC IV	64 bit	w	w, ​1⁄2w	w	w	—
1975	Motorola 6800	8 bit	w, 2 d	—	w, 2w, 3w	w	8 bit
1975	MOS Tech. 6501 MOS Tech. 6502	8 bit	w, 2 d	—	w, 2w, 3w	w	8 bit
1976	Cray-1	64 bit	24 bit, w	w	​1⁄4w, ​1⁄2w	w	8 bit
1976	Zilog Z80	8 bit	w, 2w, 2 d	—	w, 2w, 3w, 4w, 5w	w	8 bit
1978 (1980)	16-bit x86 (Intel 8086) (w/floating point: Intel 8087)	16 bit	​1⁄2w, w, 2 d	— (2w, 4w, 5w, 17 d)	​1⁄2w, w, ... 7w	8 bit	8 bit
1978	VAX	32 bit	​1⁄4w, ​1⁄2w, w, 1 d, ... 31 d, 1 bit, ... 32 bit	w, 2w	​1⁄4w, ... 14​1⁄4w	8 bit	8 bit
1979 (1984)	Motorola 68000 series (w/floating point)	32 bit	​1⁄4w, ​1⁄2w, w, 2 d	— (w, 2w, 2​1⁄2w)	​1⁄2w, w, ... 7​1⁄2w	8 bit	8 bit
1985	IA-32 (Intel 80386) (w/floating point)	32 bit	​1⁄4w, ​1⁄2w, w	— (w, 2w, 80 bit)	8 bit, ... 120 bit ​1⁄4w ... 3​3⁄4w	8 bit	8 bit
1985	ARMv1	32 bit	​1⁄4w, w	—	w	8 bit	8 bit
1985	MIPS I	32 bit	​1⁄4w, ​1⁄2w, w	w, 2w	w	8 bit	8 bit
1991	Cray C90	64 bit	32 bit, w	w	​1⁄4w, ​1⁄2w, 48 bit	w	8 bit
1992	Alpha	64 bit	8 bit, ​1⁄4w, ​1⁄2w, w	​1⁄2w, w	​1⁄2w	8 bit	8 bit
1992	PowerPC	32 bit	​1⁄4w, ​1⁄2w, w	w, 2w	w	8 bit	8 bit
1996	ARMv4 (w/Thumb)	32 bit	​1⁄4w, ​1⁄2w, w	—	w (​1⁄2w, w)	8 bit	8 bit
2000	IBM z/Architecture (w/vector facility)	64 bit	​1⁄4w, ​1⁄2w, w 1 d, ... 31 d	​1⁄2w, w, 2w	​1⁄4w, ​1⁄2w, ​3⁄4w	8 bit	8 bit, UTF-16, UTF-32
2001	IA-64	64 bit	8 bit, ​1⁄4w, ​1⁄2w, w	​1⁄2w, w	41 bit (in 128-bit bundles)	8 bit	8 bit
2001	ARMv6 (w/VFP)	32 bit	8 bit, ​1⁄2w, w	— (w, 2w)	​1⁄2w, w	8 bit	8 bit
2003	x86-64	64 bit	8 bit, ​1⁄4w, ​1⁄2w, w	​1⁄2w, w, 80 bit	8 bit, ... 120 bit	8 bit	8 bit
2013	ARMv8-A and ARMv9-A	64 bit	8 bit, ​1⁄4w, ​1⁄2w, w	​1⁄2w, w	​1⁄2w	8 bit	8 bit
Year	Computer architecture	Word size w	Integer sizes	Floating­point sizes	Instruction sizes	Unit of address resolution	Char size
key: bit: bits, c: characters, d: decimal digits, w: word size of architecture, n: variable size, wm: word mark

See also

• Integer (computer science)