Memory Hierarchy Article Index for
Memory 		Website Links For
Memory 		 

Information About

Memory Hierarchy
  CATEGORIES ABOUT MEMORY HIERARCHY
   
computer memory
   
hierarchy
   
APPAREL
BABY
BEAUTY
BOOKS
CAR TOYS
CELL PHONES
DVD'S
ELECTRONICS
GOURMET FOOD
GROCERIES
HEALTH & PERSONAL
HOME & GARDEN
JEWELRY
MUSIC
MUSIC INSTRUMENTS
OFFICE PRODUCTS
SOFTWARE
SPORTING GOODS
TOOLS & HARDWARE
TOYS
VIDEO GAMES
SHOPPING HOME
MORE SHOPPING...



The Hierarchical arrangement of Storage in current Computer Architecture s is called the memory hierarchy. It is designed to take advantage of Memory Locality in Computer Program s. Each level of the hierarchy has the properties of higher Speed , smaller size, and lower Latency than lower levels.

Most modern CPUs are so fast that for most program workloads, the Locality Of Reference of memory accesses and the efficiency of the Caching and memory transfer between different levels of the hierarchy are the practical limitation on processing speed. As a result, the CPU spends much of its time idling, waiting for memory I/O to complete.

The memory hierarchy in most computers is:

  • Processor Register s – fastest possible access (usually 1 CPU cycle), only hundreds of bytes in size

  • Level 1 (L1) Cache – often accessed in just a few cycles, usually tens of kilobytes

  • Level 2 (L2) Cache – higher latency than L1 by 2× to 10×, often 512 KiB or more

  • Level 3 (L3) Cache – (optional) higher latency than L2, often several MiB

  • Main Memory ( DRAM ) – may take hundreds of cycles, but can be multiple gigabytes. Access times may not be uniform, in the case of a NUMA machine.

  • Flash Memory – faster than disk storage, with up to 4GB or more of data, transferring (usually) over universal serial bus (USB)

  • Disk Storage – hundreds of thousands of cycles latency, but very large

  • Tertiary Storage – tape, optical disk (WORM)



MANAGEMENT

Modern Programming Language s mainly assume two levels of memory, main memory and disk storage, though in Assembly Language , and in Inline Assembler in languages such as C , registers can be directly accessed. Taking optimal advantage of the memory hierarchy requires the cooperation of programmers, hardware, and compilers (as well as underlying support from the operating system):
  • Programmers are responsible for moving data between disk and memory through file I/O.

  • Hardware is responsible for moving data between memory and caches.

  • Optimizing Compilers are responsible for generating code that, when executed, will cause the hardware to use caches and registers efficiently.



SEE ALSO