Signal (information Theory) Article Index for
Signal 		Website Links For
Signal 		 

Information About

Signal (information Theory)
APPAREL
BABY
BEAUTY
BOOKS
CAR TOYS
CELL PHONES
DVD'S
ELECTRONICS
GOURMET FOOD
GROCERIES
HEALTH & PERSONAL
HOME & GARDEN
JEWELRY
MUSIC
MUSIC INSTRUMENTS
OFFICE PRODUCTS
SOFTWARE
SPORTING GOODS
TOOLS & HARDWARE
TOYS
VIDEO GAMES
SHOPPING HOME
MORE SHOPPING...



Information theory studies both continuous signals, commonly called '' Analog '' signals; and discrete signals (Shannon 2005, 3), or quantized signals, of which the most common today are '' Digital '' signals . The information carried by a signal may be measured either on a per second basis, or per transmitted symbol; that is, either in continuous or discrete time (ibid, 19).

In information theory, the message is generated by a Stochastic Process , and the transmitted signal derives its statistical properties from the message. Conversely, usage of ''signal'' in reference to a process that generates a transmitted sequence of states in a communications channel implies that this process is stochastic. When it is not stochastic, misunderstandings can be created. Oldberg. (2005) reports that misunderstandings of this type plague the field of Defect Detection Testing.


ANALOG AND DIGITAL SIGNALS

The two main types of signals are '' Analog '' and '' Digital ''. In short, the difference between them is that digital signals are ''discrete'' and ''quantized'', as defined below, while analog signals possess neither property.


Discretization

See Also: Discrete signal



One of the fundamental distinctions between different types of signals is between Continuous and Discrete Time . In the mathematical abstraction, the domain of a continuous-time (CT) signal is the set of real numbers (or some interval thereof), whereas the domain of a discrete-time signal is the set of Integer s (or some interval). What these integers represent depends on the nature of the signal.

DT signals often arise via of CT signals. For instance, Sensor s output data continuously, but since a continuous stream is impossible to record, a discrete signal is used as an approximation. Computer s and other Digital devices are restricted to discrete time.


Quantization

See Also: Quantization (signal processing)



If a signal is to be represented as a sequence of numbers, it is impossible to maintain arbitrarily high precision - each number in the sequence must have a finite number of digits. As a result, the values of such a signal are restricted to belong to a Finite set; in other words, it is Quantized .


EXAMPLES OF SIGNALS

  • '' Motion ''. One can conceive of a signal representing the motion of a particle - say, a mote of Dust , through some suitable Space . The domain of a motion signal is one-dimensional (time), and the range is generally three-dimensional.


  • '' Sound ''. Since a sound is a Vibration of a medium (such as air), a sound signal associates a Pressure value to every value of time. In the real world, sound signals are analog.


  • '' Compact Disc s'' (CDs). CDs contain discrete signals representing sound, recorded at 44,100 samples per Second . Each sample contains data for a left and right channel (since CDs are recorded in Stereo ).


  • '' Picture s''. A picture assigns a color value to each of a set of points. Since the points lie on a plane, the domain is two-dimensional. If the picture is a physical object, such as a painting, it's a continuous signal. If the picture a Digital Image , it's a discrete signal. It's often convenient to represent color as the sum of the intensities of three Primary Colors , so that the signal is vector-valued with dimension three.


  • '' Video s''. A video is a series of images. A point in a video is identified by its position (two-dimensional) and by the time at which it occurs, so a video signal has a three-dimensional domain.


  • Biological '' Membrane Potential s''. The value of the Signal is a straightforward Electric Potential ("voltage"). The domain is more difficult to establish. Some Cell s or Organelle s have the same membrane potential throughout; Neuron s generally have different potentials at different points. These signals have very low energies, but they can be measured in aggregate by the techniques of Electrophysiology .



FREQUENCY ANALYSIS

See Also: Frequency domain



It is remarkably useful to analyze the Frequency Spectrum of a signal. This technique is applicable to all signals, both continuous and discrete. For instance, if a signal is passed through an LTI System , the frequency spectrum of the resulting output signal is the product of the frequency spectrum of the original input signal and the Frequency Response of the system.


ENTROPY

Another important propery of a signal (actually, of a statistically defined class of signals) is its Entropy or ''information content''.


SEE ALSO



WORKS CITED

Oldberg, T., 2005, "An Ethical Problem in the Statistics of Defect Detection Test Reliability," ''ndt.net'', http://www.ndt.net/article/v10n05/oldberg/oldberg.htm .

Shannon, C. E., 2005 "A Mathematical Theory of Communication," ([http://cm.bell-labs.com/cm/ms/what/shannonday/paper.html corrected reprint ), accessed Dec. 15, 2005. Orig. 1948, ''Bell System Technical Journal'', vol. 27, pp. 379-423, 623-656.