Nat (information)

When the Shannon entropy is written using a natural logarithm,

:

H = - \sum_i p_i \ln p_i \,

it is implicitly giving a number measured in ''nats''.

One nat corresponds to about 1.44 Bit s (log₂(e)), or 0.434 Hartley s (log₁₀(e)).

HISTORY

and Boulton (1970) introduced the term ''nit'' in conjunction with Minimum Message Length which was subsequently changed by the Minimum Description Length community to ''nat'' to avoid confusion with the Nit (unit) ( Comley and Dowe, 2005 , sec. 11.4.1, p271 ).

REFERENCES

J.W. Comley and D.L. Dowe, `` Minimum Message Length, MDL and Generalised Bayesian Networks with Asymmetric Languages '', Chapter 11 (pp 265 - 294 ) in P. Gru"nwald, I. J. Myung and M. A. Pitt (eds.), ` Advances in Minimum Description Length: Theory and Applications ', MIT Press (ISBN 0-262-07262-9), April 2005.

Fazlollah M. Reza. ''An Introduction to Information Theory''. New York: Dover 1994. ISBN 048668210

	APPAREL
	BABY
	BEAUTY
	BOOKS
	CAR TOYS
	CELL PHONES
	DVD'S
	ELECTRONICS
	GOURMET FOOD
	GROCERIES
	HEALTH & PERSONAL
	HOME & GARDEN
	JEWELRY
	MUSIC
	MUSIC INSTRUMENTS
	OFFICE PRODUCTS
	SOFTWARE
	SPORTING GOODS
	TOOLS & HARDWARE
	TOYS
	VIDEO GAMES
	SHOPPING HOME

	MORE SHOPPING...

Information About

Nat (information)