A Mathematical Theory of Communication: Difference between revisions

Source: Wikipedia, the free encyclopedia.
Content deleted Content added
Extended confirmed users
18,740 edits
→‎top: We can imagine
→‎Description: Adding the proposed Shannon-Fano coding technique that was included in this paper.
Line 11: Line 11:
*A destination, which can be a person or a machine, for whom or which the message is intended
*A destination, which can be a person or a machine, for whom or which the message is intended


It also developed the concepts of [[information entropy]] and [[redundancy (information theory)|redundancy]], and introduced the term [[bit]] (which Shannon credited to [[John Tukey]]) as a unit of information.
It also developed the concepts of [[information entropy]] and [[redundancy (information theory)|redundancy]], and introduced the term [[bit]] (which Shannon credited to [[John Tukey]]) as a unit of information. It was also in this paper that the [[Shannon–Fano coding]] technique was proposed - a technique developed in conjunction with [[Robert Fano]].


==References==
==References==

Revision as of 18:50, 5 November 2018

"A Mathematical Theory of Communication" is an article by

Bell System Technical Journal in 1948.[1][2][3][4] It was renamed The Mathematical Theory of Communication in the book of the same name,[5]
a small but significant title change after realizing the generality of this work.

Description

Shannon's diagram of a general communications system, which shows the process that produces a message.

The article was the founding work of the field of

ISBN 0-252-72548-4). The book contains an additional article by Warren Weaver
, providing an overview of the theory for a more general audience. Shannon's article laid out the basic elements of communication:

  • An information source that produces a message
  • A transmitter that operates on the message to create a
    signal
    which can be sent through a channel
  • A channel, which is the medium over which the signal, carrying the information that composes the message, is sent
  • A receiver, which transforms the signal back into the message intended for delivery
  • A destination, which can be a person or a machine, for whom or which the message is intended

It also developed the concepts of

information entropy and redundancy, and introduced the term bit (which Shannon credited to John Tukey) as a unit of information. It was also in this paper that the Shannon–Fano coding technique was proposed - a technique developed in conjunction with Robert Fano
.

References

External links