A Mathematical Theory of Communication: Difference between revisions
Appearance
Content deleted Content added
Extended confirmed users 18,740 edits →top: We can imagine |
→Description: Adding the proposed Shannon-Fano coding technique that was included in this paper. |
||
Line 11: | Line 11: | ||
*A destination, which can be a person or a machine, for whom or which the message is intended |
*A destination, which can be a person or a machine, for whom or which the message is intended |
||
It also developed the concepts of [[information entropy]] and [[redundancy (information theory)|redundancy]], and introduced the term [[bit]] (which Shannon credited to [[John Tukey]]) as a unit of information. |
It also developed the concepts of [[information entropy]] and [[redundancy (information theory)|redundancy]], and introduced the term [[bit]] (which Shannon credited to [[John Tukey]]) as a unit of information. It was also in this paper that the [[Shannon–Fano coding]] technique was proposed - a technique developed in conjunction with [[Robert Fano]]. |
||
==References== |
==References== |
Revision as of 18:50, 5 November 2018
"A Mathematical Theory of Communication" is an article by
Bell System Technical Journal in 1948.[1][2][3][4] It was renamed The Mathematical Theory of Communication in the book of the same name,[5]
a small but significant title change after realizing the generality of this work.
Description
![](http://upload.wikimedia.org/wikipedia/commons/thumb/f/f3/Shannon_communication_system.svg/343px-Shannon_communication_system.svg.png)
The article was the founding work of the field of
ISBN 0-252-72548-4). The book contains an additional article by Warren Weaver
, providing an overview of the theory for a more general audience. Shannon's article laid out the basic elements of communication:
- An information source that produces a message
- A transmitter that operates on the message to create a signalwhich can be sent through a channel
- A channel, which is the medium over which the signal, carrying the information that composes the message, is sent
- A receiver, which transforms the signal back into the message intended for delivery
- A destination, which can be a person or a machine, for whom or which the message is intended
It also developed the concepts of
information entropy and redundancy, and introduced the term bit (which Shannon credited to John Tukey) as a unit of information. It was also in this paper that the Shannon–Fano coding technique was proposed - a technique developed in conjunction with Robert Fano
.
References
- .
- .
- ISBN 0-486-66521-6, p. v
- ISBN 978-0-387-79233-0.
- ISBN 0-252-72548-4
External links
- The full article, hosted by IEEE (requires login)
- (PDF) A Mathematical Theory of Communication by C.E. Shannon hosted by the Harvard Mathematics Department, at Harvard University
- Khan Academy Video about A Mathematical Theory of Communication
- views