“Information Theory regards information as only those symbols that are uncertain to the receiver. For years, people have sent telegraph messages, leaving out non-essential words such as “a” and “the.” In the same vein, predictable symbols can be left out, like in the sentence, “only infrmatn esentil to understandn mst b tranmitd.” Shannon made clear that uncertainty is the very commodity of communication.”

Read:Lucent | Information Theory and Overview of Information Theory