Essay

Information Technology Lecture 1

Essay specific features

Essay content:

Information: is a function of probability -- f(p). Information is inversely proportional to p. Shannons def: info(p)=log2(1/p) Entropy = average information Ex: coin flip Pr(H)=Pr(T)=1/2 Info(H)=log2(1/(1/2))=log2(2)=1 bit Info(T)=1 bit If you flip a fair coin, either output gives you 1 bit. Since the entropy is defined as the average information, Entropy for a coin flip is a 1...
displayed 300 characters

Since the entropy is defined as the average information, Entropy for a coin flip is a 1. Formal States 1…n Pr(i)=pi Info(i)=log2(1/pi)=-log2(pi) Entropy: H= {draw:frame} {draw:frame} Flipping a coin twice: Possible outcomes: HH, HT, TH, TT n=4, pi=(1/2)(1/2)=1/4 Info(HH)=log2(1/(1/4))=log2(4)=2 Entropy(HH)=2 ? H=-p1log(p1) ' p2log(p2) ' p3log(p3) ' p4log(p4) = ?(2) + ?(2) +?(2) +?(2) = 2 Example: 6 sided die States: 1…6 pi=1/6 Info(pi)=log2(6)=2...
displayed 300 characters

General issues of this essay:

Related essays:

• The Night of The Iguana

    3 pages,   785 words
   
   
• Price of Gasoline

    6 pages,   1414 words
   
   
• The Road Ahead by Bill Gates

    3 pages,   655 words
   
   
• Information Theory

    6 pages,   1500 words
   
   
• Master Student

    5 pages,   1385 words
   
   
• Information Technology Lecture 1

    1 pages,   173 words
   
   
• The Effects Of Noise On A Communication System

    5 pages,   1399 words