

Department of Electrical Engineering and Computer Science
Department of Mechanical Engineering 
6.050J / 2.110J Information and Entropy
Spring 2006


Unit 4: Errors
Schedule
Lecture 
Thursday, Feb 23, 2006, 1:00 PM 
Room 32124 
Recitation 
Tuesday, Feb 28, 2006, 12:00 PM 
Room 32124 
Special Session 
Thursday, Mar 2, 2006, 12:00 PM 
Room 32124 
Problem Set 
Posted Wednesday, Feb 22, 2006 
Due Friday, Mar 3, 2006 
Solutions 
Posted Friday, Mar 3, 2006 

Lecture Handouts
Students who for any reason did not receive these items can pick up a copy in
Room 38344. Most of this material is also available on the 6.050J/2.110J Web site
http://mtlsites.mit.edu/Courses/6.050.
Reading Assignment
Resources
Laboratory
 Thomas F. Weiss, MIT, Introduction to Matlab, used in 6.003; Fall 1999
http://mtlsites.mit.edu/Courses/6.050/2006/notes/matlab.pdf
 MATLAB on Athena, MIT; 1998
http://web.mit.edu/olh/Matlab/Matlab.html
 Control Tutorials for Matlab, Carnegie Mellon
University and the University of Michigan; August 18, 1997
 Kermit Sigmon, University of Florida, MATLAB Primer, second edition,
translated to HTML by Nam Sun Wang, University of Maryland
http://www.glue.umd.edu/~nsw/ench250/primer.htm
Technical
Historical
General Technical Books
There are many excellent texts on coding theory and communications, most of which
assume a familiarity with mathematics beyond introductory calculus.
 John G. Truxal, "The Age of Electronic Messages," McGrawHill Publishing Company,
New York, NY; 1990. Aimed at providing technology and engineering exposure to
liberal arts students. Nonmathematical, with lots of great examples. Based on
material taught at the State University of New York at Stony Brook.
 John R. Pierce, "An Introduction to Information Theory: Symbols, Signals, and
Noise," Dover Publications, Inc., New York, NY; 1961, 1980 (Second Edition).
Mostly nonmathematical, by one of the nation's great scientific contributors at
AT&T Bell Laboratories, who was also interested in reaching a general audience.
He was later on the faculty at Caltech. One of his interesting sideline activities was writing
science fiction stories under the pen name J. J. Coupling. He died April 2, 2002
at the age of 92.
 Robert G. Gallager, "Information Theory and Reliable Communications," John
Wiley & Sons, Inc., New York, NY; 1968. One of the early textbooks, designed
for firstyear graduate students, by one of the pioneers in communications, an MIT
faculty member, later awarded the IEEE Medal of Honor, its most prestigious award.
 Thomas M. Cover and Joy A. Thomas, "Elements of Information Theory," John
Wiley & Sons, Inc., New York, NY; 1991. Aimed at university seniors and firstyear
graduate students. One of several excellent books of that era. Professor Cover,
at Stanford University, is one of the leaders in Information Theory.
Help Wanted
6.050J/2.110J students: be the first to suggest a resource, for example a useful Web
site or a good book or article, to add to the list above. If your suggestion is
accepted by the 6.050J/2.110J staff, you will get a $5 icecream gift certificate.
Send your suggestion by email during Spring 2006
to 6.050staff (at) mit.edu.
6.050J/2.110J home page 
Spring 2006 
Site map 
Search 
About this page 
Comments and inquiries
Click here for information on MIT Accessibility