|
Department of Electrical Engineering and Computer Science Department of Mechanical Engineering |
| 6.050J/2.110J – Information, Entropy and Computation – Spring 2014 |
|
|
|
These notes, for the Spring 2014 offering, will be placed here as revised
during the semester.
Notes for earlier offerings are available also:
Spring 2003,
2004,
2005,
2006,
2007,
2008,
2010,
2013.
Note that these notes are still under development. We would appreciate
learning of any errors, and
would be pleased to receive suggestions for improvements. Please use the
comment form linked below.
Preface (version 1.8)
Chapter 1. Bits (version 1.8)
Chapter 2.
Codes (version 1.8)
Detail: ASCII
Detail: Integer Codes
Detail: The Genetic Code
Detail: IP Addresses
Detail: Morse Code
Transcribing RNA to Proteins
Chapter 3.
Compression (version 1.8)
Detail: LZW Compression
MP3 Demonstration
JPEG Demonstration
Chapter 4.
Errors (version 1.8)
Detail: Check Digits
Chapter 5.
Probability (version 1.8)
Detail: Life Insurance
Detail: Efficient Source Code
Chapter 6.
Communications (version 1.8)
Detail: Communication System Requirements
Chapter 7. Processes (version 1.8)
Chapter 8. Inference (version 1.8)
Chapter 9. Principle of Maximum Entropy (version 1.8)
Chapter 10. Physical Systems (version 1.8)
Chapter 11. Energy (version 1.8)
Chapter 12. Temperature (version 1.8)
Chapter 13. Quantum Information (version 1.8)
These notes Copyright © 2003, 2004, 2005, 2006, 2007, 2008, 2010, 2013, 2014 Massachusetts Institute of Technology