Directory of Information Theory Resources

Home > Science > Math > Applications > Information Theory

Encyclopedia Britannica's says that "the chief concern of information theory is to discover mathematical laws governing systems designed to communicate or manipulate information. It sets up quantitative measures of information and of the capacity of various systems to transmit, store, and otherwise process information. Some of the problems treated are related to finding the best methods of using various available communication systems and the best methods for separating the wanted information, or signal, from the extraneous information, or noise". The study of information theory is also concerned with the definition of notion of information in a general sense and with a unified information theory that is supposed to contain all the statements of existing information theories.

Subcategories

• Academic Departments
• Complex Systems
• Conferences
• Journals
• Papers
• People
• Research Groups
• Societies

Resources in This Category

• A Discipline Independent Definition of Information

  http://www.ils.unc.edu/~losee/b5/book5.html
  An article about some sides of Information Theory written by Robert M. Losee. Also there is link to pdf-version of article.

• A Short Course in Information Theory

  http://www.inference.phy.cam.ac.uk/mackay/info-theory/course.html
  Eight lectures on information theory by David MacKay.

• Algorithmic Information Theory

  http://www.cs.auckland.ac.nz/CDMTCS/docs/ait.html
  Open problems and links to software.

• Basics of Information Theory

  http://www.cs.cmu.edu/~dst/Tutorials/Info-Theory/
  A brief introduction to information theory by David S. Touretzky of Carnegie Mellon University.

• Entropy on the World Wide Web

  http://www.math.uni-hamburg.de/home/gunesch/entropy.html
  A collection of links to on-line expository articles on entropy and theory of information, maintained by Roland Gunesch (University of Hamburg).

• Information Theory

  http://en.wikipedia.org/wiki/Information_theory
  Wikipedia article on this branch of applied mathematics and electrical engineering involving the quantification of information.

• Information Theory and Music

  http://www.music-cog.ohio-state.edu/Music829D/Notes/Infotheory.html
  An article on this subject. Definition of information theory, probability and Markov chains.

• Information Theory Resources

  http://www-lmmb.ncifcrf.gov/~toms/itresources.html
  Small collection of links about Information Theory and Claude Shannon.

• Introduction To Algorithmic Information Theory

  http://szabo.best.vwh.net/kolmogorov.html
  An introduction to the synthesis of computation and information theory by Nick Szabo.

• Linear Complexity: A Literature Survey

  http://www.ciphersbyritter.com/RES/LINCOMPL.HTM
  The linear complexity (LC) of a sequence is the size in bits of the shortest linear feedback shift register (LFSR) which can produce that sequence. The measure speaks to the difficulty of generating, and perhaps analyzing, a particular sequence.

• Organs of Computation

  http://www.edge.org/documents/archive/edge3.html
  A Talk With Steven Pinker.

• Remembering Claude Shannon

  http://www.corp.att.com/attlabs/reputation/timeline/16shannon.html
  Describes the development of information theory and Claude Shannon's contribution to the field.

• The Classic Definition of Information

  http://pespmc1.vub.ac.be/ASC/INFORMATION.html
  From the Web Dictionary of Cybernetics and Systems.

Related Categories

• Home > Computers > Computer Science > Theoretical
• Home > Science > Math > Applications > Complex Systems

 

Home > Science > Math > Applications > Information Theory

 

---

 

Thanks to DMOZ, which built a great web directory for nearly two decades and freely shared it with the web. About us