Information Theory Research Group
Fall 2001

Participants

Faculty and Staff
Michael D. DeVore
Joseph A. O'Sullivan
Donald L. Snyder

Students
Jasenka Benac
Brian Fisher
Lichun (Andrew) Li
Lee Montagnino
Ryan Murphy
Naveen Singla
Brandon Westover

Purpse of Meetings

The purpose of the meetings is to explore a set of ideas within information theory as they relate to research projects in ESSRL and elsewhere on Washington University's campus. Participants will be called on to present ideas. These should be relatively polished research topics or papers from the literature. The definition of information theory will be modified as needed to accomodate each paper studied.

This semester we will cover many of the topics that were not covered in the Information Theory Research Group Meetings of Spring 2000.

Possible topics (not ordered) include:

1. Information geometry
--Amari, Kullback, Csiszar, O'Sullivan, etc.
2. Component Analysis: Independent (ICA), Principal, Eigen vs. Fisher
3. Performance in Multiple Hypothesis Testing:
GLRT vs. Alternatives
4. Regularization and Sieves
--Grenander, Miller, Snyder, Moulin, etc.
5. Information Hiding: Steganography, Watermarking, etc.
6. Information geometry in vision and imaging problems
7. Quantum Information Theory

Topics covered in 2000 include:

1. Information geometry
--Amari, Kullback, Csiszar, O'Sullivan, etc.
2. Graphical Models in Inference
--Frey, Baum, Welch, Jelinek, etc.
3. Component Analysis: Independent (ICA), Principal, Eigen vs. Fisher
4. Information Value Decomposition
5. Bayesian Networks
6. Turbo codes, low density parity check codes, etc.

Potentially useful links

Shannon's 1948 paper in pdf. Total 4645180 bytes.
Michael I. Jordan's home page. See his book "Learning in Graphical Models" --- (MIT Press, 1999).
Brendan Frey's home page. See his tutorial on probability propagation.
David Mackay's home page
Frank R. Kschischang's home page
"Codes and Decoding on General Graphs," the doctoral thesis of Niclas Wiberg
(also, the downloaded pdf version, 1.3MB).
Robert J. McEliece's home page
Yair Weiss's home page
IEEE Information Theory Society homepage; see the on-line link to all papers ever published in the IT Transactions
Viterbi's orignal paper with the Viterbi algorithm in pdf. Total 1.5 MB.

Independent Component Analysis(ICA), Principal (PCA), etc.

Aapo Hyvärinen Home Page; See his publications
Links from Hyvärinen Home Page:
Paris Smaragdis' ICA &BSS Page
Jean-Francois Cardoso's ICA Central
Allan Barros' ICA Page ICA research at HUT

Max-Plus, Max-Sum, etc., (for those interested)

Max-Plus Algebra working group at INRIA
Paper from INRIA group (S. Gaubert, et al.).
Max Plus Group at Delft
A Search on Max Plus Algebra

J. A. O'Sullivan Home Page

Edited June 18, 2004

Washington University in St. Louis School of Engineering Department of Electrical Engineering

Information Theory Research Group Fall 2001