Information Theory Research Group
Information Theory Research Group
Fall 2001
STILL BEING FORMED
|
Participants
Faculty and Staff
Michael D. DeVore
Joseph A. O'Sullivan
Donald L. Snyder
|
Students
Jasenka Benac
Brian Fisher
Lichun (Andrew) Li
Lee Montagnino
Ryan Murphy
Naveen Singla
Brandon Westover
|
Purpse of Meetings
The purpose of the meetings is to explore a set of
ideas within information theory as they relate to research
projects in ESSRL and elsewhere on Washington University's campus.
Participants will be called on to
present ideas. These should be relatively polished research
topics or papers from the literature. The definition of
information theory will be modified as needed to accomodate
each paper studied.
This semester we will cover many of the topics that were not
covered in the
Information Theory Research Group Meetings of Spring 2000.
Possible topics (not ordered) include:
1. Information geometry
--Amari, Kullback, Csiszar, O'Sullivan, etc.
2. Component Analysis: Independent (ICA), Principal,
Eigen vs. Fisher
3. Performance in Multiple Hypothesis Testing:
GLRT vs. Alternatives
4. Regularization and Sieves
--Grenander, Miller, Snyder, Moulin, etc.
5. Information Hiding: Steganography, Watermarking, etc.
6. Information geometry in vision and imaging problems
7. Quantum Information Theory
Topics covered in 2000 include:
1. Information geometry
--Amari, Kullback, Csiszar, O'Sullivan, etc.
2. Graphical Models in Inference
--Frey, Baum, Welch, Jelinek, etc.
3. Component Analysis: Independent (ICA), Principal,
Eigen vs. Fisher
4. Information Value Decomposition
5. Bayesian Networks
6. Turbo codes, low density parity check codes, etc.
Potentially useful links
Shannon's 1948 paper in pdf. Total 4645180
bytes.
Michael I. Jordan's home
page. See his book "Learning in Graphical Models" --- (MIT Press, 1999).
Brendan Frey's home
page. See his tutorial on
probability propagation.
David Mackay's home
page
Frank R. Kschischang's
home page
"Codes and Decoding on General Graphs," the doctoral thesis of Niclas Wiberg
(also, the downloaded pdf version, 1.3MB).
Robert
J. McEliece's home page
Yair Weiss's home page
IEEE Information Theory Society homepage; see
the on-line link to all papers ever published in the IT Transactions
Viterbi's orignal paper with the
Viterbi algorithm in pdf. Total 1.5 MB.
Independent Component Analysis(ICA), Principal (PCA), etc.
Aapo Hyvärinen Home Page; See his
publications
Links from Hyvärinen Home Page:
Paris Smaragdis' ICA
&BSS Page
Jean-Francois Cardoso's ICA Central
Allan Barros' ICA
Page
ICA research at HUT
Max-Plus, Max-Sum, etc., (for those interested)
Max-Plus
Algebra working group at INRIA
Paper from INRIA group (S. Gaubert, et
al.).
Max
Plus Group at Delft
A Search on Max Plus Algebra
|