Module 1
- Introduction to high-dimensional statistics and optimization
- Background on statistical models, optimization, and iterative methods
Module 2
- Linear regression in high dimension, Lagrange relaxation and the Hahn-Banach theorem
- Concentration of measures and Fenchel duality
Module 3
- Stochastic approximation and Monotone operators
- Compressed sensing / Random projections / Splitting methods
The overall aim of the course is for students to become well acquainted with fundamental probabilistic concepts, theorems, and solution methods.
- After completing the course, students are expected to be able to:
- Formulate, explain, and compare high-dimensional statistical models and optimization methods;
- Derive and explain mathematical inequalities in high-dimensional probability theory;
- Apply the theory of monotone operators to derive convergence results for optimization methods;
- Apply theoretical concepts and methods in high-dimensional statistics and optimization to solve problems involving high-dimensional data.