ORIE 6300 Mathematical Programming I

Instructor Information

instructor: Damek Davis
office hours: M 2:30PM-3:30PM, W 12PM-1PM, and by appointment
office: Rhodes Hall 218
email: dsd95 at cornell.edu

teaching assistant: Calvin Wylie
office: Rhodes Hall 290
office hours: TR 3-4PM
email: cjw278 at cornell.edu

course discussion site: http://www.piazza.com/cornell/fall2016/orie6300/home

Email Policy

Do not expect immediate responses to emailed questions. I will try to respond to all emailed questions within 48 hours. If you feel your question may be of general interest to the class, post it on piazza.

Meeting Times and Location

lecture time: Tuesday and Thursday 1:25PM–2:40PM
lecture location: Hollister Hall 306

recitation time: Wednesday 2:55PM–4:25PM
recitation location: Hollister Hall 320

Course Description

This course gives a rigorous treatment of the theory and computational techniques of linear programming and its extensions, including formulation, duality theory, algorithms, sensitivity analysis, network flow problems and algorithms, theory of polyhedral convex sets, systems of linear equations and inequalities, Farkas’ lemma, and exploiting special structure in the simplex method and computational implementation. Topics covered will include the ellipsoid method, interior-point methods, and computational complexity issues related to optimization problems.

Topics Covered (filled in as we go along)

  • Introduction to linear programming, duality (1 week).

  • Geometry of linear programs (1 week)

  • Normal Cones, Strong Duality, Value Functions (2 weeks)

  • Simplex method (3 weeks)

  • Operator-Splitting Algorithms (2 weeks)

  • Interior Point Methods (1 week)

  • Nonlinear Programming (3 weeks)

Prerequisites

Multivariable calculus and linear algebra.

Textbook

There is no required text for this course. Instead, we will write our own set of notes. At the beginning of each lecture I will ask for a volunteer who will scribe that day's lecture. The scribe is then required to email me, within six days, a clearly written set of notes, which I will post to the course website. The notes are to be written in LaTeX. Scribes can access a document of latex macros below.

I will occasionally draw on several books, for example

  • Dimitris Bertsimas and John N. Tsitsiklis, Introduction to Linear Optimization, Athena Scientific, 1997.

More books will likely be added to this list as the course progresses.

I will also occasionally draw on lecture notes from other courses, for example

Requirements and Grading

You will need to complete weekly problems sets, a take-home midterm, and an in-class final exam.

Your grade depends on all of the above components as follows: problem sets (40%), midterm (20%), final (30%), scribing 1-2 lectures (5%), lecture/recitation/piazza participation and filling out course evaluation form (5%).

Collaboration

Cornell’s Code of Academic Integrity can be found at cuinfo.cornell.edu/Academic/AIC.html.

You may work together on problem sets, but you must write up your own solutions AND acknowledge those with whom you discussed the problem. You must also cite any resources which helped you obtain your solutions. Exam problems should not be discussed with other students.

Notes

Scribing Materials

LaTeX macros for scribing and problem sets

Lectures

1. Weak Duality (August 23)

2. Taking a Dual (August 25)

3. Polyhedra and Their Corners (August 30)

4. Bounded Polyhedra are Polytopes; Separating Hyperplane Theorem (September 1)

5. Polytopes are Polyhedrons; Normal Cones of Convex Sets (September 6)

6. Normal Cones of Polyhedra; Strong Duality (September 8)

7. Strong Duality; Value Functions (September 13)

8. Value Functions; Fourier-Motzkin (September 15)

9. Optimality Conditions; Bases (September 20)

10. Some Simplex Method-Type Computations (September 22)

11. The Effect of A Pivot (September 25)

12. Simplex Method Example (September 29)

13. Simplex Method: Initialization and Complexity (October 4)

14. Pivoting Rules and Bland's Rule (October 6)

15. The Krasnoselskii-Mann Iteration (October 13)

16. The Method of Alternating Projections (October 18)

17. The Douglas-Rachford Splitting Method (October 25)

18. The Chambolle-Pock Algorithm (October 27)

19. The Simplex Method and Nonsmooth Equations (November 1)

20. Primal-Dual Interior Point Methods (November 3)

21. Nonlinear Optimization Optimality Conditions (November 8)

22. Projected Gradient method; Sufficient Optimality Conditions (November 10)

23. Nonsmoothness, Lower-semicontinuity, and Subgradients (November 15)

24. Nonsmooth Calculus (November 17)

25. Moreau Envelopes and Proximal Operators (November 22)

26. Smoothness of Moreau Envelopes (November 29)

Recitations

1. Linear Algebra Review (August 24)

2. Facility Location (August 31)

3. Feasibility and Unboundedness (September 7)

4. Pointed Polyhedra (September 14)

5. Transportation Problems (September 21)

6. Network Flow (September 28)

7. Lagrangian Relaxation (October 5)

8. Column Generation (October 12)

9. Dantzig-Wolfe (October 19)

10. To Be Uploaded (October 26)

11. Smooth Convex Optimization (November 2)

12. Twice Continuously Differentiable Functions (November 9)

Problem Sets

1. Problem set 1, due September 1. (.tex)

2. Problem set 2, due September 8. (.tex)

3. Problem set 3, due September 15. (.tex)

4. Problem set 4, due September 22. (.tex)

5. Problem set 5, due October 6. (.tex)

6. Problem set 6, due October 13. (.tex)

7. Problem set 7, due November 3. (.tex)

8. Problem set 8 (optional), due November 10. (.tex)

9. Problem set 9, due November 17. (.tex)

10. Problem set 10, due December 1. (.tex)

Lecture Notes from Previous Instructors