MTH601 - Advanced Linear Algebra

Semester: 
Fall

Instructor: Maha Amin

Contents: 

-        Basic properties of inner product spaces (dual space, norms, bilinear forms, unitary transformation)

-        Singular values of a matrix and rank determination

-        Gram-Schmidt orthogonalization (Orthogonal projections, QR-factorization)

-        Householder transformations

-        Least-squares problem and pseudo-inverses

-        Schur form for triangularization

-        Spectral theorem for normal matrices

-        Direct methods for linear equations

-        Positive Definite matrices

Students will be using MATLAB in Projects.

References:

[REF1 ]. “Numerical Linear Algebra”, Lloyd Trefethen and David Bau, SIAM,  1996.

[REF2].  “Linear Algebra”, by Stephen Friedberg, Arnold Insel, Lawrence Spence, 2nd  edition  1989.

[REF3] "Applied Numerical Linear Algebra" , J. Demmel et al.   

[REF4] “Advanced Matrix Theory for Scientists and Engineers”, Assem Shawky Deif .

Lec Topic Reference

0

Review: Basics of Linear Algebra; Vector Space, Subspace, Basis, Linear Transformations and matrices, Ranges, Null spaces, .. ,

Elementary matrix operations  and systems of linear equations

[REF2].  Chapter 1,2,3,6.1

[REF1] Lecture 1 :Matrix vector multiplication

Lecture 2 :Orthogonal vectors and matrices

1

Review: Inner product Space basic properties; norms, unitary transformations)

                 Vector and Matrix norms

Classical Gram-Schmidt (CGS) Orthogonalization

 

[REF1].  Lecture 3: Norms

[REF2] Sec 6.1 : Inner Products and norms

Sec. 6.2 : Gram-Schmidt Orthogonaliztion

2

Singular Value Decomposition (SVD)

Properties and Applications of SVD

 

 [REF2] Sec 6.7

 [REF1].  Lecture 4-5

3

Dual Space. Review : Adjoint operator

Unitary and orthogonal operators

Orthogonal Projection

Spectral Theorem for normal matrices

Bilinear forms and Quadratic forms

Pseudo inverse

 

 

 

[REF2] Sec 2.6:Dual Space ;

[REF2] Sec 6.5 : Unitary and

orthogonal operators

Sec 6.6 : Orthogonal Projection and the spectral theorem ;

 

Sec 6.7 : Pseudo inverse

Sec.6.8: Bilinear and quadratic forms

[REF1] Lecture 6: Projectors

 

4

 

QR factorization

Classical Gram-Schmidt (CGS) Orthogonalization (revisited)

Modified Gram-Schmidt (MGS)

 

 

 

[REF1] 

Lecture 7: QR-factorization

Lecture 8: Gram-Schmidt

 

 

5

Householder Triangularization

 

 

[REF1].  Lectures 10

6

Least squares problem and pseudoinverses

 

[REF1]  Lecture 11

7

Gaussian Elimination

Conditioning and Stability

 

 

[REF1].  Lectures 12,20,21,23

[REF2] Sec 6.9 : Conditioning and the Rayleigh Quotient

8

Eigenvalue problem:

EigenSpace, Diagonalization,           

 

[REF1].  Lectures 24,25

9

 

Schur Decomposition for Triangularization

Gershgorin Theorem

 

10

Positive Definite Matrices        

 

11

Discussions

 

12

Discussions

 

 

13

REVISION

 

        Assessment                        Week                 Grade

-Assessment 1; Project Assignments            5, 10                          20

-Assessment 2; Homework Assgs.               12                            10

-Assessment 3; Midterm Exam                      9                                10

-Assessment 4; Final Exam                           15                               60

Total                                                      100

 

Related materials