Linear Algebra 2021 Fall



Common Website Class Website NTU COOL
Go to today! ✈️    Go to homework! ✈️

Exercises

DueDate Topic YouTube PDF  PPT 
10/ 1 Exercise 1.6 (Oct. 1) PDF PPT
10/ 1 Exercise 1.7 (Oct. 1) PDF PPT
10/ 8 Exercise 1.7.2 (Oct. 8) PDF PPT
10/ 8 Exercise 1.4 (Oct. 8) PDF PPT
10/ 8 Exercise 2.1 (Oct. 8) PDF PPT
10/15 Exercise 2.1 (Oct. 15) PDF PPT
10/15 Exercise 2.3 (Oct. 15) PDF PPT
10/22 Exercise 2.4 (Oct. 22) PDF PPT
10/22 Exercise 4.1 (Oct. 22) PDF PPT
10/29 Exercise 4.1 (Oct. 29) PDF PPT
10/29 Exercise 4.2 (Oct. 29) PDF PPT
10/29 Exercise 4.3 (Oct. 29) PDF PPT
11/ 5 Exercise 4.3 (Nov. 5) PDF PPT
11/ 5 Chapter 3 (Nov. 5) PDF PPT
11/ 5 Review (Nov. 5) PDF PPT
11/19 Exercise 4.4 (Nov. 19) Video PDF PPT
11/19 Exercise 4.5 (Nov. 19) Video PDF PPT😢
11/26 Exercise 5.1 (Nov. 26) Video (former half) PDF PPT
11/26 Exercise 5.2 (Nov. 26) Video (latter half) PDF PPT
12/10 Exercise 5.2 (Dec. 10) Video 1 2 PDF
12/10 Exercise 5.3 (Dec. 10) Video 1 2 PDF
12/10 Chapter 5 (Dec. 10) Video 1 2 PDF
12/17 Exercise 7.3 (Dec. 17) Video PDF PPT
12/24 Exercise 7.4 (Dec. 24) Video (former half) PDF PPT
12/24 Exercise 7.5 (Dec. 24) Video (latter half) PDF PPT

😢  : Sorry for missing some handwriting.
🚧  : Under construction.



Course Materials



✓  review 🔍 overview ★  basic concept +  optional
def.  definition ex.  example pf.  proof thm.  theorem
✓  review
🔍 overview
★  basic concept
+  optional
def.  definition
ex.  example
pf.  proof
thm.  theorem
Logistics
----- Course Policy ----- YouTube PDF PPT
Chapter 1
DueDate Topic YouTube Textbook PDF PPT
1 linear
9/22 def. Linear System
9/22 ex. Are they Linear System?
9/22 ex. Derivative and Integral are Linear Systems
2 course introduction
yourself + Linear Algebra v.s. Compulsory Courses (optional)
yourself + Course Overview (optional)
3 vector
yourself ✓ Vector 1.1
yourself ✓ Properties of Vector 1.1
4 system of linear equations
9/24 ✓ System of Linear Equations 1.3
9/24 ★ System of Linear Equations = Linear System 1.3
5 matrix
9/24 ✓ Matrix 1.1
9/24 ✓ Properties of Matrix 1.1
9/24 def. Diagonal, Identity, Zero Matrix 1.2
9/24 def. Transpose 1.1
4 system of linear equations
9/24 ✓ Matrix-Vector Product 1.2
9/24 ★ Matrix-Vector Product = System of Linear Equations 1.2
9/24 ex. Matrix-Vector Product (Example) 1.2
9/24 ★ Properties of Matrix-Vector Product 1.2
9/24 ★ Standard Vector 1.2
6 solution
9/24 ✓ Solution of System of Linear Equations (high school) 1.3
9/24 🔍 Solution of System of Linear Equations (this course)
9/24 def. Linear Combination 1.2
9/24 ★ Linear Combination v.s. Solution 1.2
9/24 ex. Linear Combination v.s. Solution (Example 1) 1.2
9/24 ex. Linear Combination v.s. Solution (Example 2) 1.2
9/24 ex. Linear Combination v.s. Solution (Example 3) 1.2
9/29 def. Span 1.6
9/29 ex. Span (Example) 1.6
9/29 ★ Span v.s. Solution 1.6
9/29 thm. Span (Theorem of Useless Vector) 1.6
9/29 pf. Span (Theorem of Useless Vector) 1.6
10/ 1 def. Dependent / Independent 1.7
10/ 1 ex. Dependent / Independent (Example) 1.7
10/ 1 ★ Dependent / Independent (Intuitive Explaination) 1.7
10/ 1 ★ Dependent / Independent v.s. Solution 1.7
10/ 1 ex. Dependent / Independent v.s. Solution (Example) 1.7
10/ 1 def. Dependent / Independent (Another Definition) 1.7
10/ 1 pf. Dependent / Independent v.s. Solution (Proof) 1.7
10/ 1 def. Rank / Nullity
10/ 1 ex. Rank / Nullity (Example 1)
10/ 1 ex. Rank / Nullity (Example 2)
10/ 1 ex. Rank / Nullity (Example 3)
10/ 1 ★ Rank / Nullity v.s. Solution
10/ 1 + Story of Gaussian Elimination (optional) 1.4
10/ 1 ★ Strategy of Finding Solutions 1.4
10/ 1 ★ Elementary Row Operation 1.4
10/ 1 def. REF 1.4
10/ 1 def. RREF 1.4
10/ 1 def. Pivot Columns 1.4
10/ 1 thm. RREF is unique 1.4
10/ 1 ★ RREF v.s. unique solution 1.4
10/ 1 ★ RREF v.s. infinite solutions 1.4
10/ 1 ★ RREF v.s. no solution 1.4
10/ 1 ~~~~~~ HW1 Released! ~~~~~~ Go to...
10/ 6 ex. Find RREF (Example 1) 1.4
10/ 6 ex. Find RREF (Example 1) - Find solution 1.4
10/ 6 ex. Find RREF (Example 2) 1.4
10/ 6 ex. Find RREF (Example 3) 1.4
7 RREF
10/ 6 thm. Column Correspondence Theorem
10/ 6 ★ Column Correspondence Theorem - Reason 1
10/ 6 thm. Ax = 0 and Rx = 0 are equivalent
10/ 6 ★ Column Correspondence Theorem - Reason 2
10/ 6 ★ No Row Correspondence Theorem
10/ 8 ★ How to Check Independence 1.7
10/ 8 ★ Independence v.s. Column Correspondence Theorem 1.7
10/ 8 ★ Independence v.s. Matrix Size 1.7
10/ 8 def. Rank = no. of Pivot Columns = no. of non-zero rows in RREF 1.7
10/ 8 ★ Independence v.s. Matrix Size (again) 1.7
10/ 8 def. Rank v.s. Basic / Free Variables 1.7
10/ 8 🔍 Definitions of Rank and Nullity 1.7
10/ 8 ★ All properties about always consistent 1.7
10/ 8 thm. More than m vectors in Rm must be dependent 1.7
10/ 8 + Three is a powerful number :) (optional) 1.7
Chapter 2
DueDate Topic YouTube Textbook PDF PPT
1 matrix multiplication
10/ 8 ✓ Matrix Multiplication: inner product 2.1
10/ 8 ★ Matrix Multiplication: Combination of Columns 2.1
10/ 8 ★ Matrix Multiplication: Combination of Rows 2.1
10/ 8 ★ Matrix Multiplication: Summation of Matrices 2.1
10/ 8 ★ Block Multiplication 2.1
10/ 8 ex. Block Multiplication - Example 2.1
10/ 8 ★ Matrix Multiplication means multiple inputs 2.1
10/ 8 ★ Matrix Multiplication represents Composition 2.1
10/ 8 ex. Matrix Multiplication represents Composition - Example 2.1
10/13 ★ Matrix Multiplication - Properties 2.1
10/13 ★ Matrix Multiplication - Transpose 2.1
10/13 + Matrix Multiplication - Pratical Computation Issue (optional) 2.1
2 matrix inverse
10/13 def. Inverse of Matrix 2.4
10/13 ★ Inverse of Matrix - Properties 2.4
10/13 ★ Inverse of Matrix - Matrix Transpose 2.4
10/13 ★ Inverse of Matrix - Matrix Multiplication 2.4
10/15 + Inverse of Matrix - Solving System of Linear Equations (optional) 2.4
10/15 + Inverse of Matrix - Input-output Model 1 (optional) 2.4
10/15 + Inverse of Matrix - Input-output Model 2 (optional) 2.4
10/15 thm. Invertible Matrix Theorem 2.4
10/15 ✓ Review: one-to-one and onto 2.8
10/15 ★ One-to-one in Linear Algebra 2.8
10/15 ★ Onto in Linear Algebra 2.8
10/15 ★ Invertible = One-to-one and Onto 2.8
10/15 pf. Invertible Matrix Theorem - Proof (part 1) 2.4
10/15 pf. Invertible Matrix Theorem - Proof (part 2) 2.4
10/15 def. Elementary Matrix 2.3
10/15 ★ Inverse of Elementary Matrix 2.3
10/15 pf. Invertible Matrix Theorem - Proof (part 3) 2.4
10/15 + Find A-1 (Special Case: 2x2 matrices) (optional) 2.4
10/15 ★ Find A-1 2.4
10/15 ★ Find A-1C 2.4
10/15 ~~~~~~ HW2 Released! ~~~~~~ Go to...
Chapter 4
DueDate Topic YouTube Textbook PDF PPT
  subspace
10/20 def. Subspace 4.1
10/20 ex. Subspace - Example 4.1
10/20 ★ Subspace v.s. Span 4.1
10/20 def. Column Space and Row Space 4.3
10/20 def. Null Space 4.3
10/22 def. Basis 4.2
10/22 ex. Basis - Example 4.2
10/22 thm. More Theorems of Span 4.2
10/22 thm. Three Theorems of Basis 4.2
10/22 def. Dimension 4.2
10/22 ★ More than m vectors in Rm must be dependent (again and again) 4.2
10/22 pf. Proof of Basis Theorem 1 - Reduction Theorem 4.2
10/22 pf. Proof of Basis Theorem 2 - Extension Theorem 4.2
10/22 pf. Proof of Basis Theorem 3 - Dimension 4.2
10/22 thm. Dimension v.s. "Size" of Subspace 4.3
10/22 🔍 Three Theorems of Basis (review) 4.2
10/22 ★ Is it a basis? - Based on Definition 4.2
10/22 ★ Is it a basis? - Easier Way 4.2
10/22 ex. Is it a basis? - Example 4.2
10/22 ★ Basis and Dimension of Column Space (More definitions of Rank!) 4.3
10/22 ★ Basis and Dimension of Row Space (More definitions of Rank!) 4.3
10/22 thm. Rank A = Rank AT !!! 4.3
10/22 ★ Basis and Dimension of Null Space 4.3
10/22 thm. Dimension Theorem 4.3
10/27 def. Coordinate System 4.4
10/27 ex. Coordinate System - Example 4.4
10/27 + 莊子齊物論 (optional) 4.4
10/27 def. Cartesian Coordinate System 4.4
10/27 + 蓋亞思維 (optional) 4.4
10/27 ★ A coordinate system is a basis 4.4
10/27 ★ Other system to Cartesian 4.4
10/27 ★ Cartesian to Other system 4.4
10/27 ★ Change Coordinate 4.4
10/29 + Equation of ellipse (optional) 4.4
10/29 + Equation of hyperbola (optional) 4.4
10/29 + 全面啟動 (optional) 4.5
10/29 ex. Describing a function in another coordinate system 4.5
10/29 ★ Function in Different Coordinate Systems 4.5
10/29 ex. Function in Different Coordinate Systems - Example 4.5
10/29 ex. Function in Different Coordinate Systems - Example 4.5
Chapter 3
DueDate Topic YouTube Textbook PDF PPT
  determinant
10/29 + Determinant (high school) (optional) 3.1
10/29 def. Determinant - Cofactor Expansion 3.1
10/29 ex. Determinant of 2x2 and 3x3 matrices 3.1
10/29 ex. Determinant of 2x2 and 3x3 matrices 3.1
10/29 + Determinant of a special gigantic matrix (optional) 3.1
11/ 3 def. Three Basic Properties of Determinant
11/ 3 ★ Basic Property 1
11/ 3 ★ Basic Property 2
11/ 3 ★ Basic Property 3
11/ 3 + From Basic Properties to Cofactor Expansion (2x2 matrix) (optional)
11/ 3 + From Basic Properties to Cofactor Expansion (3x3 matrix) (optional)
11/ 3 + From Basic Properties to Cofactor Expansion (nxn matrix) (optional)
11/ 5 + Formula of A-1 (optional)
11/ 5 + Formula of A-1 - Example (optional)
11/ 5 + Formula of A-1 - Proof (optional)
11/ 5 + Cramer’s Rule (optional) 3.2
11/ 5 + Three Basic Properties of Determinant (review) (optional) 3.2
11/ 5 thm. A is invertible = det (A) is not zero 3.2
11/ 5 ex. example 3.2
11/ 5 thm. Properties of Determinant 3.2
11/ 5 pf. det(AB) = det(A)det(B) 3.2
11/ 5 pf. det(A) = det (AT) 3.2
11/ 5 ~~~~~~ HW3 Released! ~~~~~~ Go to...
Chapter 5
DueDate Topic YouTube Textbook PDF PPT
  eigenvalues and eigenvectors
11/24 + How to find a "good" coordinate system? (optional) 5.1
11/24 def. Eigenvalues and Eigenvectors 5.1
11/24 ex. Example 5.1
11/24 ★ Do the eigenvectors correspond to an eigenvalue from a subspace? 5.1
11/24 def. Eigenspace 5.1
11/24 ★ Check whether a scalar is an eigenvalue 5.1
11/24 ex. Example 5.1
11/24 ★ Looking for Eigenvalues 5.1
11/24 ex. Looking for Eigenvalues - Example 1 5.1
11/26 ex. Looking for Eigenvalues - Example 2 5.1
11/26 ex. Looking for Eigenvalues - Example 3 5.1
11/26 def. Characteristic Polynomial 5.2
11/26 ★ Matrix A and RREF of A have different eigenvalues 5.2
11/26 thm. Similar matrices have the same eigenvalues 5.2
11/26 thm. More Properties of Characteristic Polynomial 5.2
11/26 + PageRank: How does Google rank search results? (optional)
11/26 + PageRank: Introduction (optional)
11/26 + PageRank: Basic Idea (optional)
11/26 + PageRank: Formulation (optional)
11/26 + PageRank: Relation to Eigenvectors / Eigenvalues (optional)
11/26 + PageRank: Always having eigenvalue = 1 (optional)
11/26 + PageRank: When does dimension of eigenspace = 1 (optional)
11/26 + PageRank: How to make dimension of eigenspace = 1 (optional)
11/26 + PageRank: Power Method (optional)
11/26 ~~~~~~ HW4 Released! ~~~~~~ Go to...
12/ 1 def. Diagonalizable 5.3
12/ 1 ★ Not all matrices are diagonalizable 5.3
12/ 1 ★ How to diagonalize a matrix 5.3
12/ 1 thm. Eigenvectors corresponding to distinct Eigenvalues is independent 5.3
12/ 1 ★ Find independent eigenvectors 5.3
12/ 1 ex. Example 5.3
12/ 1 ★ Test for Diagonalizable Matrix 5.3
12/ 1 + Application of Diagonalization 1: 這就是人生! (optional) 5.3
12/ 1 + Application of Diagonalization 1: 你花了多少時間在念線性代數? (optional) 5.3
12/ 1 ex. Diagonalization of Linear Operator 5.3
12/ 1 ★ Application of Diagonalization 2: Find a good Coordinate System 5.3
Chapter 7
DueDate Topic YouTube Textbook PDF PPT
  orthogonality
12/ 8 def. Norm and Distance 7.1
12/ 8 def. Dot Product and Orthogonal 7.1
12/ 8 thm. Pythagorean Theorem 7.1
12/ 8 thm. Dot Product v.s. Geometry 7.1
12/ 8 thm. Triangle Inequality 7.1
12/10 def. Orthogonal Set 7.2
12/10 ★ Orthogonal Set v.s. Independent Set 7.2
12/10 def. Orthonormal Set 7.2
12/10 def. Orthogonal / Orthonormal Basis 7.2
12/10 thm. Orthogonal Decomposition Theory 7.2
12/10 ex. Example 7.2
12/10 thm. Gram-Schmidt Process 7.2
12/10 ex. Example 7.2
12/10 pf. Proof of Gram-Schmidt Process (1): Obtaining Orthogonal Set 7.2
12/10 pf. Proof of Gram-Schmidt Process (2): Obtaining Basis 7.2
12/10 def. Orthogonal Complement 7.3
12/10 ex. Example 7.3
12/10 thm. B be a basis of W, then B⟂ = W⟂ 7.3
12/10 ex. How to find W⟂ 7.3
12/10 thm. Orthogonal Complement v.s. Null Space 7.3
12/10 thm. u = w + z → w ∈ W, z ∈ W⟂ 7.3
12/15 def. Orthogonal Projection 7.4
12/15 thm. Closest Vector Property 7.4
12/15 def. Orthogonal Projection Matrix 7.3
12/15 ★ Orthogonal Projection on a line 7.3
12/15 thm. Orthogonal Projection Matrix 7.3
12/15 pf. Orthogonal Projection Matrix - Proof (part I) 7.3
12/15 pf. Orthogonal Projection Matrix - Proof (part II) 7.3
12/15 ★ Orthogonal Decomposition Theory v.s. Orthogonal Projection Matrix 7.3
12/17 ★ Applications of Orthogonal Projection 7.4
12/17 ★ Least Square Approximation - Problem Statement 7.4
12/17 ★ Least Square Approximation - Solving by Orthogonal Projection 7.4
12/17 ex. Least Square Approximation - Example 1 7.4
12/17 ex. Least Square Approximation - Example 2 7.4
12/17 ex. Least Square Approximation - Example 3 7.4
12/17 def. Orthogonal Matrix 7.5
12/17 def. Norm-preserving 7.5
12/17 ★ Orthogonal Matrix = Norm-preserving 7.5
12/17 thm. Properties of Orthogonal Matrix 7.5
12/17 pf. Properties of Orthogonal Matrix - Proof 7.5
12/17 thm. det Q, PQ, Q⁻¹, Qᵀ 7.5
12/17 + Orthogonal Operator (optional) 7.5
12/17 ~~~~~~ HW5 Released! ~~~~~~ Go to...
12/22 ★ symmetric matrices: eigenvalues are always real (2x2 matrices) 7.6
12/22 thm. symmetric matrices: eigenvalues are always real (general cases) 7.6
12/22 thm. symmetric matrices: eigenvectors for different eigenvalues are orthogonal 7.6
12/22 thm. symmetric matrices are diagonalizable 7.6
12/22 pf. symmetric matrices are diagonalizable (proof I) 7.6
12/22 pf. symmetric matrices are diagonalizable (proof II) 7.6
12/22 ex. symmetric matrices are diagonalizable (example) 7.6
12/22 ex. symmetric matrices are diagonalizable (example) 7.6
12/22 ★ How to diagonalize symmetric matrices 7.6
12/22 thm. Spectral Decomposition 7.6
12/22 ex. Spectral Decomposition (example) 7.6
12/24 + Singular Value Decomposition (SVD) (optional) 7.7
12/24 + SVD v.s. Rank (optional) 7.7
12/24 + SVD - Low Rank Approximation (optional) 7.7
12/24 + SVD - Application (optional) 7.7
12/24 + SVD - proof I (optional) 7.7
12/24 + SVD - proof II (optional) 7.7
12/24 + SVD - proof III (optional) 7.7
Chapter 6
DueDate Topic YouTube Textbook PDF PPT
  vector space
12/24 ★ 原來萬物都是 vector ! 6.1
12/24 def. Vector Space 6.1
12/24 ★ Revisit Subspace 6.1
12/24 ★ Revisit Linear Combination and Span 6.2
12/29 ★ Revisit Linear Transformation 6.2
12/29 ★ Isomorphism 6.2
12/29 ★ Revisit Basis 6.3
12/29 ★ Vector Representation of Object 6.4
12/29 ★ Matrix Representation of Linear Operator 6.4
12/29 ★ Revisit Eigenvalue and Eigenvector 6.4
12/31 def. Inner Product 6.5
12/31 ex. Example 6.5
12/31 ★ Revisit Orthogonal/Orthonormal Basis 6.5
12/31 ex. Example 6.5
1/14 ~~~~~~ HW6 Released! ~~~~~~ Go to...

Homework

# Date Topic TA Slides Video
10/ 1 Colab Tutorial 陳建成 Slides Video
HW110/ 1 Cycle Detection 林泓均 Slides Video
HW210/15 Hill Cipher 劉聿珉 Slides Video
HW311/ 5 Cosine Transform and Its Application 林冠廷 Slides Video
HW411/26 PageRank 翁茂齊 Slides Video (original)
HW512/17 Linear Regression 陳建成 Slides Video
HW6 1/14 SVD for Image Compression 王凡林 Slides Video
Note: 🚧  implies the material is not available now.