Chapter 4 Vector Spaces 4.1 4.2 4.3 4.4 4.5 4.6 4.7 Elementary Linear Algebra R. Larsen et al. (6 Edition) Vectors in Rn Vector Spaces Subspaces of Vector Spaces Spanning Sets and Linear Independence Basis and Dimension Rank of a Matrix and Systems of Linear Equations Coordinates and Change of Basis 投影片設計編製者 淡江大學 電機系 翁慶昌 教授 n 4.1 Vectors in R An ordered n-tuple: a sequence of n real number ( x1 , x2 ,, xn ) n n-space: R the set of all ordered n-tuple Elementary Linear Algebra: Section 4.1, p.183 2/107 Ex: 1 n=1 R = 1-space = set of all real number n=2 R = 2-space = set of all ordered pair of real numbers ( x1 , x2 ) n=3 2 3 R = 3-space = set of all ordered triple of real numbers ( x1 , x2 , x3 ) n=4 4 R = 4-space = set of all ordered quadruple of real numbers ( x1 , x2 , x3 , x4 ) Elementary Linear Algebra: Section 4.1, p.183 3/107 Notes: n (1) An n-tuple ( x1 , x2 ,, xn ) can be viewed as a point in R with the xi’s as its coordinates. (2) An n-tuple ( x1 , x2 ,, xn ) can be viewed as a vector x ( x1 , x2 ,, xn ) in Rn with the xi’s as its components. Ex: x1 , x2 x1 , x2 a point Elementary Linear Algebra: Section 4.1, p.183 0,0 a vector 4/107 u u1 , u2 ,, un , v v1 , v2 ,, vn Equal: u v if and only if (two vectors in Rn) u1 v1 , u2 v2 , , un vn Vector addition (the sum of u and v): u v u1 v1, u2 v2 , , un vn Scalar multiplication (the scalar multiple of u by c): cu cu1 , cu2 ,, cun Notes: The sum of two vectors and the scalar multiple of a vector n in R are called the standard operations in Rn. Elementary Linear Algebra: Section 4.1, p.183 5/107 Negative: u (u1 ,u2 ,u3 ,...,un ) Difference: u v (u1 v1 , u2 v2 , u3 v3 ,...,un vn ) Zero vector: 0 (0, 0, ..., 0) Notes: (1) The zero vector 0 in Rn is called the additive identity in Rn. (2) The vector –v is called the additive inverse of v. Elementary Linear Algebra: Section 4.1, p.184 6/107 Thm 4.2: (Properties of vector addition and scalar multiplication) n Let u, v, and w be vectors in R , and let c and d be scalars. (1) (2) (3) (4) (5) (6) u+v is a vector in Rn u+v = v+u (u+v)+w = u+(v+w) u+0 = u u+(–u) = 0 cu is a vector in Rn (7) c(u+v) = cu+cv (8) (c+d)u = cu+du (9) c(du) = (cd)u (10) 1(u) = u Elementary Linear Algebra: Section 4.1, p.185 7/107 Ex 5: (Vector operations in R4) Let u=(2, – 1, 5, 0), v=(4, 3, 1, – 1), and w=(– 6, 2, 0, 3) be 4 vectors in R . Solve x for x in each of the following. (a) x = 2u – (v + 3w) (b) 3(x+w) = 2u – v+x Sol: (a) x 2u ( v 3w ) 2u v 3w (4, 2, 10, 0) (4, 3, 1, 1) (18, 6, 0, 9) (4 4 18, 2 3 6, 10 1 0, 0 1 9) (18, 11, 9, 8). Elementary Linear Algebra: Section 4.1, p.185 8/107 (b) 3(x w ) 2u v x 3x 3w 2u v x 3x x 2u v 3w 2x 2u v 3w x u 12 v 32 w 2,1,5,0 2, 23 , 21 , 12 9,3,0, 29 9, 211 , 92 ,4 Elementary Linear Algebra: Section 4.1, p.185 9/107 Thm 4.3: (Properties of additive identity and additive inverse) n Let v be a vector in R and c be a scalar. Then the following is true. (1) The additive identity is unique. That is, if u+v=v, then u = 0 (2) The additive inverse of v is unique. That is, if v+u=0, then u = –v (3) 0v=0 (4) c0=0 (5) If cv=0, then c=0 or v=0 (6) –(– v) = v Elementary Linear Algebra: Section 4.1, p.186 10/107 Linear combination: The vector x is called a linear combination of v1 , v 2 ,...,v n , if it can be expressed in the form x c1v1 c2 v 2 cn v n c1 , c2 , , cn : scalar Ex 6: Given x = (– 1, – 2, – 2), u = (0,1,4), v = (– 1,1,2), and 3 w = (3,1,2) in R , find a, b, and c such that x = au+bv+cw. Sol: b 3c 1 a b c 2 4a 2b 2c 2 a 1, b 2, c 1 Thus x u 2 v w Elementary Linear Algebra: Section 4.1, p.187 11/107 Notes: A vector u (u1 , u2 ,, un ) in R n can be viewed as: a 1×n row matrix (row vector): u [u1 , u2 ,, un ] or u1 u 2 a n×1 column matrix (column vector): u u n (The matrix operations of addition and scalar multiplication give the same results as the corresponding vector operations) Elementary Linear Algebra: Section 4.1, p.187 12/107 Vector addition Scalar multiplication u v (u1 , u2 , , un ) (v1 , v2 , , vn ) cu c(u1 , u2 ,, un ) (u1 v1 , u2 v2 , , un vn ) u v [u1 , u2 , , un ] [v1 , v2 , , vn ] [u1 v1 , u2 v2 , , un vn ] u1 v1 u1 v1 u v u v u v 2 2 2 2 u v u v n n n n Elementary Linear Algebra: Section 4.1, p.188 (cu1 , cu2 , , cun ) cu c[u1 , u2 ,, un ] [cu1 , cu2 ,, cun ] u1 cu1 u cu cu c 2 2 un cun 13/107 Keywords in Section 4.1: ordered n-tuple:有序的n項 n-space:n維空間 equal:相等 vector addition:向量加法 scalar multiplication:純量乘法 negative:負向量 difference:向量差 zero vector:零向量 additive identity:加法單位元素 additive inverse:加法反元素 14/107 4.2 Vector Spaces Vector spaces: Let V be a set on which two operations (vector addition and scalar multiplication) are defined. If the following axioms are satisfied for every u, v, and w in V and every scalar (real number) c and d, then V is called a vector space. Addition: (1) u+v is in V (2) u+v=v+u (3) u+(v+w)=(u+v)+w (4) V has a zero vector 0 such that for every u in V, u+0=u (5) For every u in V, there is a vector in V denoted by –u such that u+(–u)=0 Elementary Linear Algebra: Section 4.2, p.191 15/107 Scalar multiplication: (6) cu is in V. (7) c(u v) cu cv (8) (c d )u cu du (9) c(du) (cd )u (10) 1(u) u Elementary Linear Algebra: Section 4.2, p.191 16/107 Notes: (1) A vector space consists of four entities: a set of vectors, a set of scalars, and two operations V:nonempty set c:scalar (u, v) u v: vector addition (c, u) cu: scalar multiplication V , (2) V 0: , is called a vector space zero vector space Elementary Linear Algebra: Section 4.2, Addition 17/107 Examples of vector spaces: (1) n-tuple space: Rn (u1, u2 ,, un ) (v1, v2 ,, vn ) (u1 v1, u2 v2 ,, un vn ) vector addition scalar multiplication k (u1, u2 ,, un ) (ku1, ku2 ,, kun ) (2) Matrix space: V M mn (the set of all m×n matrices with real values) Ex: :(m = n = 2) u11 u12 v11 v12 u11 v11 u12 v12 u u v v u v u v 21 22 21 22 21 21 22 22 u11 u12 ku11 ku12 k u21 u22 ku 21 ku 22 Elementary Linear Algebra: Section 4.2, Addition vector addition scalar multiplication 18/107 (3) n-th degree polynomial space: V Pn (x) (the set of all real polynomials of degree n or less) p( x) q( x) (a0 b0 ) (a1 b1 ) x (an bn ) xn kp( x) ka0 ka1x kan xn (4) Function space: V c(, ) (the set of all real-valued continuous functions defined on the entire real line.) ( f g )(x) f ( x) g ( x) (kf )(x) kf ( x) Elementary Linear Algebra: Section 4.2, p.193 19/107 Thm 4.4: (Properties of scalar multiplication) Let v be any element of a vector space V, and let c be any scalar. Then the following properties are true. (1) 0 v 0 (2) c0 0 (3) If cv 0, then c 0 or v 0 (4) (1) v v Elementary Linear Algebra: Section 4.2, p.195 20/107 Notes: To show that a set is not a vector space, you need only find one axiom that is not satisfied. Ex 6: The set of all integer is not a vector space. Pf: 1V , 12 R ( 12 )(1) 12 V (it is not closed under scalar multiplication) noninteger scalar integer Ex 7: The set of all second-degree polynomials is not a vector space. Pf: Let p( x) x 2 and q( x) x 2 x 1 p( x) q( x) x 1V (it is not closed under vector addition) Elementary Linear Algebra: Section 4.2, p.195 21/107 Ex 8: V=R2=the set of all ordered pairs of real numbers vector addition: (u1 , u2 ) (v1 , v2 ) (u1 v1 , u2 v2 ) scalar multiplication: c(u1 , u2 ) (cu1 ,0) Verify V is not a vector space. Sol: 1(1, 1) (1, 0) (1, 1) the set (together with the two given operations) is not a vector space Elementary Linear Algebra: Section 4.2, p.196 22/107 Keywords in Section 4.2: vector space:向量空間 n-space:n維空間 matrix space:矩陣空間 polynomial space:多項式空間 function space:函數空間 23/107 4.3 Subspaces of Vector Spaces Subspace: (V ,,) : a vector space W : a nonempty subset W V (W ,,) :a vector space (under the operations of addition and scalar multiplication defined in V) W is a subspace of V Trivial subspace: Every vector space V has at least two subspaces. (1) Zero vector space {0} is a subspace of V. (2) V is a subspace of V. Elementary Linear Algebra: Section 4.3, p.198 24/107 Thm 4.5: (Test for a subspace) If W is a nonempty subset of a vector space V, then W is a subspace of V if and only if the following conditions hold. (1) If u and v are in W, then u+v is in W. (2) If u is in W and c is any scalar, then cu is in W. Elementary Linear Algebra: Section 4.3, p.199 25/107 Ex: Subspace of R2 (1) 0 0 0, 0 (2) Lines through t he origin (3) R2 Ex: Subspace of R3 (1) 0 0 0, 0, 0 (2) Lines through t he origin (3) Planes through t he origin (4) R3 Elementary Linear Algebra: Section 4.3, p.199 26/107 Ex 2: (A subspace of M2×2) Let W be the set of all 2×2 symmetric matrices. Show that W is a subspace of the vector space M2×2, with the standard operations of matrix addition and scalar multiplication. Sol: W M 22 M 22 : vector sapces Let A1, A2 W ( A1T A1, A2T A2 ) A1 W, A2 W ( A1 A2 )T A1T A2T A1 A2 ( A1 A2 W ) k R, A W (kA)T kAT kA (kAW ) W is a subspace of M 22 Elementary Linear Algebra: Section 4.3, p.200 27/107 Ex 3: (The set of singular matrices is not a subspace of M2×2) Let W be the set of singular matrices of order 2. Show that W is not a subspace of M2×2 with the standard operations. Sol: 1 0 0 0 A W , B W 0 0 0 1 1 0 A B W 0 1 W2 is not a subspace of M 22 Elementary Linear Algebra: Section 4.3, p.200 28/107 Ex 4: (The set of first-quadrant vectors is not a subspace of R2) Show that W {(x1 , x2 ) : x1 0 and x2 0} , with the standard operations, is not a subspace of R2. Sol: Let u (1, 1) W 1u 11, 1 1, 1W (not closed under scalar multiplication) W is not a subspace of R 2 Elementary Linear Algebra: Section 4.3, p.201 29/107 Ex 6: (Determining subspaces of R2) Which of the following two subsets is a subspace of R2? (a) The set of points on the line given by x+2y=0. (b) The set of points on the line given by x+2y=1. Sol: (a) W ( x, y) x 2 y 0 (2t , t ) t R Let v1 2t1 , t1 W v2 2t2 , t2 W v1 v2 2t1 t2 ,t1 t2 W (closed under addition) kv1 2kt1 , kt1 W (closed under scalar multiplication) W is a subspace of R 2 Elementary Linear Algebra: Section 4.3, p.202 30/107 (b) W x, y x 2 y 1 (Note: the zero vector is not on the line) Let v (1,0) W 1v 1,0W W is not a subspace of R 2 Elementary Linear Algebra: Section 4.3, p.203 31/107 Ex 8: (Determining subspaces of R3) Which of the following subsets is a subspace of R 3? (a) W ( x1 , x2 ,1) x1 , x2 R (b) W ( x1 , x1 x3 , x3 ) x1 , x3 R Sol: (a) Let v (0,0,1) W (1) v (0,0,1) W W is not a subspace of R 3 (b) Let v ( v1 , v1 v 3 , v 3 ) W , u (u1 , u1 u 3 , u 3 ) W v u v1 u1, v1 u1 v3 u3 , v3 u3 W kv kv1 , kv1 kv3 , kv3 W W is a subspace of R 3 Elementary Linear Algebra: Section 4.3, p.204 32/107 Thm 4.6: (The intersection of two subspaces is a subspace) If V and W are both subspaces of a vector space U , then the intersecti on of V and W (denoted by V U ) is also a subspace of U . Elementary Linear Algebra: Section 4.3, p.202 33/107 Keywords in Section 4.3: subspace:子空間 trivial subspace:顯然子空間 34/107 4.4 Spanning Sets and Linear Independence Linear combination: A vector v in a vector space V is called a linear combinatio n of the vectors u1,u 2 , ,u k in V if v can be written in the form v c1u1 c2u2 ck uk Elementary Linear Algebra: Section 4.4, p.207 c1,c2 , ,ck : scalars 35/107 Ex 2-3: (Finding a linear combination) v1 (1,2,3) v 2 (0,1,2) v 3 (1,0,1) Prove (a) w (1,1,1) is a linear combinatio n of v1 , v 2 , v 3 (b) w (1,2,2) is not a linear combinatio n of v1 , v 2 , v 3 Sol: (a) w c1v1 c2 v 2 c3 v3 1,1,1 c1 1,2,3 c2 0,1,2 c3 1,0,1 (c1 c3 , 2c1 c2 , 3c1 2c2 c3 ) c1 c3 2c1 c2 3c1 2c2 c3 1 1 1 Elementary Linear Algebra: Section 4.4, pp.208-209 36/107 1 0 1 1 Guass Jordan Elimination 2 1 0 1 3 2 1 1 1 0 1 1 0 1 2 1 0 0 0 0 c1 1 t , c2 1 2t , c3 t (this system has infinitely many solutions) t 1 w 2 v1 3v 2 v 3 Elementary Linear Algebra: Section 4.4, pp.208-209 37/107 (b) w c1v1 c2 v 2 c3 v 3 1 0 1 1 Guass Jordan Elimination 2 1 0 2 3 2 1 2 1 0 1 1 0 1 2 4 0 0 0 7 this system has no solution ( 0 7) w c1v1 c2 v 2 c3 v3 Elementary Linear Algebra: Section 4.4, pp.208-209 38/107 the span of a set: span (S) If S={v1, v2,…, vk} is a set of vectors in a vector space V, then the span of S is the set of all linear combinations of the vectors in S, span(S ) c1 v1 c2 v 2 ck v k ci R (the set of all linear combinatio ns of vectors in S ) a spanning set of a vector space: If every vector in a given vector space can be written as a linear combination of vectors in a given set S, then S is called a spanning set of the vector space. Elementary Linear Algebra: Section 4.4, p.209 39/107 Notes: span ( S ) V S spans (generates ) V V is spanned (generated ) by S S is a spanning set of V Notes: (1) span( ) 0 (2) S span( S ) (3) S1 , S2 V S1 S2 span(S1 ) span(S2 ) Elementary Linear Algebra: Section 4.4, p.209 40/107 Ex 5: (A spanning set for R3) Show that the set S (1,2,3), (0,1,2), (2,0,1) sapns R 3 Sol: We must determine whether an arbitrary vector u (u1 , u2 , u3 ) in R 3 can be as a linear combinatio n of v1 , v 2 , and v 3 . u R3 u c1v1 c2 v 2 c3 v3 c1 2c1 c2 2c3 u1 u2 3c1 2c2 c3 u3 The problem thus reduces to determinin g whether this system is consistent for all values of u1 , u2 , and u3 . Elementary Linear Algebra: Section 4.4, p.210 41/107 1 0 2 A2 1 3 2 0 0 1 Ax b has exactly one solution for every u. span(S ) R3 Elementary Linear Algebra: Section 4.4, p.210 42/107 Thm 4.7: (Span(S) is a subspace of V) If S={v1, v2,…, vk} is a set of vectors in a vector space V, then (a) span (S) is a subspace of V. (b) span (S) is the smallest subspace of V that contains S. (Every other subspace of V that contains S must contain span (S).) Elementary Linear Algebra: Section 4.4, p.211 43/107 Linear Independent (L.I.) and Linear Dependent (L.D.): S v1 , v 2 ,, v k : a set of vectors in a vector space V c1v1 c2 v 2 ck v k 0 (1) If the equation has only the trivial solution (c1 c2 ck 0) then S is called linearly independen t. (2) If the equation has a nontrivial solution (i.e., not all zeros), then S is called linearly dependent. Elementary Linear Algebra: Section 4.4, p.211 44/107 Notes: (1) is linearly independen t (2) 0 S S is linearly dependent. (3) v 0 vis linearly independent (4) S1 S2 S1 is linearly dependent S2 is linearly dependent S2 is linearly independent S1 is linearly independent Elementary Linear Algebra: Section 4.4, p.211 45/107 Ex 8: (Testing for linearly independent) Determine whether the following set of vectors in R3 is L.I. or L.D. S 1, 2, 3, 0,1, 2, 2, 0,1 v1 v2 v3 c1 2c3 0 Sol: 0 c1 v1 c2 v 2 c3 v 3 0 2c1 c2 3c1 2c2 c3 0 1 0 2 0 1 0 0 0 - Jordan Eliminatio n 2 1 0 0 Gauss 0 1 0 0 3 2 1 0 0 0 1 0 c1 c2 c3 0 only the trivial solution S is linearly independen t Elementary Linear Algebra: Section 4.4, p.213 46/107 Ex 9: (Testing for linearly independent) Determine whether the following set of vectors in P2 is L.I. or L.D. Sol: S = {1+x – 2x2 , 2+5x – x2 , x+x2} v1 v2 v3 c1v1+c2v2+c3v3 = 0 i.e. c1(1+x – 2x2) + c2(2+5x – x2) + c3(x+x2) = 0+0x+0x2 2 0 0 1 c1+2c2 =0 G. J. c1+5c2+c3 = 0 1 5 1 0 2 1 1 0 –2c1 – c2+c3 = 0 1 2 0 0 1 1 1 0 0 0 03 0 This system has infinitely many solutions. (i.e., This system has nontrivial solutions.) S is linearly dependent. Elementary Linear Algebra: Section 4.4, p.214 (Ex: c1=2 , c2= – 1 , c3=3) 47/107 Ex 10: (Testing for linearly independent) Determine whether the following set of vectors in 2×2 matrix space is L.I. or L.D. 2 1 3 0 1 0 S , , 0 1 2 1 2 0 Sol: v1 v2 v3 c1v1+c2v2+c3v3 = 0 2 1 3 0 1 0 0 0 c1 c2 c3 0 1 2 1 2 0 0 0 Elementary Linear Algebra: Section 4.4, p.215 48/107 2c1+3c2+ c3 = 0 c1 =0 2c2+2c3 = 0 c1 + c2 =0 2 3 1 0 1 0 0 0 0 2 2 0 1 1 0 0 1 0 - Jordan Eliminatio n Gauss 0 0 0 1 0 0 0 0 1 0 0 0 0 0 c1 = c2 = c3= 0 (This system has only the trivial solution.) S is linearly independent. Elementary Linear Algebra: Section 4.4, p.215 49/107 Thm 4.8: (A property of linearly dependent sets) A set S = {v1,v2,…,vk}, k2, is linearly independent if and only if at least one of the vectors vj in S can be written as a linear combination of the other vectors in S. Pf: () c1v1+c2v2+…+ckvk = 0 S is linearly dependent ci 0 for some i ci 1 ci 1 ck c1 v i v1 v i 1 v i 1 v k ci ci ci ci Elementary Linear Algebra: Section 4.4, p.217 50/107 () Let vi = d1v1+…+di-1vi-1+di+1vi+1+…+dkvk d1v1+…+di-1vi-1-vi+di+1vi+1+…+dkvk = 0 c1=d1, …,ci-1=di-1, ci=-1,ci+1=di+1,…, ck=dk (nontrivial solution) S is linearly dependent Corollary to Theorem 4.8: Two vectors u and v in a vector space V are linearly dependent if and only if one is a scalar multiple of the other. Elementary Linear Algebra: Section 4.4, p.217 51/107 Keywords in Section 4.4: linear combination:線性組合 spanning set:生成集合 trivial solution:顯然解 linear independent:線性獨立 linear dependent:線性相依 52/107 4.5 Basis and Dimension Basis: V:a vector space S ={v1, v2, …, vn}V Generating Sets Bases Linearly Independent Sets (a) S spans V (i.e., span(S) = V ) (b) S is linearly independent S is called a basis for V Notes: (1) Ø is a basis for {0} (2) the standard basis for R3: {i, j, k} i = (1, 0, 0), j = (0, 1, 0), k = (0, 0, 1) Elementary Linear Algebra: Section 4.5, p.221 53/107 n (3) the standard basis for R : {e1, e2, …, en} e1=(1,0,…,0), e2=(0,1,…,0), en=(0,0,…,1) Ex: R4 {(1,0,0,0), (0,1,0,0), (0,0,1,0), (0,0,0,1)} (4) the standard basis for mn matrix space: { Eij | 1im , 1jn } Ex: 2 2 matrix space: 1 0 0 1 0 0 0 0 , , , 0 0 0 0 1 0 0 1 (5) the standard basis for Pn(x): {1, x, x2, …, xn} Ex: P3(x) {1, x, x2, x3} Elementary Linear Algebra: Section 4.5, p.224 54/107 Thm 4.9: (Uniqueness of basis representation) If S v1, v 2 ,, v n is a basis for a vector space V, then every vector in V can be written in one and only one way as a linear combination of vectors in S. Pf: 1. span(S) = V S is a basis 2. S is linearly independent span(S) = V Let v = c1v1+c2v2+…+cnvn v = b1v1+b2v2+…+bnvn 0 = (c1–b1)v1+(c2 – b2)v2+…+(cn – bn)vn S is linearly independen t c1= b1 , c2= b2 ,…, cn= bn Elementary Linear Algebra: Section 4.5, p.224 (i.e., uniqueness) 55/107 Thm 4.10: (Bases and linear dependence) If S v1, v 2 ,, v n is a basis for a vector space V, then every set containing more than n vectors in V is linearly dependent. Pf: Let S1 = {u1, u2, …, um} , m > n span(S ) V u1 c11 v1 c21 v 2 cn1 v n uiV u 2 c12 v1 c22 v 2 cn 2 v n u m c1m v1 c2 m v 2 cnm v n Elementary Linear Algebra: Section 4.5, p.225 56/107 Let k1u1+k2u2+…+kmum= 0 d1v1+d2v2+…+dnvn= 0 (where di = ci1k1+ci2k2+…+cimkm) S is L.I. di=0 i i.e. c11k1 c12 k 2 c1m k m 0 c21k1 c22 k 2 c2 m k m 0 cn1k1 cn 2 k 2 cnm k m 0 Thm 1.1: If the homogeneous system has fewer equations than variables, then it must have infinitely many solution. m > n k1u1+k2u2+…+kmum = 0 has nontrivial solution S1 is linearly dependent Elementary Linear Algebra: Section 4.5, p.225 57/107 Thm 4.11: (Number of vectors in a basis) If a vector space V has one basis with n vectors, then every basis for V has n vectors. (All bases for a finite-dimensional vector space has the same number of vectors.) Pf: S ={v1, v2, …, vn} S'={u1, u2, …, um} two bases for a vector space S is a basis Thm .4.10 n m S ' is L.I. n m Thm . 4 . 10 S is L.I. n m S ' is a basis Elementary Linear Algebra: Section 4.5, p.226 58/107 Finite dimensional: A vector space V is called finite dimensional, if it has a basis consisting of a finite number of elements. Infinite dimensional: If a vector space V is not finite dimensional, then it is called infinite dimensional. Dimension: The dimension of a finite dimensional vector space V is defined to be the number of vectors in a basis for V. V: a vector space dim(V) = #(S) S: a basis for V (the number of vectors in S) Elementary Linear Algebra: Section 4.5, p.227 59/107 dim(V) = n Notes: (1) dim({0}) = 0 = #(Ø) Generating Sets #(S) > n (2) dim(V) = n , SV Bases Linearly Independent Sets #(S) = n #(S) < n S:a generating set #(S) n S:a L.I. set #(S) n S:a basis #(S) = n (3) dim(V) = n , W is a subspace of V dim(W) n Elementary Linear Algebra: Section 4.5, Addition 60/107 Ex: (1) Vector space Rn basis {e1 , e2 , , en} dim(Rn) = n (2) Vector space Mmn basis {Eij | 1im , 1jn} dim(Mmn)=mn (3) Vector space Pn(x) basis {1, x, x2, , xn} dim(Pn(x)) = n+1 (4) Vector space P(x) basis {1, x, x2, } dim(P(x)) = Elementary Linear Algebra: Section 4.5, Addition 61/107 Ex 9: (Finding the dimension of a subspace) (a) W={(d, c–d, c): c and d are real numbers} (b) W={(2b, b, 0): b is a real number} Sol: (Note: Find a set of L.I. vectors that spans the subspace) (a) (d, c– d, c) = c(0, 1, 1) + d(1, – 1, 0) S = {(0, 1, 1) , (1, – 1, 0)} (S is L.I. and S spans W) S is a basis for W dim(W) = #(S) = 2 (b) 2b, b,0 b2,1,0 S = {(2, 1, 0)} spans W and S is L.I. S is a basis for W dim(W) = #(S) = 1 Elementary Linear Algebra: Section 4.5, p.228 62/107 Ex 11: (Finding the dimension of a subspace) Let W be the subspace of all symmetric matrices in M22. What is the dimension of W? Sol: a b W a , b, c R b c a b 1 0 0 1 0 0 a b c b c 0 0 1 0 0 1 1 0 0 1 0 0 S , , spans W and S is L.I. 0 0 1 0 0 1 S is a basis for W dim(W) = #(S) = 3 Elementary Linear Algebra: Section 4.5, p.229 63/107 Thm 4.12: (Basis tests in an n-dimensional space) Let V be a vector space of dimension n. (1) If S v1 , v 2 ,, v n is a linearly independent set of vectors in V, then S is a basis for V. (2) If S v1 , v 2 ,, v n spans V, then S is a basis for V. dim(V) = n Generating Sets Bases Linearly Independent Sets #(S) > n #(S) = n Elementary Linear Algebra: Section 4.5, p.229 #(S) < n 64/107 Keywords in Section 4.5: basis:基底 dimension:維度 finite dimension:有限維度 infinite dimension:無限維度 65/107 Let A be an m×n matrix. Row space: The row space of A is the subspace of Rn spanned by the row vectors of A. RS( A) {1 A(1) 2 A( 2) ... m A( m) | 1 , 2 ,..., m R} Column space: The column space of A is the subspace of Rm spanned by the column vectors of A. CS A {1 A(1) 2 A(2) n A( n) 1, 2 ,n R} Null space: The null space of A is the set of all solutions of Ax=0 and it is a subspace of Rn. NS ( A) {x Rn | Ax 0} Elementary Linear Algebra: Section 4.6, p.233 66/107 4.6 Rank of a Matrix and Systems of Linear Equations row vectors: a11 a A 21 am1 a12 a22 am 2 Row vectors of A a1n A1 a2 n A2 amn Am [ a11 , a12 , , a1n ] A(1) [ a21 , a22 , , a2n ] A(2) [ am1 , am2 , , amn ] A( n ) column vectors: a11 a A 21 am1 a12 a22 am 2 a1n a2 n A1 A2 An amn Elementary Linear Algebra: Section 4.6, p.232 Column vectors of A a11 a12 a1n a a a 21 22 2 n am1 am 2 amn || || || (1) (2) (n) A A A 67/107 Thm 4.13: (Row-equivalent matrices have the same row space) If an mn matrix A is row equivalent to an mn matrix B, then the row space of A is equal to the row space of B. Notes: (1) The row space of a matrix is not changed by elementary row operations. RS(r(A)) = RS(A) r: elementary row operations (2) Elementary row operations can change the column space. Elementary Linear Algebra: Section 4.6, p.233 68/107 Thm 4.14: (Basis for the row space of a matrix) If a matrix A is row equivalent to a matrix B in row-echelon form, then the nonzero row vectors of B form a basis for the row space of A. Elementary Linear Algebra: Section 4.6, p.234 69/107 Ex 2: ( Finding a basis for a row space) 1 0 Find a basis of row space of A = 3 3 2 Sol: 1 0 3 A= 3 2 a1 3 1 1 0 1 6 4 2 0 4 a2 a3 3 0 1 1 2 a4 Elementary Linear Algebra: Section 4.6, p.234 3 1 1 0 1 6 4 2 0 4 1 0 .E. 0 G B= 0 0 b1 3 0 1 1 2 3 1 3 w 1 1 1 0 w 2 0 0 1 w 3 0 0 0 0 0 0 b2 b3 b4 70/107 a basis for RS(A) = {the nonzero row vectors of B} (Thm 4.14) = {w1, w2, w3} = {(1, 3, 1, 3), (0, 1, 1, 0), (0, 0, 0, 1)} Notes: (1) b3 2b1 b2 a3 2a1 a2 (2) {b1 , b2 , b4 } is L.I. {a1 , a2 , a4 } is L.I. Elementary Linear Algebra: Section 4.6, p.234 71/107 Ex 3: (Finding a basis for a subspace) Find a basis for the subspace of R3 spanned by v1 v3 v2 S {(1, 2, 5), (3, 0, 3), (5,1, 8)} Sol: 1 2 5 v 1 A = 3 0 3 v 2 5 1 8 v 3 G.E. 1 2 5 w 1 B 0 1 3 w 2 0 0 0 a basis for span({v1, v2, v3}) = a basis for RS(A) = {the nonzero row vectors of B} = {w1, w2} = {(1, –2, – 5) , (0, 1, 3)} Elementary Linear Algebra: Section 4.6, p.235 (Thm 4.14) 72/107 Ex 4: (Finding a basis for the column space of a matrix) Find a basis for the column space of the matrix A given in Ex 2. 1 0 A 3 3 2 3 1 1 0 1 6 4 2 0 4 3 0 1 1 2 Sol. 1: 1 3 AT 1 3 0 3 3 2 1 0 1 0 4 0 .E. G B 0 1 6 2 4 0 1 1 2 0 Elementary Linear Algebra: Section 4.6, p.236 0 3 3 2 w1 1 9 5 6 w 2 0 1 1 1 w3 0 0 0 0 73/107 CS(A)=RS(AT) a basis for CS(A) = a basis for RS(AT) = {the nonzero vectors of B} = {w1, w2, w3} 1 0 3, 3 2 0 0 1 0 9 , 1 (a basis for the column space of A) 5 1 6 1 Note: This basis is not a subset of {c1, c2, c3, c4}. Elementary Linear Algebra: Section 4.6, p.236 74/107 Sol. 2: 1 0 A 3 3 2 c1 Leading 1 3 1 0 4 0 c2 3 1 0 1 0 G.E . B 0 6 1 2 1 0 0 4 2 c3 c4 v1 1 3 1 3 1 1 0 0 0 1 0 0 0 0 0 0 v2 v3 v4 => {v1, v2, v4} is a basis for CS(B) {c1, c2, c4} is a basis for CS(A) Notes: (1) This basis is a subset of {c1, c2, c3, c4}. (2) v3 = –2v1+ v2, thus c3 = – 2c1+ c2 . Elementary Linear Algebra: Section 4.6, p.236 75/107 Thm 4.16: (Solutions of a homogeneous system) If A is an mn matrix, then the set of all solutions of the homogeneous system of linear equations Ax = 0 is a subspace of Rn called the nullspace of A. Pf: NS ( A) {x Rn | Ax 0} NS ( A) R n NS ( A) ( A0 0) Let x1, x 2 NS ( A) (i.e. Ax1 0, Ax 2 0) Then (1) A(x1 x 2) Ax1 Ax 2 0 0 0 Addition (2) A(cx1) c( Ax1) c(0) 0 Scalar multiplication Thus NS ( A) is a subspace of R n Notes: The nullspace of A is also called the solution space of the homogeneous system Ax = 0. Elementary Linear Algebra: Section 4.6, p.239 76/107 Ex 6: (Finding the solution space of a homogeneous system) Find the nullspace of the matrix A. 1 2 2 1 A 3 6 5 4 1 2 0 3 Sol: The nullspace of A is the solution space of Ax = 0. 1 2 2 1 1 2 0 3 .J .E A 3 6 5 4 G 0 0 1 1 1 2 0 3 0 0 0 0 x1 = –2s – 3t, x2 = s, x3 = –t, x4 = t x1 2s 3t 2 3 x s 1 0 2 s t sv 1 t v 2 x x3 t 0 1 x 0 1 4 t NS ( A) {sv1 tv 2 | s, t R} Elementary Linear Algebra: Section 4.6, p.240 77/107 Thm 4.15: (Row and column space have equal dimensions) If A is an mn matrix, then the row space and the column space of A have the same dimension. dim(RS(A)) = dim(CS(A)) Rank: The dimension of the row (or column) space of a matrix A is called the rank of A and is denoted by rank(A). rank(A) = dim(RS(A)) = dim(CS(A)) Elementary Linear Algebra: Section 4.6, pp.237-238 78/107 Nullity: The dimension of the nullspace of A is called the nullity of A. nullity(A) = dim(NS(A)) Note: rank(AT) = rank(A) Pf: rank(AT) = dim(RS(AT)) = dim(CS(A)) = rank(A) Elementary Linear Algebra: Section 4.6, p.238 79/107 Thm 4.17: (Dimension of the solution space) If A is an mn matrix of rank r, then the dimension of the solution space of Ax = 0 is n – r. That is n = rank(A) + nullity(A) Notes: (1) rank(A): The number of leading variables in the solution of Ax=0. (The number of nonzero rows in the row-echelon form of A) (2) nullity (A): The number of free variables in the solution of Ax = 0. Elementary Linear Algebra: Section 4.6, p.241 80/107 Notes: If A is an mn matrix and rank(A) = r, then Fundamental Space Dimension RS(A)=CS(AT) r CS(A)=RS(AT) r NS(A) n–r NS(AT) m–r Elementary Linear Algebra: Section 4.6, Addition 81/107 Ex 7: (Rank and nullity of a matrix) Let the column vectors of the matrix A be denoted by a1, a2, a3, a4, and a5. 1 0 1 0 2 0 1 3 1 3 A 2 1 1 1 3 0 3 9 0 12 a1 a2 a3 a4 a5 (a) Find the rank and nullity of A. (b) Find a subset of the column vectors of A that forms a basis for the column space of A . (c) If possible, write the third column of A as a linear combination of the first two columns. Elementary Linear Algebra: Section 4.6, p.242 82/107 Sol: Let B be the reduced row-echelon form of A. 0 1 0 2 1 0 1 3 1 3 A 2 1 1 1 3 0 3 9 0 12 a1 a2 a3 a4 a5 (a) rank(A) = 3 1 0 B 0 0 b1 0 2 0 1 1 3 0 4 0 0 1 1 0 0 0 0 b2 b3 b4 b5 (the number of nonzero rows in B) nuillity( A) n rank( A) 5 3 2 Elementary Linear Algebra: Section 4.6, p.242 83/107 (b) Leading 1 {b1 , b 2 , b 4 } is a basis for CS ( B) {a1 , a 2 , a 4 } is a basis for CS ( A) 1 0 1 0 1 1 a1 , a 2 , and a 4 , 2 1 1 0 3 0 (c) b3 2b1 3b2 a3 2a1 3a2 Elementary Linear Algebra: Section 4.6, p.243 84/107 Thm 4.18: (Solutions of a nonhomogeneous linear system) If xp is a particular solution of the nonhomogeneous system Ax = b, then every solution of this system can be written in the form x = xp + xh , wher xh is a solution of the corresponding homogeneous system Ax = 0. Pf: Let x be any solution of Ax = b. A(x x p ) Ax Ax p b b 0. (x x p ) is a solution of Ax = 0 Let xh x x p x x p xh Elementary Linear Algebra: Section 4.6, p.243 85/107 Ex 8: (Finding the solution set of a nonhomogeneous system) Find the set of all solution vectors of the system of linear equations. Sol: x1 3x1 x2 x1 2 x2 2 x3 5x3 x4 5x4 5 8 9 1 5 1 5 1 0 2 1 0 2 3 1 5 G 0 1 .J .E 0 8 1 3 7 1 2 0 0 0 5 9 0 0 0 s t Elementary Linear Algebra: Section 4.6, p.243 86/107 x1 2 s x s x 2 x3 s x4 0 s t 3t 0t t 5 2 1 5 1 3 7 7 s t 1 0 0 0 0 0 1 0 su1 tu2 x p 5 7 i.e. x p is a particular solution vector of Ax=b. 0 0 xh = su1 + tu2 is a solution of Ax = 0 Elementary Linear Algebra: Section 4.6, p.244 87/107 Thm 4.19: (Solution of a system of linear equations) The system of linear equations Ax = b is consistent if and only if b is in the column space of A. Pf: Let a11 a A 21 am1 a12 a22 am 2 a1n a2 n , amn x1 x x 2, xn and b1 b b 2 bm be the coefficient matrix, the column matrix of unknowns, and the right-hand side, respectively, of the system Ax = b. Elementary Linear Algebra: Section 4.6, pp.244-245 88/107 Then a11 a12 a1n x1 a11 x1 a12 x2 a x a x a x a a 22 2n 2 22 2 Ax 21 21 1 a a a m2 mn xn m1 am1 x1 am 2 x2 a11 a12 a1n a a a x1 21 x2 22 xn 2 n . am1 am 2 amn a1n xn a2 n xn amn xn Hence, Ax = b is consistent if and only if b is a linear combination of the columns of A. That is, the system is consistent if and only if b is in the subspace of Rm spanned by the columns of A. Elementary Linear Algebra: Section 4.6, p.245 89/107 Note: If rank([A|b])=rank(A) Then the system Ax=b is consistent. Ex 9: (Consistency of a system of linear equations) x1 x2 x1 3x1 2 x2 Sol: x3 x3 x3 1 3 1 1 1 1 1 1 0 . J .E . A 1 0 1 G 0 1 2 3 2 1 0 0 0 Elementary Linear Algebra: Section 4.6, p.245 90/107 1 3 1 1 1 1 1 0 . J .E. [ A b] 1 0 1 3 G 0 1 2 4 3 2 1 1 0 0 0 0 c1 c2 c3 b w1 w2 w3 v v 3w1 4w 2 b 3c1 4c 2 0c3 (b is in the column space of A) The system of linear equations is consistent. Check: rank( A) rank([ A b]) 2 Elementary Linear Algebra: Section 4.6, p.245 91/107 Summary of equivalent conditions for square matrices: If A is an n×n matrix, then the following conditions are equivalent. (1) A is invertible (2) Ax = b has a unique solution for any n×1 matrix b. (3) Ax = 0 has only the trivial solution (4) A is row-equivalent to In (5) | A | 0 (6) rank(A) = n (7) The n row vectors of A are linearly independent. (8) The n column vectors of A are linearly independent. Elementary Linear Algebra: Section 4.6, p.246 92/107 Keywords in Section 4.6: row space : 列空間 column space : 行空間 null space: 零空間 solution space : 解空間 rank: 秩 nullity : 核次數 93/107 4.7 Coordinates and Change of Basis Coordinate representation relative to a basis Let B = {v1, v2, …, vn} be an ordered basis for a vector space V and let x be a vector in V such that x c1v1 c2 v 2 cn v n . The scalars c1, c2, …, cn are called the coordinates of x relative to the basis B. The coordinate matrix (or coordinate vector) of x relative to B is the column matrix in Rn whose components are the coordinates of x. xB c1 c 2 cn Elementary Linear Algebra: Section 4.7, p.249 94/107 n Ex 1: (Coordinates and components in R ) Find the coordinate matrix of x = (–2, 1, 3) in R3 relative to the standard basis S = {(1, 0, 0), ( 0, 1, 0), (0, 0, 1)} Sol: x (2, 1, 3) 2(1, 0, 0) 1(0, 1, 0) 3(0, 0, 1), 2 [ x]S 1. 3 Elementary Linear Algebra: Section 4.7, p.250 95/107 Ex 3: (Finding a coordinate matrix relative to a nonstandard basis) Find the coordinate matrix of x=(1, 2, –1) in R3 relative to the (nonstandard) basis B ' = {u1, u2, u3}={(1, 0, 1), (0, – 1, 2), (2, 3, – 5)} Sol: x c u c u c u (1, 2, 1) c (1, 0, 1) c (0, 1, 2) c (2, 3, 5) 1 1 2 2 c1 c1 c2 2c2 3 3 1 2c3 3c3 5c3 2 1 1 0 1 G.J. E. 0 1 3 2 0 1 2 5 1 0 Elementary Linear Algebra: Section 4.7, p.251 2 3 2 c1 1 1 0 2 i.e. 0 1 3 c2 2 1 2 5 c3 1 1 0 0 5 5 1 0 8 [ x ] 8 2 0 1 2 1 B 96/107 Change of basis problem: You were given the coordinates of a vector relative to one basis B and were asked to find the coordinates relative to another basis B'. Ex: (Change of basis) Consider two bases for a vector space V B {u1 , u2}, B {u1 , u2} a c If [u1 ]B , [u2 ]B b d i.e., u1 au1 bu2 , u2 cu1 du2 Elementary Linear Algebra: Section 4.7, p.253 97/107 k1 Let v V , [ v]B k 2 v k1u1 k2u2 k1 (au1 bu 2 ) k2 (cu1 du 2 ) (k1a k2c)u1 (k1b k2 d )u 2 k1a k 2 c a c k1 [ v ]B k k b k d b d 2 2 1 u1 B u2 B v B Elementary Linear Algebra: Section 4.7, p.253 98/107 Transition matrix from B' to B: Let B {u1 , u 2 ,..., u n } and B {u1 , u2 ..., un } be two bases for a vector space V If [v]B is the coordinate matrix of v relative to B [v]B‘ is the coordinate matrix of v relative to B' then [ v]B P[ v]B u1 B , u2 B ,...,un B vB where P u1 B , u2 B , ...,un B is called the transition matrix from B' to B Elementary Linear Algebra: Section 4.7, p.255 99/107 Thm 4.20: (The inverse of a transition matrix) If P is the transition matrix from a basis B' to a basis B in Rn, then (1) P is invertible –1 (2) The transition matrix from B to B' is P Notes: B {u1 , u 2 , ..., u n }, B' {u1 , u2 , ..., un } vB [u1 ]B , [u2 ]B , ..., [un ]B vB P vB vB [u1 ]B , [u 2 ]B , ..., [u n ]B vB P 1 vB Elementary Linear Algebra: Section 4.7, p.253 100/107 Thm 4.21: (Transition matrix from B to B') Let B={v1, v2, … , vn} and B' ={u1, u2, … , un} be two bases n for R . Then the transition matrix P–1 from B to B' can be found by using Gauss-Jordan elimination on the n×2n matrix B B as follows. B B I n P 1 Elementary Linear Algebra: Section 4.7, p.255 101/107 Ex 5: (Finding a transition matrix) B={(–3, 2), (4,–2)} and B' ={(–1, 2), (2,–2)} are two bases for R2 (a) Find the transition matrix from B' to B. 1 (b) Let [ v]B ' , find [ v]B 2 (c) Find the transition matrix from B to B' . Elementary Linear Algebra: Section 4.7, p.257 102/107 Sol: 4 (a) 3 2 2 B (b) Check : 1 2 2 2 B' 3 2 P 2 1 G.J.E. 1 0 3 2 0 1 2 1 I P (the transition matrix from B' to B) 1 3 2 1 1 [v ]B [v ]B P [v ]B 2 2 1 2 0 1 [v ]B v (1)(1,2) (2)(2,2) (3,2) 2 1 [v ]B v (1)(3,2) (0)(4,2) (3,2) 0 Elementary Linear Algebra: Section 4.7, p.258 103/107 (c) 2 3 4 1 2 2 2 2 B' B 1 2 P 2 3 1 G.J.E. 1 0 1 2 0 1 2 3 -1 I P (the transition matrix from B to B') Check: 3 2 1 2 1 0 PP I2 2 1 2 3 0 1 1 Elementary Linear Algebra: Section 4.7, p.259 104/107 Ex 6: (Coordinate representation in P3(x)) (a) Find the coordinate matrix of p = 3x3-2x2+4 relative to the standard basis S = {1, x, x2, x3} in P3(x). (b) Find the coordinate matrix of p = 3x3-2x2+4 relative to the basis S = {1, 1+x, 1+ x2, 1+ x3} in P3(x). Sol: 4 0 (a) p (4)(1) (0)(x) (-2)(x 2 ) (3)(x 3 ) [ p]B 2 3 3 0 (b) p (3)(1) (0)(1 x) (-2)(1 x 2 ) (3)(1 x 3 ) [ p]B 2 3 Elementary Linear Algebra: Section 4.7, p.259 105/107 Ex: (Coordinate representation in M2x2) Find the coordinate matrix of x = 5 6 relative to the standard basis in M2x2. Sol: 7 8 B = 1 0, 0 1, 0 0, 0 0 0 0 1 0 0 1 0 0 5 6 1 0 0 1 0 0 0 0 x 5 6 7 8 7 8 0 0 0 0 1 0 0 1 5 6 x B 7 8 Elementary Linear Algebra: Section 5.7, Addition 106/107 Keywords in Section 4.7: coordinates of x relative to B:x相對於B的座標 coordinate matrix:座標矩陣 coordinate vector:座標向量 change of basis problem:基底變換問題 transition matrix from B' to B:從 B' 到 B的轉移矩陣 107/107