Math 317: Linear Algebra Homework 2 Solutions Fall 2015 1. Section 1.4, Problem 4(d) Give the general solution of the equation Ax = b in standard form. 2 −1 1 A = 2 1 3 , 1 1 2 1 b = −1 −1 We formulate the associated augmented matrix [A|b] and find a row echelon form: 1 1 2 −1 1 1 R1 →R3 2 1 −→ [A|b] = 2 1 3 −1 1 1 2 −1 2 −1 1 1 2 −1 1 2 →R3 0 −1 −1 1 3R−→ 0 −R2 →R2 0 −3 −3 3 0 2 −1 −2R1 +R2 →R2 3 −1 −→ −2R1 +R3 →R3 1 1 1 2 −1 1 1 −1 0 0 0 From here we see that x1 , x2 are the pivot variables and x3 is the free variable (since its column does not contain a pivot entry). Thus, we solve everything in terms of x3 . Converting the augmented matrix back to a system of equations yields: x1 + x2 + 2x3 = −1 x2 + x3 = −1 Solving this system of equations in terms of the free variable x3 yields: x2 + x3 = −1 =⇒ x2 = −1 − x3 and x1 + x2 + 2x3 = −1 =⇒ x1 + (−1 − x3 ) + 2x3 = −1 =⇒ x1 = −x3 . We write the solution in standard form as follows: x1 −x3 0 −1 x2 = −1 − x3 = −1 + x3 −1 x3 x3 0 1 2. Section 1.4, Problem 11(b) We wish to find all vectors x ∈ R4 which are orthogonal to a = (1, 1, 1, −1) and b = (1, 2, −1, 1). This problem is equivalent to finding those vectors x such that x · a = 0 and x · b = 0. Using the algebraic definition of the dot product, this yields the following system of equations: 1 Math 317: Linear Algebra Homework 2 Solutions Fall 2015 x · a = (x1 , x2 , x3 , x4 ) · (1, 1, 1, −1) = x1 + x2 + x3 − x4 = 0 x · b = (x1 , x2 , x3 , x4 ) · (1, 2, −1, 1) = x1 + 2x2 − x3 + x4 = 0, which we can now solve using our typical Gaussian elimination method: 1 1 1 −1 0 1 2 −1 1 0 1 1 1 −1 0 −→ 0 1 −2 2 0 1 0 3 −3 0 0 1 −2 2 0 −R1 +R2 →R2 −R2 +R1 →R1 −→ Now that our augmented matrix is in echelon form, we see that our free variables are x3 and x4 . Rewriting our augmented matrix as a system of linear equations yields: x1 + 3x3 − 3x4 = 0 x2 − 2x3 + 2x4 = 0 Solving the above equations in terms of x3 and x4 yields x1 = −3x3 + 3x4 and x2 = −2x3 + 2x4 . In standard form, the solution becomes x1 −3x3 + 3x4 −3x3 3x4 −3 3 x2 2x3 − 2x4 2x3 −2x4 2 −2 = = x3 x3 + 0 = x3 1 + x 4 0 x3 x4 x4 0 x4 0 1 So all of vectors that are orthogonal to both a and b are precisely those vectors that lie in span {(−3, 2, 1, 0), (3, −2, 0, 1)}. 3. Section 1.4, Problem 14 Let A be an m × n matrix, and let b ∈ Rm . (a) Show that if u and v ∈ Rn are both solutions of Ax = b, then u − v is a solution of Ax = 0. Proof : Suppose that A is an m × n matrix, and let b ∈ Rm . Since u and v ∈ Rn are both solutions of Ax = b, then Au = b and Av = b. Using a proposition proved in class (or Problem 13(a) in Section 1.4), we have that A(u − v) = Au − Av = b − b = 0. (b) Suppose u is a solution of Ax = 0 and p is a solution of Ax = b. Show 2 Math 317: Linear Algebra Homework 2 Solutions Fall 2015 that u + p is a solution of Ax = b. Proof : Suppose that u is a solution of Ax = 0 and p is a solution of Ax = b. Then Au = 0 and Ap = b. Using a proposition proved in class (or Problem 13(a) in Section 1.4), we have that A(u + p) = Au + Ap = 0 + b = b. 4. Suppose that [A|b] is the augmented matrix associated with a linear system. You know that performing row operations on [A|b] does not change the solution of the system. However, no mention of column operations was ever made because column operations can alter the solution. (a) Describe the effect on the solution of a linear system when the j th column of A is interchanged with the k th column of A. We illiustrate how column operations affect the solution to a system of linear equations by consider the 2 × 2 case. That is, consider the following system of 2 equations with 2 unknowns: a11 x1 + a12 x2 = b1 a21 x1 + a22 x2 = b2 . The resulting augmented system is given by a11 a12 b1 . a21 a22 b2 If we switch the first column with the second column, we obtain a12 a11 b1 a22 a21 b2 . which corresponds to the following system of equations: a12 x1 + a11 x2 = b1 a22 x1 + a21 x2 = b2 . We see that this column operation has the effect of interchanging the order of the unknowns–x1 and x2 have been permuted. (b) Describe the effect when column A∗j (i.e. the j th column of A) is replaced by cA∗j for some c ∈ R. 3 Math 317: Linear Algebra Homework 2 Solutions Fall 2015 Once again, consider the following system of 2 equations with 2 unknowns: a11 x1 + a12 x2 = b1 a21 x1 + a22 x2 = b2 . The resulting augmented system is given by a11 a12 b1 . a21 a22 b2 If we multiply the 2nd column by c 6= 0 , we obtain a11 ca12 b1 a21 ca22 b2 . which corresponds to the following system of equations: a11 x1 + ca12 x2 = b1 a21 x1 + ca22 x2 = b2 . The solution to the new system is the same as the solution to the old system except that the solution for the 2nd unknown of the new system is x̂2 = 1c x2 . (c) By experimenting with a 2 × 2 system, describe the effect when A∗j is replaced by A∗j + cA∗k where A∗k denotes the k th column of A. Once again, consider the following system of 2 equations with 2 unknowns: a11 x1 + a12 x2 = b1 a21 x1 + a22 x2 = b2 . The resulting augmented system is given by a11 a12 b1 . a21 a22 b2 If we multiply the 2nd column by c 6= 0 and add it to the first column , we obtain a11 + ca12 a12 b1 a21 + ca22 a22 b2 . 4 Math 317: Linear Algebra Homework 2 Solutions Fall 2015 which corresponds to the following system of equations: (ca12 + a11 )x1 + a12 x2 = b1 (ca22 + a21 )x1 + a22 x2 = b2 . The solution to the new system is the same as the solution for the old system except that the solution for the 1st unknown in the new system is x̂1 = x1 − cx2 . 5. Section 1.5, Problem 4(b) We seek to find constraint equations for b so that b is an element of V = span {(1, 0, 1, 1), (0, 1, 1, 2), (1, 1, 1, 0)}. For b to be in this set it must be of the form: 1 0 1 b1 0 1 1 b2 = c1 + c2 + c3 , 1 1 1 b3 1 2 0 b4 where c1 , c2 and c3 are unknown.This corresponds to the following system of equations: c1 + c3 c2 + c3 c1 + c2 + c3 c1 + 2c2 = = = = b1 b2 b3 b4 . We may solve this system of equations via Gaussian elimination. The associated augmented matrix is given by 1 b1 b2 −R1 +R3 →R3 0 −→ b3 −R1 +R4 →R4 0 b4 0 0 1 b1 −3R3 →R4 b2 1 1 −→ 0 −1 b3 − b1 − b2 0 −3 b4 − b1 − 2b2 1 0 1 1 1 0 0 0 0 1 1 2 1 1 1 0 0 1 b1 +R4 →R4 1 1 b2 −2R2−→ 1 0 b3 − b 1 −R2 +R3 →R3 2 −1 b4 − b1 1 0 1 b1 0 1 0 b2 0 0 −1 b4 − b1 − 2b2 0 0 0 b2 − 3b3 − 4b1 + b4 . 5 Math 317: Linear Algebra Homework 2 Solutions Fall 2015 For the above system to be consistent, we need b2 − 3b3 − 4b1 + b4 = 0. This is precisely our constraint equation. 6. Section 1.5, Problem 7(a) If possible, we wish to find a matrix A such that • One of the rows of A is (1, 0, 1). • x = (1, 0, 1) and y = (2, 1, 1) are solutions to Ax = b where b ∈ R2 . Since b ∈ R2 , we know that we have two equations in our system with three unknowns (since the solution x has three components). Thus the associated matrix equation has the form: x1 1 0 1 b x2 = 1 ? ? ? b2 x3 From here, we know that one of the equations is given by x1 + x3 = b1 . Now, if x = (1, 0, 1) is a solution to this system of equations, then 1 + 1 = b1 . If y = (2, 1, 1) is a solution to this system of equations, then 2 + 1 = b1 . This forces b1 to take on two different values for the same system of equations. Thus, it is not possible to construct such an A. 7. Section 1.5, Problem 13 Suppose A is an m × n matrix with rank m and v1 , v2 , . . . , vk ∈ Rn are vectors such that Span(v1 , v2 , . . . , vk ) = Rn . Prove that Span(Av1 , Av2 , . . . , Avk ) = Rm . Proof : To show that two sets are equal, say A and B, we must show that A ⊂ B and B ⊂ A. Let us begin by showing that Span(Av1 , Av2 , . . . , Avk ) ⊂ Rm . Suppose that b ∈ Span(Av1 , Av2 , . . . , Avk ). We want to show that b ∈ Rm . Since b ∈ Span(Av1 , Av2 , . . . , Avk ), we know that b = c1 (Av1 ) + c2 (Av2 ) + . . . ck (Avk ), for some c1 , c2 , . . . , ck ∈ R. If we think of b1 = Av1 as a matrix equation which represents a system of linear equations, then the fact that A is an m×n matrix tells us that the system of equations has m equations. This means that the system of equations has m right-hand sides. This is equivalent to saying that b has m components which of course is the same thing as saying that Av1 has m components. The argument is similar for Avi , i = 1, 2, . . . k, and so b must also contain m elements as it is just the addition of vectors, all with m components. Thus b ∈ Rm . The more challenging portion of this problem is showing that Rm ⊂ Span(Av1 , Av2 , . . . , Avk ). We proceed 6 Math 317: Linear Algebra Homework 2 Solutions Fall 2015 as follows. Let b ∈ Rm . Since rank(A) = m, we know that the reduced row echelon of A has no zero rows (since A is an m × n matrix). Thus for any b ∈ Rm , we can always find an x ∈ Rn such that Ax = b. That is, Ax = b is consistent for every b ∈ Rm . Now since x ∈ Rn and Rn = span(v1 , . . . , vk ), we know that x ∈ span(v1 , . . . , vk ) and hence x = c1 v 1 + c2 v 2 . . . + ck v k , for c1 , c2 , . . . , ck ∈ Rn . Thus we have that b = Ax = A (c1 v1 + c2 v2 . . . + ck vk ) = c1 Av1 + c2 Av2 + . . . ck Avk , where we have used the two properties in Problem 13, 1.4, A(x + y) = Ax+Ay and A(cx) = cAx. Thus, b ∈ Span(Av1 , Av2 , . . . , Avk ). Therefore, Span(Av1 , Av2 , . . . , Avk ) = Rm . 8. Section 1.5, Problem 15 (a) Suppose that A is an m×n matrix with column vectors a1 , . . . , an ∈ Rm such that a1 + . . . an = 0. We want to prove that rank(A) < n. Proof: We want to show that rank(A) < n. Following the hint, we look at solutions to Ax = 0. Recall that if Ax = 0 has infinitely many solutions, then rank(A) < n. Since Ax = 0 either has one solution (the trivial solution x = 0) or infinitely many solutions, it suffices to find just one nontrivial solution to Ax = 0. (You should try and prove that a system Ax = 0 cannot have exactly two solutions. That would make a great test question!) To try and find a solution, we rewrite the system of equations Ax = 0 as Ax = 0 =⇒ x1 a1 + x2 a2 + . . . xn an = 0, where ai is the ith column of A. Recall that this representation comes from regarding the right hand side (0 in this case) as an element of the span of the columns of A. For an explicit example of how this representation is used, look at Problem 5 on Worksheet 1. Using this representation, we see that a solution to Ax = 0 is precisely x = (1, 1, 1, . . . 1), since this will force a1 + . . . an = 0 which is true by assumption. Thus, Ax = 0 has a nontrivial solution which immediately implies that Ax = 0 has infinitely many solutions. Thus, rank(A) < n. (b) Suppose that A is an m×n matrix with column vectors a1 , . . . , an ∈ Rm 7 Math 317: Linear Algebra Homework 2 Solutions Fall 2015 such that c1 a1 + . . . cn an = 0 where c1 6= 0. We want to prove that rank(A) < n. Proof: The proof here works the exact same way as (a) except that at this point: Ax = 0 =⇒ x1 a1 + x2 a2 + . . . xn an = 0, we pick x1 = c1 , x2 = c2 , . . . xn = cn , so that c1 a1 + . . . cn an = 0. Thus, Ax = 0 has a nontrivial solution (since ci 6= 0) which immediately implies that Ax = 0 has infinitely many solutions. Thus, rank(A) < n. 8