THE EIGENVALUE PROBLEM

advertisement
BY
YAN RU LIN
SCOTT HENDERSON
NIRUPAMA GOPALASWAMI
GROUP 4
11.1 EIGENVALUES &
EIGENVECTORS
Definition
๏‚— An eigenvector of a n x n matrix A is a nonzero vector
x such that ๐‘จ๐’™ = λ๐’™ for some scalar λ.
๏‚— A scalar λ is called an eigenvalue of A if there is a
nontrivial solution x of ๐‘จ๐’™ = λ๐’™; such an x is called an
eigenvector corresponding to λ.
D.C. Lay, "Eigenvectors and Eigenvalues," in Linear Algebra and Its Applications, 3rd ed. Boston, MA: Pearson, 2006, ch. 5, pp. 301-372
Formulation
๏‚— ๐‘จ๐’™ = λ๐’™
๏‚— This is also equivalent to (๐‘จ − λ๐‘ฐ)๐’™ = ๐ŸŽ
๏‚— Now it can be solved easily using a determinant
Essentially, for some value of λ given a transformation matrix A, there
may exist a vector x such that the equation is satisfied. If λ and this
particular vector x do exist, then we call λ the eigenvalue and the x the
corresponding eigenvector.
Example
1. ๐ด๐‘ ๐‘ ๐‘ข๐‘š๐‘’
5 −1
=๐‘จ
3 10
5 −1
๐’™ = λ๐’™
3 10
5 −1
3.
๐’™ − λ๐‘ฐ๐’™ = ๐ŸŽ
3 10
5−λ
−1
4.
๐’™=๐ŸŽ
3
10 − λ
5. Solve now using a determinant
2.
Importance
๏‚— Eigenvalues and eigenvectors find numerous
applications in these areas:
๏‚— Differential Equations
๏‚— Dynamical systems
๏‚— Engineering design
๏‚— Chemistry and physics
๏‚— Schrödinger equation (quantum mechanics)
๏‚— Vibration analysis
BRAINBITE
A. λ=2 B. λ=0
C. λ=-3 D. λ=1
Remember that…
๐‘จ๐’™ = λ๐’™
x is given along with A, so λ is solved easily
http://www.maths.usyd.edu.au/u/UG/JM/MATH1014/Quizzes/quiz10.html
Answer: C
11.2 EIGENVALUES SOLUTION
PROCEDURE AND
APPLICATIONS
11.2 Eigenvalues Solution Procedure
and Applications
๏‚— Ax = ๏ฌx ๏ƒ  (A-๏ฌI)x = 0
๏‚— x=0 is a trivial solution
๏‚— Non-trivial solutions exist if and only if:
det( A ๏€ญ ๏ฌI) ๏€ฝ
a11 ๏€ญ ๏ฌ
a21
๏
an1
a12
๏Œ
a22 ๏€ญ ๏ฌ ๏Œ
๏
an 2
a1n
a2 n
๏
๏
๏Œ ann ๏€ญ ๏ฌ
๏€ฝ0
๏‚— Resulting algebraic equation is called the characteristic
๏‚—
๏‚—
๏‚—
๏‚—
equation.
Characteristic polynomial- nth-order polynomial in ๏ฌ
Roots are the eigenvalues {๏ฌ1, ๏ฌ2, …, ๏ฌn}
Solution space is called eigenspace corresponding to {๏ฌ1,
๏ฌ2, …, ๏ฌn}
The solutions obtained are called eigenvectors
Eigenvalue Example
๏‚— Characteristic matrix
๏ƒฉ1 2 ๏ƒน
๏ƒฉ1 0๏ƒน ๏ƒฉ1 ๏€ญ ๏ฌ
A ๏€ญ ๏ฌI ๏€ฝ ๏ƒช
๏€ญ ๏ฌ๏ƒช
๏€ฝ๏ƒช
๏ƒบ
๏ƒบ
๏ƒซ3 ๏€ญ 4๏ƒป
๏ƒซ0 1๏ƒป ๏ƒซ 3
2 ๏ƒน
๏€ญ 4 ๏€ญ ๏ฌ ๏ƒบ๏ƒป
๏‚— Characteristic equation
A ๏€ญ ๏ฌI ๏€ฝ (1 ๏€ญ ๏ฌ )(๏€ญ4 ๏€ญ ๏ฌ ) ๏€ญ (2)(3) ๏€ฝ ๏ฌ2 ๏€ซ 3๏ฌ ๏€ญ 10 ๏€ฝ 0
๏‚— Eigenvalues: ๏ฌ1 = -5, ๏ฌ2 = 2
11.2 Subsection(1) -Quick Tips
๏‚— An n x n matrix A means that
are n values to x, and there
will be n eigenvectors and
eigenvalues even if some are
duplicated
๏‚— The eigenvalues of a triangular
matrix are the entries on its
main diagonal
๏‚— Consider that since λ is scalar,
A must act on eigenvectors
only to “stretch” x and not to
change its direction (see figure)
Unknown. (2011, Oct
27). Eigenvalues and
eigenvectors [Online].
Available: http://en.wikipedia.o
rg/wiki/Eigenvalues_and_eigen
vectors
Example
๏‚— Click here to view a demo on eigenvalues and
eigenvectors
๏‚— http://web.mit.edu/18.06/www/Demos/eigen-applet-
all/eigen_sound_all.html
11.2 Subsection(2)-Determining Eigenvectors
๏‚— First determine eigenvalues: {๏ฌ1, ๏ฌ2, …, ๏ฌn}
๏‚— Then determine eigenvector corresponding to each
eigenvalue:
( A ๏€ญ ๏ฌI)x ๏€ฝ 0 ๏ƒž (A ๏€ญ ๏ฌk I)x k ๏€ฝ 0
๏‚— Eigenvectors determined up to scalar multiple
๏‚— Distinct eigenvalues
๏‚— Produce linearly independent eigenvectors
๏‚— Repeated eigenvalues
๏‚— Produce linearly dependent eigenvectors
๏‚— If n roots are equal then the eigenvalues are said
to of multiplicity n.
Eigenvector Example
๏‚— Eigenvalues
๏ƒฉ1 2 ๏ƒน ๏ฌ1 ๏€ฝ ๏€ญ5
A๏€ฝ๏ƒช
๏ƒบ ๏ฌ ๏€ฝ2
3
๏€ญ
4
๏ƒซ
๏ƒป
2
๏‚— Determine eigenvectors: Ax = ๏ฌx
x1 ๏€ซ 2 x2 ๏€ฝ ๏ฌx1
3x1 ๏€ญ 4 x2 ๏€ฝ ๏ฌx2
(1 ๏€ญ ๏ฌ ) x1 ๏€ซ 2 x2 ๏€ฝ 0
๏ƒž
3x1 ๏€ญ (4 ๏€ซ ๏ฌ ) x2 ๏€ฝ 0
๏‚— Eigenvector for ๏ฌ1 = -5
๏‚— Eigenvector for ๏ฌ1 = 2
6 x1 ๏€ซ 2 x2 ๏€ฝ 0
3x1 ๏€ซ x2 ๏€ฝ 0
๏ƒฉ1๏ƒน
x1 ๏€ฝ ๏ƒช ๏ƒบ
๏ƒซ๏€ญ 3๏ƒป
๏€ญ x1 ๏€ซ 2 x2 ๏€ฝ 0
3x1 ๏€ญ 6 x2 ๏€ฝ 0
๏ƒฉ 2๏ƒน
x2 ๏€ฝ ๏ƒช ๏ƒบ
๏ƒซ1 ๏ƒป
BRAINBITE
http://www.maths.usyd.edu.au/u/UG/JM/MATH1014/Quizzes/quiz12.html
Answer : c
11.2.2 APPLICATIONS TO ELEMENTARY
SINGULARITIES IN THE PHASE PLANE
๏‚— Consider a linear system of ODEs given by
๏‚— If the eigenvalues λ is real
Criteria
Type
λ<0
Stable node
λ>0
Unstable node
λ > 0 and λ < 0
Saddle
๏‚— If eigenvalues are complex of the form ๐‘Ž + ๐‘–๐‘
Criteria
Type
a<0
Stable focus
a=0
Centre
a>0
Unstable focus
11.2. subsection(3)Special matrices in exercises
(1) Markov Matrix
๏‚— Let
A=
๏‚— The sum of elements of row or column sum to unity.
๏‚— One of the eigenvalue of Markov matrix is 1.
๏‚— The rows of [A-I]sum to zero
๏‚— [A-I] is singular and columns of A-I are linearly dependent.
M.D. Greenberg, "The Eigenvalue Problem," in Advanced Engineering Mathematics,
2nd ed. Upper Saddle River, New Jersey: Prentice Hall, 1998, ch. 11.3
(2)Tridiagnol matrix
๏‚— A Tridiagnol matrix is one in which all element are
zero except the principal diagonals and its two
adjacent diagonals .
๏‚— Eigenvalues are given by
(3) Generalized eigenvalue problem
๏‚— If B≠1 then Ax=λBx is called generalized eigenvalue
problem.
๏‚— Characteristic equation got by det(A - λB)x=0
๏‚— Eigenvectors given by (A - λB)x=0
(4) Cayley hamilton theorem
๏‚— Theorem- The characteristic equation of any square
matrix A is
λn+ α1 λn-1 +…. αn λ =0
then
An+ α1 An-1+…+ αn -1A+ αn I=0.
i.e A satisfies characteristic equation.
BRAINBITE
http://www.maths.usyd.edu.au/u/UG/JM/MATH1014/Quizzes/quiz12.html
Answer : a
11.3 SYMMETRIC MATRICES
๏‚— A square matrix is symmetric if A = AT. This means
that each element aij = aji, as figure[1].
๏‚— A symmetric matrix needs not have
real numbers as elements. However,
when it does, it has the remarkable
property of having only real
eigenvalues.
๏‚— Proof : recall, a complex number ๐‘ง =๐‘Ž + ๐‘–๐‘, then, the
conjugate of z is defined to be ๐‘ง = ๐‘Ž − ๐‘–๐‘, and ๐ด๐ต =
(๐ด)(๐ต), ๐‘ง๐‘ง = ๐‘ง 2 …[2]
[1] http://www.aiaccess.net/English/Glossaries/GlosMod/e_gm_symmetric_matrix.htm
[2]Peter V. O’Neil, “Eigenvalues,Diagnolization and Special Matrices” in Advanced Engineering
Mathematics 5th edition. Birmingham, AL: B. Stenquist, 2003, ch. 8.3, pp. 354-362.
Let A be an n x n matrix. Let ๐ธ be the eigenvector
corresponding to its eigenvalue ๐œ†, and get
๐ธ=
๐‘’1
๐‘’2
โ‹ฎ
๐‘’๐‘›
, ๐ธ ๐‘‡ = ๐‘’1 , ๐‘’2 โ‹ฏ ๐‘’๐‘› ,
๐ธ ๐‘‡ ๐ด๐ธ = ๐ธ ๐‘‡ ๐œ†๐ธ = ๐œ†๐ธ ๐‘‡ ๐ธ = ๐œ† ๐‘’1 , ๐‘’2 โ‹ฏ ๐‘’๐‘›
= ๐œ†( ๐‘’1
2
+ ๐‘’2
2
๐‘’1
๐‘’2
โ‹ฎ
๐‘’๐‘›
+ โ‹ฏ + ๐‘’๐‘› 2 )
If A is a real and symmetric matrix, then ๐‘จ = ๐€ and
๐‘จ๐‘‡ = ๐‘จ, now compute[1]…
[1]Peter V. O’Neil, “Eigenvalues,Diagnolization and Special Matrices” in Advanced Engineering Mathematics
5th edition. Birmingham, AL: B. Stenquist, 2003, ch. 8.3, pp. 354-362.
๐ธ ๐‘‡ ๐‘จ๐ธ = ๐ธ ๐‘‡ ๐‘จ๐ธ = ๐ธ ๐‘‡ ๐‘จ๐ธ is a 1x1 matrix (a number), and so
is the same as its transpose
⇒ ๐ธ ๐‘‡ ๐‘จ๐ธ = (๐ธ ๐‘‡ ๐‘จ๐ธ)๐‘‡ = ๐ธ ๐‘‡ ๐‘จ(๐ธ ๐‘‡ )๐‘‡ = ๐ธ ๐‘‡ ๐‘จ๐ธ
⇒ ๐ธ ๐‘‡ ๐‘จ๐ธ = ๐ธ ๐‘‡ ๐‘จ๐ธ = ๐œ†( ๐‘’1 2 + ๐‘’2 2 + โ‹ฏ + ๐‘’๐‘› 2 )
Therefore, the number ๐ธ ๐‘‡ ๐‘จ๐ธ , being equal to its conjugate,
is a real number. And ( ๐‘’1 2 + ๐‘’2 2 + โ‹ฏ + ๐‘’๐‘› 2 ) is
certainly real. Therefore ๐œ† is real[1].
[1]Peter V. O’Neil, “Eigenvalues,Diagnolization and Special Matrices” in Advanced Engineering Mathematics
5th edition. Birmingham, AL: B. Stenquist, 2003, ch. 8.3, pp. 354-362.
๏‚— Let A be a real symmetric matrix. Then eigenvectors
associated with distinct eigenvalues are orthogonal.
๏‚— Let A be a real symmetric matrix. Then there is a real,
orthogonal matrix that diagonalizes A[1].
๏‚— Let A be a real, n x n symmetric matrix. Then its
eigenvector provide an orthogonal basis for n-space.
Therefore, if an eigenvalue is repeated by k times.
Then the eigenspace is of dimension k, and we can
find another set of orthogonal vector by linear
combination[2].
[1] Peter V. O’Neil, “Eigenvalues,Diagnolization and Special Matrices” in Advanced Engineering
Mathematics 5th edition. Birmingham, AL: B. Stenquist, 2003, ch. 8.3, pp. 354-362.
[2] M.D. Greenberg, "The Eigenvalue Problem," in Advanced Engineering Mathematics, 2nd ed. Upper
Saddle River, New Jersey: Prentice Hall, 1998, ch. 11.3, pp. 554-569.
Symmetric Matrix Examples
๏ฌ1 ๏€ฝ 2
๏ƒฆ 3 0 ๏€ญ2 ๏ƒถ
let A ๏€ฝ ๏ƒง๏ƒง 0 2 0 ๏ƒท๏ƒท and get ๏ฌ2 ๏€ฝ ๏€ญ1
๏ƒง ๏€ญ2 0 0 ๏ƒท
๏ฌ3 ๏€ฝ 4
๏ƒจ
๏ƒธ
๏‚— We can see that a real, symmetric matrix provides a set
of real eigenvalues. And the corresponding eigenvectors
are
๏ƒฆ 0๏ƒถ ๏ƒฆ 1๏ƒถ ๏ƒฆ 2 ๏ƒถ
๏ƒง1๏ƒท,๏ƒง 0๏ƒท,๏ƒง 0 ๏ƒท
๏ƒง ๏ƒท ๏ƒง ๏ƒท ๏ƒง ๏ƒท
๏ƒง 0 ๏ƒท ๏ƒง 2 ๏ƒท ๏ƒง ๏€ญ1๏ƒท
๏ƒจ ๏ƒธ ๏ƒจ ๏ƒธ ๏ƒจ ๏ƒธ
๏‚— These form an orthogonal set of vectors[1].
[1]Peter V. O’Neil, “Eigenvalues,Diagnolization and Special Matrices” in Advanced Engineering Mathematics
5th edition. Birmingham, AL: B. Stenquist, 2003, ch. 8.3, pp. 354-362.
๏‚— The orthonormal form is divided by its length and they
can be used as columns of an orthogonal matrix.
๏ƒฆ
1
2 ๏ƒถ
๏ƒง0 5 5 ๏ƒท
Q ๏€ฝ ๏ƒง1 0 0 ๏ƒท
๏ƒง
๏ƒท
๏ƒง 0 25 ๏€ญ 15 ๏ƒท
๏ƒง
๏ƒท
๏ƒจ
๏ƒธ
๏‚— We can find Q-1 = QT, and A can be diagonalized by Q[1].
๏ƒฆ 2 0 0๏ƒถ
Q ๏€ญ1 AQ ๏€ฝ ๏ƒง๏ƒง 0 ๏€ญ1 0 ๏ƒท๏ƒท
๏ƒง 0 0 4๏ƒท
๏ƒจ
๏ƒธ
[1]Peter V. O’Neil, “Eigenvalues,Diagnolization and Special Matrices” in Advanced Engineering Mathematics
5th edition. Birmingham, AL: B. Stenquist, 2003, ch. 8.3, pp. 354-362.
Useful properties[1]
๏‚— If A, B are symmetric n × n matrices, then A+B is
symmetric.
๐ด + ๐ต ๐‘‡ = ๐ด๐‘‡ + ๐ต๐‘‡ = ๐ด + ๐ต
๏‚— If A, B are symmetric n × n matrices, then AB is not
symmetric.
๐ด๐ต ๐‘‡ = ๐ต๐‘‡ ๐ด๐‘‡ = ๐ต๐ด ≠ ๐ด๐ต
๏‚— If C is any n × n matrix. Then ๐ต = ๐ถ ๐‘‡ ๐ถ is a symmetric
matrix.
(๐ถ ๐‘‡ ๐ถ)๐‘‡ = ๐ถ ๐‘‡ (๐ถ ๐‘‡ )๐‘‡ = ๐ถ ๐‘‡ ๐ถ
๏‚— If D is a diagonal matrix, then D is symmetric.
[1]http://www.math.panam.edu/
BRAINBITE
Find which of followings is not the eigenvalue of the 4x4
matrix and its corresponding orthogonal eigenvector.
a. ๐œ† = 0, ๐‘ฃ = [1 0 0 0]๐‘‡
0 0
0 0
0 1 −2 0
b. ๐œ† = 0, ๐‘ฃ = [0 0 0 1]๐‘‡
0 −2 1 0
0 0
0 0
c. ๐œ† = −1, ๐‘ฃ = [0 1 1 0]๐‘‡
d. ๐œ† = 1, ๐‘ฃ = [0 − 1 − 1 0]๐‘‡
e. ๐œ† = 3, ๐‘ฃ = [0 − 1 1 0]๐‘‡
[1]Peter V. O’Neil, “Eigenvalues,Diagnolization and Special Matrices” in Advanced Engineering Mathematics
5th edition. Birmingham, AL: B. Stenquist, 2003, ch. 8.3, pp. 354-362.
answer : d
11.4 DIAGONALIZATION
Background
๏‚— Diagonal matrices have good properties for simplifying
calculations
๏‚— Exploit these properties by diagonalizing the matrix
A in ๐‘จ๐’™ = λ๐’™ or ๐‘จ๐’™ = ๐’™′ for DE
๏‚— Essentially, a change of base is required (๐ฑ = ๐๐’™) so
that…
๏‚— ๐‘จ๐‘ธ๐’™ = ๐‘ธ๐’™′
๏‚— ๐’™′ = ๐‘ธ−1 ๐‘จ๐‘ธ ๐’™ = ๐‘ซ๐’™
Properties and Restrictions
๏‚— A is diagonalizable if and only if it has n LI
eigenvectors
๏‚— If the above condition is met, ๐‘ธ = {๐‘’1 , ๐‘’2 , … , ๐‘’๐‘› } (i.e.
the eigenvectors of A form a matrix Q)
๏‚— Symmetric matrices are always diagonalizable.
๏‚— ๐‘ธ๐‘‡ = ๐‘ธ−1 due to property of LI eigenvectors
Example
๏‚—
๏‚—
๏‚—
๏‚—
๐‘ฅ(๐‘ก)
3 5
๐’™ + ๐‘จ๐’™ = ๐ŸŽ where ๐’™ =
and ๐‘จ =
๐‘ฆ(๐‘ก)
1 2
Make substitution of ๐’™ = ๐‘ธ๐’™
๐’™′′ + ๐‘ธ−1 ๐‘จ๐‘ธ๐’™ = ๐ŸŽ where ๐‘ธ−1 ๐‘จ๐‘ธ๐’™ = ๐‘ซ๐’™
Solve for eigenvalues and eigenvectors to find D and Q
′′
Example
๏‚— Eigenvalues are of A are λ1 = 4.79129 and λ2 =0.208712
2.79129
−1.79129
๏‚— Eigenvectors are
and
1
1
4.79129
0
๏‚— Therefore, ๐‘ซ =
when ๐ =
0
0.208712
2.79129 −1.79129
1
1
Example
๏‚— Using D, two uncoupled differential equations arise
(instead of coupled like before)
๐’™(๐’•)′′ + ๐Ÿ‘๐’™ ๐’• + ๐Ÿ“๐‘ฆ(๐‘ก) = ๐ŸŽ
๐’š(๐’•)′′ + ๐Ÿ๐’™ ๐’• + ๐Ÿ๐’š(๐’•) = ๐ŸŽ Diagonalization
๐’™′′ + ๐Ÿ’. ๐Ÿ•๐Ÿ—๐Ÿ๐Ÿ๐Ÿ—๐’™ = ๐ŸŽ
๐’š′′ + ๐ŸŽ. ๐Ÿ๐ŸŽ๐Ÿ–๐Ÿ•๐Ÿ๐Ÿ๐’š = ๐ŸŽ
๏‚— These equations are simple ODE and are solved using
the solution ๐ด sin(๐œ”๐‘ก + ๐œ‘).
๏‚— ω can be solved for easily whereas A and φ are
constants of integration
Example
๏‚— Since we assumed ๐’™ = ๐‘ธ๐’™, now we can solve for the
real x(t) and y(t)
๐‘ฅ(๐‘ก)
๐ด1 sin(๐œ”1 ๐‘ก + ๐œ‘1 )
๏‚—
=๐‘ธ
๐‘ฆ(๐‘ก)
๐ด2 sin(๐œ”2 ๐‘ก + ๐œ‘2 )
๐‘ฅ(๐‘ก)
2.79129
๏‚—
=
๐‘ฆ(๐‘ก)
1
−1.79129 ๐ด1 sin(๐œ”1 ๐‘ก + ๐œ‘1 )
๐ด2 sin(๐œ”2 ๐‘ก + ๐œ‘2 )
1
๏‚— x(t) and y(t) have been solved completely and easily
compared to not using properties of diagonal matrices
11.5 APPLICATIONS TO FIRST
ORDER SYSTEMS WITH
CONSTANT COEFFICIENTS
11.5 APPLICATIONS TO FIRST ORDER
SYSTEMS WITH CONSTANT COEFFICIENTS
๏‚— Consider an initial value problem
๏‚— In matrix form
๏‚— The solution to the differential equation is given by
๏‚— Where
A= coefficients of variables
Q= modal matrix =[e1,e2….en]
D= Diagonal matrix where jth diagonal elements
are jth eigenvalue of A.
๏‚— The solution can also be expressed of the form
Where
M.D. Greenberg, "The Eigenvalue Problem," in Advanced Engineering
Mathematics, 2nd ed. Upper Saddle River, New Jersey: Prentice Hall, 1998, ch. 11.3
Example
๏‚— Consider the equations
๏‚— Solution :
๏‚— Replacing the values of A,D,Q and Q-1 in the following
equation
๏‚— we get
11.6 QUADRATIC FORMS
๏‚— A (complex) quadratic form is an expansion
๐‘›
๐‘—=1
๐‘›
๐‘˜=1 ๐‘Ž๐‘—๐‘˜ ๐‘ง๐‘— ๐‘ง๐‘˜ ,
in which each ๐‘Ž๐‘—๐‘˜ and ๐‘ง๐‘— is a
complex number[1]. For n=2, this is
๐‘Ž11 ๐‘ง1 ๐‘ง1 + ๐‘Ž12 ๐‘ง1 ๐‘ง2 + ๐‘Ž21 ๐‘ง2 ๐‘ง1 + ๐‘Ž22 ๐‘ง2 ๐‘ง2
๏‚— The quadratic form is real if each ๐‘Ž๐‘—๐‘˜ and ๐‘ง๐‘— is real, and
we usually write ๐‘ง๐‘— as ๐‘ฅ๐‘— , and the form is
๐‘›
๐‘›
๐‘—=1 ๐‘˜=1 ๐‘Ž๐‘—๐‘˜ ๐‘ฅ๐‘— ๐‘ฅ๐‘˜ .
[1]Peter V. O’Neil, “Eigenvalues,Diagnolization and Special Matrices” in Advanced Engineering Mathematics
5th edition. Birmingham, AL: B. Stenquist, 2003, ch. 8.4, pp. 363-367.
๏‚— It is often convenient to write a quadratic form in a
matrix form. If A = [๐‘Ž๐‘–๐‘— ], ๐‘ง =
๐‘Ž11
then ๐‘ง ๐‘‡ ๐ด๐‘ = (๐‘ง1 , ๐‘ง2 โ‹ฏ ๐‘ง๐‘› ) โ‹ฎ
๐‘Ž๐‘›1
=
๐‘›
๐‘—=1
๐‘ง1
๐‘ง2
โ‹ฎ
๐‘ง๐‘›
โ‹ฏ ๐‘Ž1๐‘›
โ‹ฑ
โ‹ฎ
โ‹ฏ ๐‘Ž๐‘›๐‘›
๐‘ง1
๐‘ง2
โ‹ฎ
๐‘ง๐‘›
๐‘›
๐‘˜=1 ๐‘Ž๐‘—๐‘˜ ๐‘ง๐‘— ๐‘ง๐‘˜ [1]
[1]Peter V. O’Neil, “Eigenvalues,Diagnolization and Special Matrices” in Advanced Engineering Mathematics
5th edition. Birmingham, AL: B. Stenquist, 2003, ch. 8.4, pp. 363-367.
Quadratic forms example
๏‚— Let ๐ด =
๐‘ฅ1 , ๐‘ฅ2
1 4
, then
3 2
1 4
3 2
๐‘ฅ1
๐‘ฅ2
= ๐‘ฅ1 2 + 7๐‘ฅ1 ๐‘ฅ2 + 2๐‘ฅ2 2
But we can also rewrite the quadratic form as ๐‘ฅ1 2 +
7
1
7
7
๐‘ฅ1
2
๐‘ฅ1 ๐‘ฅ2 + ๐‘ฅ2 ๐‘ฅ1 + 2๐‘ฅ2 2 = ๐‘ฅ1 , ๐‘ฅ2 7
2
2
2 ๐‘ฅ2
2
The advantage of latter form is that A is a symmetric
matrix[1].
[1]Peter V. O’Neil, “Eigenvalues,Diagnolization and Special Matrices” in Advanced Engineering Mathematics
5th edition. Birmingham, AL: B. Stenquist, 2003, ch. 8.4, pp. 363-367.
Classi๏ฌcation of The Quadratic Form[1]
Q = ๐‘ฅ ๐‘‡ ๐ด๐‘ฅ: A quadratic form is said to be:
๏‚— Negative de๏ฌnite: Q < 0 when x ≠ 0
๏‚— Negative semide๏ฌnite: Q ≤ 0 for all x and Q = 0 for
some x ≠ 0
๏‚— Positive de๏ฌnite: Q > 0 when x ≠ 0
๏‚— Positive semide๏ฌnite: Q ≥ 0 for all x and Q = 0 for
some x ≠ 0
๏‚— Inde๏ฌnite: Q > 0 for some x and Q < 0 for some other
x
[1]http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=5&ved=0CGQQFjAE&url=http%3A
%2F%2Fwww.econ.iastate.edu%2Fclasses%2Fecon501%2FHallam%2Fdocuments%2FQuad_Forms_000.pdf
&ei=wp26TvrgMsiJsAKNzqXOCA&usg=AFQjCNGQ_OibQn6rhf0wrBTNSVMVOltoaQ&sig2=Y061Hf2_fqb
XqjUYyADczQ
Classi๏ฌcation example[1]
1 0 0
๏‚— For ๐ด = 0 2 0 , then
0 0 4
1 0 0 ๐‘ฅ1
๐‘„ = ๐‘ฅ ๐‘‡ ๐ด๐‘ฅ = (๐‘ฅ1 , ๐‘ฅ2 , ๐‘ฅ3 ) 0 2 0 ๐‘ฅ2
0 0 4 ๐‘ฅ3
= ๐‘ฅ12 + 2๐‘ฅ22 + 4๐‘ฅ32
For any real vector ๐‘ฅ ≠ 0, that ๐‘„ will be positive (so
called positive definite).
[1]http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=5&ved=0CGQQFjAE&url=http%3A
%2F%2Fwww.econ.iastate.edu%2Fclasses%2Fecon501%2FHallam%2Fdocuments%2FQuad_Forms_000.pdf
&ei=wp26TvrgMsiJsAKNzqXOCA&usg=AFQjCNGQ_OibQn6rhf0wrBTNSVMVOltoaQ&sig2=Y061Hf2_fqb
XqjUYyADczQ
Graphical Analysis[1]
๏‚— Consider the indefinite matrix A is given by
−2 2
2 2
๏‚— The quadratic form then is given by
−2 2 ๐‘ฅ1
๐‘‡
๐‘„ = ๐‘ฅ ๐ด๐‘ฅ = (๐‘ฅ1 , ๐‘ฅ2 )
2 2 ๐‘ฅ2
= −2๐‘ฅ12 + 4๐‘ฅ1 ๐‘ฅ2 + 2๐‘ฅ22
๐ด=
= 4๐‘ฅ22 − ( 2๐‘ฅ1 − 2๐‘ฅ2 )2
๏‚— Then Q > 0 for some x and Q < 0 for some other x, so
called indefinite form.
[1]http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=5&ved=0CGQQFjAE&url=http%3A%2F%
2Fwww.econ.iastate.edu%2Fclasses%2Fecon501%2FHallam%2Fdocuments%2FQuad_Forms_000.pdf&ei=wp26Tv
rgMsiJsAKNzqXOCA&usg=AFQjCNGQ_OibQn6rhf0wrBTNSVMVOltoaQ&sig2=Y061Hf2_fqbXqjUYyADczQ
Graphical Analysis[1]
๏‚— The graphic in 3-demension governed by Q = −2๐‘ฅ12 +
4๐‘ฅ1 ๐‘ฅ2 + 2๐‘ฅ22 as follows
๏‚— Where it is clear that Q takes both positive and
negative values.
[1]http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=5&ved=0CGQQFjAE&url=http%3A%2F%
2Fwww.econ.iastate.edu%2Fclasses%2Fecon501%2FHallam%2Fdocuments%2FQuad_Forms_000.pdf&ei=wp26Tv
rgMsiJsAKNzqXOCA&usg=AFQjCNGQ_OibQn6rhf0wrBTNSVMVOltoaQ&sig2=Y061Hf2_fqbXqjUYyADczQ
๏‚— In some problems involving quadratic forms,
calculations are simplified if we transform from
๐‘ฅ1 , ๐‘ฅ2 โ‹ฏ ๐‘ฅ๐‘› coordinate system to a ๐‘ฆ1 , ๐‘ฆ2 โ‹ฏ ๐‘ฆ๐‘› system
in which there are no mixed product terms. That is,
we want to choose so that ๐‘›๐‘—=1 ๐‘›๐‘˜=1 ๐‘Ž๐‘—๐‘˜ ๐‘ฅ๐‘— ๐‘ฅ๐‘˜ =
๐‘›
2
๐‘
๐‘ฆ
๐‘—
๐‘—
๐‘—=1
๏‚— The ๐‘ฆ1 , ๐‘ฆ2 โ‹ฏ ๐‘ฆ๐‘› coordinates are called principal axes
for the quadratic form, where the rotation of axes is
used to eliminate mixed product terms in the
equation of conic[1].
[1]Peter V. O’Neil, “Eigenvalues,Diagnolization and Special Matrices” in Advanced Engineering Mathematics
5th edition. Birmingham, AL: B. Stenquist, 2003, ch. 8.4, pp. 363-367.
๏‚— Let A be a real symmetric matrix with eigenvalues ๐œ†1 โ‹ฏ ๐œ†๐‘› ,
and Q is an orthogonal matrix formed by their
corresponding eigenvectors that diagonalizes A. Then the
change of variables X=QY transforms ๐‘›๐‘—=1 ๐‘›๐‘˜=1 ๐‘Ž๐‘—๐‘˜ ๐‘ฅ๐‘— ๐‘ฅ๐‘˜
to ๐‘›๐‘—=1 ๐œ†๐‘— ๐‘ฆ๐‘— 2 [1].
๐‘›
๐‘—=1
๏‚— Proof:
๐‘›
๐‘˜=1 ๐‘Ž๐‘—๐‘˜ ๐‘ฅ๐‘—
๐‘ฅ๐‘˜ = ๐‘‹ ๐‘‡ ๐ด๐‘‹ =
๐‘„๐‘Œ)๐‘‡ ๐ด ๐‘„๐‘Œ = (๐‘Œ ๐‘‡ ๐‘„๐‘‡ ๐ด๐‘„๐‘Œ = ๐‘Œ ๐‘‡ ๐‘„๐‘‡ ๐ด๐‘„ ๐‘Œ
= ๐‘ฆ1 โ‹ฏ ๐‘ฆ๐‘›
๐œ†1
0
0
0
โ‹ฑ
0
0
0
๐œ†๐‘›
๐‘ฆ1
2 + โ‹ฏ+ ๐œ† ๐‘ฆ 2
=
๐œ†
๐‘ฆ
1 1
๐‘› ๐‘›
โ‹ฎ
๐‘ฆ๐‘›
[1]Peter V. O’Neil, “Eigenvalues,Diagnolization and Special Matrices” in Advanced Engineering Mathematics
5th edition. Birmingham, AL: B. Stenquist, 2003, ch. 8.4, pp. 363-367.
Principal Axis Example
๏‚— Analyze the conic 4๐‘ฅ1 2 − 3๐‘ฅ1 ๐‘ฅ2 + 2๐‘ฅ2 2 = 8
First write the quadratic form as ๐‘ฟ๐‘‡ ๐‘จ๐‘ฟ = 8, where ๐ด =
−3
4
2
, then the eigenvalues of A are (6 ± √13)/2.
−3
2
2
By the principal axis theorem, there is an orthogonal
matrix Q that transforms the equation of the conic to
standard form (canonical form):
6+√13
๐‘ฆ1 2
2
+
6−√13
๐‘ฆ2 2
2
=8
[1]Peter V. O’Neil, “Eigenvalues,Diagnolization and Special Matrices” in Advanced Engineering Mathematics
5th edition. Birmingham, AL: B. Stenquist, 2003, ch. 8.4, pp. 363-367.
๏‚— This is an ellipse in the ๐‘ฆ1 , ๐‘ฆ2 plane. The figure[1]
shows a graph of this ellipse.
๐‘‹ = ๐‘„๐‘Œ ⇒
๐‘Œ = ๐‘„ −1 ๐‘‹ = ๐‘„๐‘‡ ๐‘‹
[1]Peter V. O’Neil, “Eigenvalues,Diagnolization and Special Matrices” in Advanced Engineering Mathematics
5th edition. Birmingham, AL: B. Stenquist, 2003, ch. 8.4, pp. 363-367.
Download