Lecture 24 Nonlinear Systems: Picard and Newton methods

advertisement

Lecture 24

Nonlinear Systems: Picard and Newton methods

(Lecture notes taken by Paul Thompson and Jason Andrus)

Fixed point in 1D: x = g(x). x g x

Example:

√2 2 2 0

. Or,

2

Picard Method: where the last part of the previous equation is accomplished by the mean value theorem.

Cm x   x m

Assume

| | 1

on some interval. Then by the mean value theorem g is contractive on [a b] (iff

| | | |

| | | | | | | |

If

1, then

Returning to Example:

2

2 0 1

near √2 , then it is larger than 1!! Picard method would fails.

Example: ODE

Δ

Δ

Δ

If |

0 Δ

| , then|

Picard method in nD.

| Δ and we must choose Δ such that Δ 1 where we hope this converges to a fixed point

|| || || ||

A similar analysis as from above can be given and requires r < 1.

Generally we change this into a one variable problem: scalar.

Example:

0 1 0

Use FDM:

2

Or use:

2

0

0

1 2

0

1 0 0

1

1 0

1

1 2

,

where t is a

FEM example.

,

 

Picard Method:

Root in 1D: f(x) = 0.

 

Newton’s   Method:  

1

 

~ x

0

  x

1

 

 

The green curve represents the function whose zero one is trying to find f(x). The red line represents the tangent line to the curve at the initial guess and x

1

is located where the tangent line equals zero. The process is repeated until the iterative solution is sufficiently close to the exact solution. The formula used for this process can be seen below.

 

One can look at this method as a special Picard scheme. For convergence purposes we need

| | 1

.

 

1

"

 

"

 

|

| " |

|

| |

 

If

| " |

and

| ′ |

then:

′ | | 1

From the above statement it can be noted that for Newton’s Method the initial guess (x

0

) needs to be close to the exact solution.

Example Problem:

2 0  

2

2

 

3

2

1

1  

1 2

2

3

2

 

9

4

3

2

17

12

√2 1.4142

 

1.41667

 

 

Thus one notes that the series is converging to the exact solution.

 

Convergence Properties (Under Suitable Assumptions)

1) Local Convergence

"

2) Quadratic Convergence

| | |

"

|

Matrix formation for Newton Method . n = 1: n   

,

,

0 ,

Need

 

 

 

 

 

 

1D:

0 ′ nD:

0

will be dimension n x 1, while matrix

′ will be Note: Matrices dimension n x n.

and

Newton’s Method in nD

Example Problem: n = 2:

1,

,

1 d=1/2 d=1   d=2  

We note at d>1 the curves do not intersect, at d=1 the curves are tangent at exactly two locations, and at d<1 the curves will have four points of intersection.

2

2

2

2 det ′ 2 2 2 2 8

Example Problem Using FDM

2

, , … ,

Thus now let one build the derivative matrix F’.

0

1

2

0

1

0

1

1

1

1

2

0

0

1

2

0

1

1

0

1

1 2

0

0

1

FEM example.

0.

B is the mass matrix and both A and B are tri-diagonal as previously shown. Use the weak equation and following expressions for u and f:

Download