NUMERICAL ANALYSIS
THE GOAL OF THE COURSE
Except as regular introductory course in numerical analysis, this course is designed to cover the greater part of
the contents of the access exam in Numerical analysis as part of the doctoral studies in mathematics.
After successful examination of this course, students will be able to:

demonstrate knowledge and understanding of the concepts and results of numerical mathematics, solve
basic numerical problems analytically and using advanced computation on computers

independently use mathematical reading of numerical analysis in Croatian and English language
THE SYLLABUS
Errors and numerical stability
Sources of errors, error propagation. Computer arithmetic and round off errors. The stability of problems and
algorithms. Errors in summations. Computing the value of a polynomial and some elementary functions at the
given point.
Systems of linear equations
Direct methods, Gaussian elimination, LU factorization. Definite systems and the Cholesky factorization. Condition of the linear system, perturbation theory for linear systems and algorithms.
Iterative methods for linear systems
General theory of iterative methods. The classical iterative methods and their convergence: Jacobi, Gauss-Seidel,
JOR and SOR methods. The optimal choice of the relaxation parameter for special systems. Iterations from the
Krylov subspaces and their convergence. Arnoldy and GMRES methods.
Matrix formulation of linear least squares problem
Solve least squares problems using the QR factorization and singular value decomposition (SVD). The MoorePenrose inverse.
The eigenvalue problem
General theory of symmetric and nonsymmetric eigenvalue problem. Variational characterization of eigenvalues
and perturbation theory of Hermitian matrices. Reduction to Hessenberg and tridiagonal form. General QR
algorithm. The algorithms for symmetric matrices, classical Jacobi method, QR iteration, modern methods
(review). Algorithms for computing the singular value decomposition. Application of SVD.
Interpolation
Interpolation polynomials, estimation of error, convergence, optimal selection of nodes. Hermite interpolation.
Numerical derivation. Piecewise polynomial interpolation, linear and cubic spline, B-splines. Trigonometric and
rational interpolation, continued fractions.
Aproximation
Approximation in various norms. Discrete and continuous least squares problem. Orthogonal systems of
functions. Orthogonal polynomials (continuous and discrete). Generalized Horner scheme. Continuous and
discrete Fourier approximation. Min-max and almost min-max approximation. Smoothing the data.
Numerical integration
Newton-Cotes integration formulas. The trapezoidal and Simpson's rule. The composite formulas. The
trapezoidal rule for periodic functions,.The Euler-MacLaurin formula, the Romberg algorithm. The Gaussian
quadrature.
Rootfinding for nonlinear equations
The bisection method, simple function iteration, Newton's method. A general theory for one-point iteration
methods, roots of polynomials. Newton's method for nonlinear systems. The secant method.
Numerical solution of ordinary differential equations
Initial problems. Single-step methods, explicit and implicit Euler method, Runge-Kutta methods, implicit
trapezoidal method. Multistep methods, predictor-corrector couples. General theory of linear difference schemes,
consistency, stability, convergence (brief overview).
Numerical solutions of partial differential equations
Boundary problems, discretization using finite differences. Some practical problems and frequent equation in
practice. Finite differences in the time and spatial variables. Parabolic equations, explicit, implicit and CrankNicolson method. Elliptic problems, Laplace and Poisson equation on a rectangle, difference schemes.
Comparison of iterative methods for discrete Poisson equations on the square. Multigrid methods (a brief
overview).
REQUIRED READING
K. E. Atkinson: An Introduction to Numerical Analysis, Third Edition, John Wiley & Sons, New York, 1988.
J. W. Demmel: Applied Numerical Linear Algebra, SIAM, Philadelphia, 1997.
W. Gautschi: Numerical Analysis, An Introduction, Birkhauser, Boston, 1997.
G. Golub and C. F. Van Loan: Matrix computations. The John Hopkins University Press, Baltimore 2012.
J. Stoer, R. Bulirsch: Introduction to Numerical Analysis, Second Edition, Texts in Applied Mathematics
12, Springer Verlag, New York, 1992.
ADDITIONAL READING
S. C. Brenner, L. R. Scott: The mathematical theory of finite element methods, Springer 2007.
W. Cheney, D. Kincaid: Numerical Mathematics and Computing, Fourth Edition, Brooks/Cole, Pacific Grove,
1999.
P. G. Ciarlet: Introduction to numerical linear algebra and optimisation, Cambridge U. Press, Cambridge 1989.
N. J. Higham: Accuracy and Stability of Numerical Algorithms, Second Edition, SIAM, Philadelphia 2002.
R. M. M. Mattheij, S. W. Rienstra, J. H. M. ten Thije Boonkkamp: Partial Differential Equations: Modeling,
Analysis, Computation, SIAM, Philadelphia, 2005.
A. Ralston, P. Rabinowitz: A First Course in Numerical Analysis, Second Edition, McGraw-Hill, Singapore,
1978.
M. Schatzman: Numerical Analysis, A Mathematical Introduction, Oxford University Press, Oxford, 2002.