Fundamentals of Numerical Mathematics for Physicists and Engineers

Introduces the fundamentals of numerical mathematics and illustrates its applications to a wide variety of disciplines in physics and engineering  Applying numerical mathematics to solve scientific problems, this book helps readers understand the mathematical and algorithmic elements that lie beneath numerical and computational methodologies in order to determine the suitability of certain techniques for solving a given problem. It also contains examples related to problems arising in classical mechanics, thermodynamics, electricity, and quantum physics. Fundamentals of Numerical Mathematics for Physicists and Engineers is presented in two parts. Part I addresses the root finding of univariate transcendental equations, polynomial interpolation, numerical differentiation, and numerical integration. Part II examines slightly more advanced topics such as introductory numerical linear algebra, parameter dependent systems of nonlinear equations, numerical Fourier analysis, and ordinary differential equations (initial value problems and univariate boundary value problems). Chapters cover: Newton’s method, Lebesgue constants, conditioning, barycentric interpolatory formula, Clenshaw-Curtis quadrature, GMRES matrix-free Krylov linear solvers, homotopy (numerical continuation), differentiation matrices for boundary value problems, Runge-Kutta and linear multistep formulas for initial value problems. Each section concludes with Matlab hands-on computer practicals and problem and exercise sets. This book:  Provides a modern perspective of numerical mathematics by introducing top-notch techniques currently used by numerical analysts  Contains two parts, each of which has been designed as a one-semester course Includes computational practicals in Matlab (with solutions) at the end of each section for the instructor to monitor the student's progress through potential exams or short projects Contains problem and exercise sets (also with solutions) at the end of each section  Fundamentals of Numerical Mathematics for Physicists and Engineers is an excellent book for advanced undergraduate or graduate students in physics, mathematics, or engineering. It will also benefit students in other scientific fields in which numerical methods may be required such as chemistry or biology.

Table of Contents:
About the Author ix Preface xi Acknowledgments xv Part I 1 1 Solution Methods for Scalar Nonlinear Equations 3 1.1 Nonlinear Equations in Physics 3 1.2 Approximate Roots: Tolerance 5 1.2.1 The Bisection Method 6 1.3 Newton’s Method 10 1.4 Order of a Root-Finding Method 13 1.5 Chord and Secant Methods 16 1.6 Conditioning 18 1.7 Local and Global Convergence 20 Problems and Exercises 24 2 Polynomial Interpolation 29 2.1 Function Approximation 29 2.2 Polynomial Interpolation 30 2.3 Lagrange’s Interpolation 33 2.3.1 Equispaced Grids 37 2.4 Barycentric Interpolation 39 2.5 Convergence of the Interpolation Method 43 2.5.1 Runge’s Counterexample 46 2.6 Conditioning of an Interpolation 49 2.7 Chebyshev’s Interpolation 54 Problems and Exercises 60 3 Numerical Differentiation 63 3.1 Introduction 63 3.2 Differentiation Matrices 66 3.3 Local Equispaced Differentiation 72 3.4 Accuracy of Finite Differences 75 3.5 Chebyshev Differentiation 80 Problems and Exercises 84 4 Numerical Integration 87 4.1 Introduction 87 4.2 Interpolatory Quadratures 88 4.2.1 Newton–Cotes Quadratures 92 4.2.2 Composite Quadrature Rules 95 4.3 Accuracy of Quadrature Formulas 98 4.4 Clenshaw–Curtis Quadrature 104 4.5 Integration of Periodic Functions 112 4.6 Improper Integrals 115 4.6.1 Improper Integrals of the First Kind 116 4.6.2 Improper Integrals of the Second Kind 119 Problems and Exercises 125 Part II 129 5 Numerical Linear Algebra 131 5.1 Introduction 131 5.2 Direct Linear Solvers 132 5.2.1 Diagonal and Triangular Systems 133 5.2.2 The Gaussian Elimination Method 135 5.3 LU Factorization of a Matrix 140 5.3.1 Solving Systems with LU 145 5.3.2 Accuracy of LU 147 5.4 LU with Partial Pivoting 150 5.5 The Least Squares Problem 160 5.5.1 QR Factorization 162 5.5.2 Linear Data Fitting 173 5.6 Matrix Norms and Conditioning 178 5.7 Gram–Schmidt Orthonormalization 183 5.7.1 Instability of CGS: Reorthogonalization 187 5.8 Matrix-Free Krylov Solvers 193 Problems and Exercises 204 6 Systems of Nonlinear Equations 209 6.1 Newton’s Method for Nonlinear Systems 210 6.2 Nonlinear Systems with Parameters 220 6.3 Numerical Continuation (Homotopy) 224 Problems and Exercises 232 7 Numerical Fourier Analysis 235 7.1 The Discrete Fourier Transform 235 7.1.1 Time–Frequency Windows 243 7.1.2 Aliasing 246 7.2 Fourier Differentiation 251 Problems and Exercises 258 8 Ordinary Differential Equations 261 8.1 Boundary Value Problems 262 8.1.1 Bounded Domains 262 8.1.2 Periodic Domains 275 8.1.3 Unbounded Domains 277 8.2 The Initial Value Problem 279 8.2.1 Runge–Kutta One-Step Formulas 281 8.2.2 Linear Multistep Formulas 287 8.2.3 Convergence of Time-Steppers 297 8.2.4 A-Stability 301 8.2.5 A-Stability in Nonlinear Systems: Stiffness 315 Problems and Exercises 330 Solutions to Problems and Exercises 335 Glossary of Mathematical Symbols 367 Bibliography 369 Index 373