6. Revision Notes and Plans#
6.1. Recent Changes#
2025-12-08 Initial stubs for some planned future topics:
Finding the Minimum of a Function of One Variable Without Using Derivatives: expanded notes on the method of Successive Parabolic Interpolation.
2025-11-24 Finding the Minimum of a Function of One Variable Without Using Derivatives: expanded notes on the method of Successive Parabolic Interpolation.
2025-11-20 Finding the Minimum of a Function of Several Variables: expanded.
2025-11-19 section Some Possible Projects, with templates for several possible projects.
2025-11-18 Solving Nonlinear Systems of Equations by generalizations of Newton’s Method — an introduction: adding brief notes on topics beyond Newton’s method.
2025-11-18 Finding the Minimum of a Function of One Variable Without Using Derivatives: expanded.
2025-11-11 ODE IVP’s: added references to [LeVeque, 2007].
2025-11-05 Added code for solving tridiagonal linear systems in section Tridiagonal system solving in the module numerical_methods.
2025-10-29 Error bounds for linear algebra, matrix norms, condition numbers, etc.: Added the proof of the formula (2.10) for the matrix norm \(\| A \|_\infty\) in Error bounds for linear algebra, matrix norms, condition numbers, etc..
2025-10-29 Added references to [Kincaid and Chenney, 1990].
2025-10-28 Adding Algorithm 2.9 for forward substitution with upper triangular matrices that are not “unit”, Algorithm 2.10 for the Cholesky factorization of positive definite matrices, and expanded notes on when LU factorization works.
2025-10-25 Section Solving Ax = b with LU factorization: added Algorithm 2.9 for general upper trianglar matrices and Algorithm 2.10, and expanded the notes on LU factorization working for both types of SDD matrix.
2025-10-10 Section Faster Methods for Solving Ax=b with Tridiagonal and Banded Matrices: added Algorithm 2.19 for solving tri-diagonal systems by row-reduction, and some Exercises on measuring cost by operation counts.
2025-10-10 Section Operation Counts for Solving Simultaneous Linear Equations: added some (references to) exercises.
2025-10-07 Section Errors and Error Formulas for Polynomial Collocation: added Example 3.4 on approximating an exponential function to the
2025-10-07 Section Approximating Derivatives by the Method of Undetermined Coefficients: added Aside on an Alternative Approach: Differentiating a Collocating Polynomial.
2025-09-30 Computing Eigenvalues and Eigenvectors: the Power Method and Beyond: added the proof of the Gershgorin Circle Theorem Theorem 2.17 and the Rayleigh Iteration method for computing all eigenvalues.
2025-09-24 Section Iterative Methods for Simultaneous Linear Equations: added code for the Jacobi method and examples with that, and modified the exercises.
2025-09-01: Added references to Sullivan [2021] and Dionne [2023] throughout.
2025-08-17/18: Updated references in Chapters 1 and 2.
2025-08-17: Added more exercises.
2025-07-10: Ongoing adoption of myST/sphinx formatting for exercises, examples, remarks (formerly asides) and such, provided by the extensions
sphinx_proofandsphinx_exercise.2025-07-10: Gathered the exercises in each section into a subsection “Exercises” at the end of each section, with cross-references from where each is relevant.
2025-03-18: Updated the Bibliography.
2024-11-06: Renumbered exercises to be sequential through each chapter (“chapter.item”), rather than within each section, to be consistent with the numbering of other items (definitions, theorems, examples etc.). However, the PDF version insists on “chapter.section.item” format for everything. (Done to Runge-Kutta Methods so far.)
2024-10-08: Added the iteration cost result in the section on Root Finding by Interval Halving
2024-10-08: Added the derivation of the error bound \(\displaystyle Rel(x_a) := \frac{\|x - x_a\|}{\| x \|} \leq \|A\|\|A^{-1}\|\frac{\|r\|}{\|b\|} \) in the section on Error bounds for linear algebra etc..
2024-10-07: Added some comments to the section on Solving Equations by Fixed Point Iteration
2024-09-13: Revised the function
bisection1in modulenumerical_methods.2024-08-26/31: Added further exercises.
2024-06-18: Renamed, dropping the “Introduction to” and correspondingly dropping “introduction-to-” from its URLs.
6.2. Planned Content Improvements and Additions#
Add a section on “direct” methods for second order equations \(u'' = f(t, u, u')\), and in particular for conservative and Hamiltonian systems.
Add an introduction to methods for PDE IVPs.
Add brief introductions to background facts about existence and uniqueness of solutions, and well-posedness for DE’s: ODE IVP, ODE BVP, PDE IVP, etc.
Expand/complete the chapter on Optimization (Minimization).
Complete the section on root-finding for functins of several variables.
Add notes on linear multi-step methods: zero-stability, th eDahlquist theorem and absolute stability regions.
Add a brief chapter on ODE BVP’s, with:
an introduction to the Galerkin/finite element method for ODE BVP’s.
an introduction to then finite difference method for ODE BVP’s.
ODE IVP’s: add reference and citatons to the OER materials from TU Delft, in particular “Vuik et al - c”.
ODE IVP’s: Stability regions and “consistency plus stabilty equals convergence” results.
ODE IVP’s: In the notes on consistency/stabilty/canvergence in multitep methods, add or change to the less obviously wrong example of Sauer’s Eq. 6.81 in Section 6.7.2.
Move the results on “when does naive row reduction work?” to a subsequent (no-Python?) section, which introduces the various main cases of “well-behaved” matrices like DD, SDD and positive definite.
Continue revising Initial Value Problems for Ordinary Differential Equations from Error Control and Variable Step Sizes on.
Add definition of positive definite matrices in Row Reduction (Gaussian Elimination), and then add more results for this case in various places.
Improve the presentation of error control methods such as Runge-Kutta-Fehlberg in Error Control and Variable Step Sizes.
Add more references to [Gear, 1971] in Initial Value Problems for Ordinary Differential Equations
Add Python versions of most or all algorithms presented in the text (typically as pseudo-code); in general, only in the module
numerical_methodsbut with some “didactic” examples in the main text, to illustrate Python features such asimport, array creation and manipulation, and so on. Currently (2025-11-05) this is being done in Initial Value Problems for Ordinary Differential Equations and some of Linear Algebra and Simultaneous Equations.Continue adding some more advanced exercises.
Continue revising the notes on cubic splines in Piecewise Polynomial Approximating Functions and Spline Interpolation.
Add more exercises at the end of each section, gathering from assignments, the current separate sections on exercises, and other sources.
Add notes on min-max (Chebychev) approximation of functions by polynomials.
Expand some sections that are only stubs or very brief; in particular those on
Optimization (Minimization)
Multi-step methods for ODEs and determining their stability.
Continue to merge updates to and from the Julia version, mostly from Finding the Minimum of a Function of One Variable Without Using Derivatives onwards.
About document “python-tutorial-introduction”: either omit it or add notes on speed/cost measurement, such as with module
time.
6.3. Planned Format Revisions#
Continue adoption of advanced MyST/Sphinx features, such as converting most aside’s and note’s to an enumerated “remark” or “observation” via the extension
sphinx_proof; convert some from “remark” to “observation” (in progress).Add more subsections, so that the in-page index at right is more useful.