Section 4.3 Partial Derivatives
Revised on March 26.Introduction.
For a differentiable function of one variable, \(y=f(x)\text{,}\) a single number \(f'(a)\) describes the rate of change of the function value relative to change in the independent variable \(x\) away from \(x=a\text{.}\)
Change in the value of a function of two variables can be more complicated depending on the direction of the change. Consider the simple function \(f(x,y)=2x-y\) for \((x,y)\) near \((0,0)\text{.}\) Moving a distance \(h\) in the positive \(x\) direction changes the value by \(2h\text{;}\) moving a distance \(h\) in the positive \(y\) direction changes the function value by \(-h\text{;}\) moving any distance in the direction \(\vector{1,2}\) does not change the value at all.
The reason for this is that there are infinitely many directions in which the values of the independent variables can change. Thus we start by considering the effect of change along the coordinate axes: changing one independent variable while holding the other constant.
Subsection 4.3.1 Partial Derivatives of \(f(x,y)\) at a point
For \(f(x,y)\) and a point \((a,b)\) in its domain, consider the function given by allowing just \(x\) to vary while the \(y\) values is always \(b\text{:}\) \(g(x) = f(x,b)\text{.}\) Then \(g'(a)\) is its rate of change at \(x=a\text{,}\) which is also the rate of change of \(f(x,y)\) due to change in \(x\) alone at \((a,b)\text{.}\)
This is called the partial derivative of \(f\) with respect to \(x\) at \((a,b)\), denoted \(f_x(a,b)\text{:}\) using the definition of the derivative in terms of limits,
\begin{equation}
f_x(a,b) = \lim_{h \to 0}\frac{f(a+h,b)-f(a,b)}{h}\tag{4.3.1}
\end{equation}
Similarly, we define the partial derivative of \(f\) with respect to \(y\) at \((a,b)\) by
\begin{equation}
f_y(a,b) = \lim_{h \to 0}\frac{f(a,b+h)-f(a,b)}{h}.\tag{4.3.2}
\end{equation}
Subsection 4.3.2 Partial Derivatives as Functions
For a given point \((a,b)\text{,}\) the partial derivatives at \((a,b)\text{,}\) \(f_x(a,b)\) and \(f_y(a,b)\text{,}\) are numbers. As the point at which these are computed is allowed to vary, this gives functions:
Definition 4.3.1.
If \(f\) is a function of two variables, its partial derivatives are the functions \(f_x\) and \(f_y\) with values given by
\begin{equation*}
\begin{split}
f_x(x,y) \amp= \lim_{h \to 0}\frac{f(x+h,y)-f(x,y)}{h}
\\
f_y(x,y) \amp= \lim_{h \to 0}\frac{f(x,y+h)-f(x,y)}{h}
\end{split}
\end{equation*}
That is, to compute
\(f_x\text{,}\) treat
\(y\) as a constant, so that
\(f\) is teated as a function of a single variable
\(x\) and differentiate that. Likewise to compute
\(f_y\text{.}\)
To distinguish from partial derivatives, the derivative of a function of a single variable, \(f'\) or \(dy/dx\text{,}\) is sometimes called an ordinary derivative.
Subsection 4.3.3 Notations
A great variety of notations are used in various places for partial derivatives. For \(z=f(x,y)\text{,}\) some are
\begin{gather}
f_x(x,y) = f_x = \frac{\partial f}{\partial x} = \partial_x f = \frac{\partial z}{\partial x} = f_1 = D_1 f = D_x f\tag{4.3.3}\\
f_y(x,y) = f_y = \frac{\partial f}{\partial y} = \partial_y f = \frac{\partial z}{\partial y} = f_2 = D_2 f = D_y f\tag{4.3.4}
\end{gather}
Note the symbol \(\partial\) (a variant of \(\delta\text{,}\) spoken "partial") used in place of the \(d\) of the Leibniz notation \(df/dx\) for derivatives of function of a single variable.
For notation that does not depend on particular variable names, the prime notation \(f'\) is now ambiguous, so numerical subscripts are used to indicate the position of the variable in forms like \(f_1\) and \(D_2 f\text{.}\)
Subsection 4.3.4 Geometrical Meaning
A geometrical interpretation of this is that when computing \(f_x(a,b)\text{,}\) one looks at the intersection of the graph of \(f\) with the plane \(y=b\text{.}\)
This is the curve that is the graph of function \(z=g(x)=f(x,b)\text{,}\) but drawn on plane \(y=b\) instead of on the \(x-z\) plane.
Then \(f_x(a,b)=g'(b)\) which is the tangent slope of the curve at the point \(P(a,b,c)\) with \(c=f(a,b)\text{.}\)
Likewise, \(f_y(a,b)\) is the tangent slope at this point \(P\) to the curve given by the intersection of the graph of \(f\) with the plane \(x=a\text{.}\)
Subsection 4.3.5 Functions of More than Two Variables
Extensions to functions of three or more variables are fairly intuitive. For example with \(u = f(x,y,z)\text{,}\) we have
\begin{equation*}
f_z(x,y,z) = \lim_{h \to 0}\frac{f(x,y,z+h)-f(x,y,z)}{h}
\end{equation*}
When multiple variables are used with notation \(u=f(x_1, x_2, \dots, x_n)\text{,}\)
\begin{equation*}
\frac{\partial f}{\partial x_i} = \lim_{h \to 0}\frac{f(x_1, \dots , x_{i-1}, x_i+h, x_{i+1},\dots,x_n)-f(x_1,\dots,x_i,\dots,x_n)}{h}
\end{equation*}
As above, effectively all variables except one [\(x_i\)] are treated as constants in the formula for \(f\text{,}\) and one then computes as one would the derivative with respect to that one remaining variable.
Other notations include \(\ds
\frac{\partial u}{\partial x_i} = \frac{\partial f}{\partial x_i} = \partial_{x_i} f = f_{x_i} = f_i = D_i f
\text{.}\)
Subsection 4.3.6 Second Partial Derivatives
As with ordinary derivatives one can compute partial derivatives of partial derivatives. The most methodical notations are things like \((f_x)_y\) for the derivative with respect to \(y\) of the derivative with respect to \(x\) of \(f\text{.}\)
A variety of more concise notations are used:
\begin{equation*}
(f_x)_x = f_{xx} = f_{11} = \frac{\partial}{\partial x}\frac{\partial f}{\partial x} = \frac{\partial^2 f}{\partial x^2} = \frac{\partial^2 z}{\partial x^2} = D_1^2f = D_x^2f
\end{equation*}
\begin{equation*}
(f_x)_y = f_{xy} = f_{12} = \frac{\partial}{\partial y}\frac{\partial f}{\partial x} = \frac{\partial^2 f}{\partial y \partial x} = \frac{\partial^2 z}{\partial y \partial x} = D_2D_1 f = D_yD_x f
\end{equation*}
\begin{equation*}
(f_y)_x = f_{yx} = f_{21} = \frac{\partial}{\partial x}\frac{\partial f}{\partial y} = \frac{\partial^2 f}{\partial x \partial y} = \frac{\partial^2 z}{\partial x \partial y} = D_1D_2 f = D_xD_y f
\end{equation*}
\begin{equation*}
(f_y)_y = f_{yy} = f_{22} = \frac{\partial}{\partial y}\frac{\partial f}{\partial y} = \frac{\partial^2 f}{\partial y^2} = \frac{\partial^2 z}{\partial x^y} = D_2^2 f = D_y^2 f
\end{equation*}
In the middle two, note the different order of \(x\) an \(y\) in the different notations, according to whether new derivatives are added to the right or the left.
Subsection 4.3.7 Does the Order of Derivatives Matter?
In mixed derivatives like \(f_{xy}\) and \(f_{yx}\text{,}\) the order often does not matter, though this is far from obvious:
Theorem 4.3.2. (Clairaut).
If \(f\) is defined on an open set \(D\) that contains the point \((a,b)\text{,}\) both partial derivatives \(f_{xy}\) and \(f_{yx}\) exist, and both are continuous on that disk, then
\begin{equation*}
f_{xy}(a,b) = f_{yx}(a,b)
\end{equation*}
In particular, if these two mixed derivatives exist and are continuous everywhere, they are equal everywhere.
Subsection 4.3.8 Higher Derivatives
Differentation can be done repeatedly (so long as the derivatives exist), and with any number of variables, with notations like \(f_{xyy}\text{,}\) \(f_{xyzx}\text{,}\) \(\ds\frac{\partial^3 f}{\partial x \partial y \partial z}\) and so on.
Repeated application of Clairaut’s Theorem typically allows reordering of the derivatives, greatly reducing the number of different higher partial derivatives that need to be computed.
Subsection 4.3.9 Partial Differential Equations
Many physical laws describe a function of several variables in terms of an equation relating its partial derivatives. Three of the most important basic ones for functions of two variables are
- The Wave Equation
- \(u_{tt} = c^2u_{xx}\)
- The Heat Equation
- \(u_{t} = K u_{xx}\)
- Laplace’s Equation
- \(u_{xx} + u_{yy} = 0\)
- Poisson’s Equation
- \(u_{xx} + u_{yy} = f(x, y)\)
- Schrödinger’s Equation
- \(i \hbar \psi_t = -\ds\frac{\hbar^2}{2 m} ( \psi_{xx} + \psi_{yy} + \psi_{zz} ) + V(x, y, z, t) \psi\)
Question 4.3.3.
Verify that \(u(t,x)=e^{-t}\sin x\) is a solution of the heat equation.
Study Guide.
The Definitions.
Clairaut’s Theorem.
All the Examples (and the Checkpoints following each).
One or several exercises from each of the following ranges: 112–117, 118–128, 129–131, 132–133, 135–140, 145–148.