◀ Back to Note

Tony's Intertwingled Memex • Reference Manual

Critical Points in Multivariable Functions

Formulas & Definitions
Core Definition

Let z=f(x,y)z = f(x, y)z=f(x,y) be a scalar function of two variables defined on an open set in R2\mathbb{R}^2R2. A point (a,b)(a, b)(a,b) in the domain of fff is a critical point (or stationary point) of fff if either:

  1. The gradient vector vanishes simultaneously:
    ∇f(a,b)=0  ⟺  ∂f∂x(a,b)=0and∂f∂y(a,b)=0\nabla f(a, b) = \mathbf{0} \iff \frac{\partial f}{\partial x}(a, b) = 0 \quad \text{and} \quad \frac{\partial f}{\partial y}(a, b) = 0∇f(a,b)=0⟺∂x∂f​(a,b)=0and∂y∂f​(a,b)=0
  2. Or at least one of the first-order partial derivatives ∂f∂x\frac{\partial f}{\partial x}∂x∂f​ or ∂f∂y\frac{\partial f}{\partial y}∂y∂f​ does not exist at (a,b)(a, b)(a,b).

For functions of three variables w=f(x,y,z)w = f(x, y, z)w=f(x,y,z), a point (a,b,c)(a, b, c)(a,b,c) is a critical point if ∇f(a,b,c)=⟨0,0,0⟩=0\nabla f(a, b, c) = \langle 0, 0, 0 \rangle = \mathbf{0}∇f(a,b,c)=⟨0,0,0⟩=0 or if any first partial derivative fails to exist.


Concept Explanation

Geometric Meaning: The Flat Tangent Plane

In single-variable calculus, critical points occur where the tangent line is horizontal (f′(x)=0f'(x) = 0f′(x)=0) or sharp/undefined. In multivariable calculus, for a surface z=f(x,y)z = f(x, y)z=f(x,y), the tangent plane equation at (a,b,f(a,b))(a, b, f(a, b))(a,b,f(a,b)) is given by:

z−f(a,b)=fx(a,b)(x−a)+fy(a,b)(y−b)z - f(a, b) = f_x(a, b)(x - a) + f_y(a, b)(y - b)z−f(a,b)=fx​(a,b)(x−a)+fy​(a,b)(y−b)

When (a,b)(a, b)(a,b) is a critical point where fx(a,b)=0f_x(a, b) = 0fx​(a,b)=0 and fy(a,b)=0f_y(a, b) = 0fy​(a,b)=0, the tangent plane simplifies directly to:

z=f(a,b)z = f(a, b)z=f(a,b)
This means the tangent plane is completely horizontal (parallel to the xyxyxy-plane). At this point, the surface has zero slope along the xxx-axis, zero slope along the yyy-axis, and in fact zero directional derivative in every direction u⃗\vec{u}u:
Du⃗f(a,b)=∇f(a,b)⋅u⃗=0⋅u⃗=0D_{\vec{u}} f(a, b) = \nabla f(a, b) \cdot \vec{u} = \mathbf{0} \cdot \vec{u} = 0Du​f(a,b)=∇f(a,b)⋅u=0⋅u=0

               z ^
                 |        Flat Tangent Plane: z = f(a, b)
                 |        +-------------------------+
                 |       /                         /
                 |      /            * (a, b, f)  /
                 |     +-------------------------+
                 |                .-'   '-.
                 |              .'         '.
                 |             /   Surface   \
                 |
                 +----------------------------------> y
                /
               /
            x v

Critical Points vs. Extrema

Locating a critical point is a necessary condition for an interior local extremum of a differentiable function (Fermat's Theorem for Multivariable Functions):

  • If fff has a local maximum or local minimum at an interior point (a,b)(a, b)(a,b), and the first partial derivatives exist, then ∇f(a,b)=0\nabla f(a, b) = \mathbf{0}∇f(a,b)=0.
  • However, having ∇f(a,b)=0\nabla f(a, b) = \mathbf{0}∇f(a,b)=0 is not sufficient to guarantee a maximum or minimum. The point could be a saddle point (where the surface curves upward in one direction and downward in another), or an inflection trough. Classifying the nature of a critical point requires The Second Derivative Test.

Step-by-Step Procedure to Locate Critical Points

  1. Compute First Partial Derivatives: Calculate the symbolic expressions for fx(x,y)f_x(x, y)fx​(x,y) and fy(x,y)f_y(x, y)fy​(x,y) across the domain.
  2. Formulate the Simultaneous System: Set both partial derivatives equal to zero:
    {fx(x,y)=0fy(x,y)=0\begin{cases} f_x(x, y) = 0 \\ f_y(x, y) = 0 \end{cases}{fx​(x,y)=0fy​(x,y)=0​
  3. Solve the System Algebraically:
    • Look for single-variable equations first to isolate numerical values.
    • If equations are coupled or non-linear, factor where possible, or substitute expressions (e.g., y=g(x)y = g(x)y=g(x)) into the other equation.
    • Caution: Avoid dividing both sides of an equation by a variable expression without first checking if that variable could equal zero.
  4. Identify Singular Points: Check the original domain of fff for points where fxf_xfx​ or fyf_yfy​ ceases to exist (e.g., roots in denominators, cone vertices like f(x,y)=x2+y2f(x, y) = \sqrt{x^2 + y^2}f(x,y)=x2+y2​).

Engineering Applications

  • Aerospace & Mechanical Engineering: Equilibrium configurations of mechanical mechanisms occur at stationary points of the potential energy surface V(q1,q2)V(q_1, q_2)V(q1​,q2​). Setting ∇V=0\nabla V = \mathbf{0}∇V=0 yields the equilibrium states of linkages and robotic trusses.
  • Electrical Engineering: Static bias points in multi-transistor analog circuits correspond to critical points of node-voltage equations, ensuring amplifiers operate in their linear active regions without clipping.
  • Chemical Engineering: In thermodynamic phase equilibrium, stationary points of the Gibbs free energy function determine the coexistence of vapor and liquid phases in distillation columns.

Example Problems

Example 1: Decoupled Polynomial Critical Points

Find all critical points of the function:

f(x,y)=x3−3x+y2−4y+7f(x, y) = x^3 - 3x + y^2 - 4y + 7f(x,y)=x3−3x+y2−4y+7

Solution
  1. Compute first partial derivatives:

    fx(x,y)=∂∂x(x3−3x+y2−4y+7)=3x2−3f_x(x, y) = \frac{\partial}{\partial x}(x^3 - 3x + y^2 - 4y + 7) = 3x^2 - 3fx​(x,y)=∂x∂​(x3−3x+y2−4y+7)=3x2−3
    fy(x,y)=∂∂y(x3−3x+y2−4y+7)=2y−4f_y(x, y) = \frac{\partial}{\partial y}(x^3 - 3x + y^2 - 4y + 7) = 2y - 4fy​(x,y)=∂y∂​(x3−3x+y2−4y+7)=2y−4

  2. Set each partial derivative to zero:

    3x2−3=0  ⟹  3(x2−1)=0  ⟹  x=1orx=−13x^2 - 3 = 0 \implies 3(x^2 - 1) = 0 \implies x = 1 \quad \text{or} \quad x = -13x2−3=0⟹3(x2−1)=0⟹x=1orx=−1
    2y−4=0  ⟹  2y=4  ⟹  y=22y - 4 = 0 \implies 2y = 4 \implies y = 22y−4=0⟹2y=4⟹y=2

  3. Assemble coordinate pairs: Combining the xxx-solutions with the unique yyy-solution yields two distinct critical points:

    (1,2)and(−1,2)(1, 2) \quad \text{and} \quad (-1, 2)(1,2)and(−1,2)


Example 2: Coupled Non-Linear Critical Points

Find all critical points of the function:

f(x,y)=y3−3xy+12xf(x, y) = y^3 - 3xy + 12xf(x,y)=y3−3xy+12x

Solution
  1. Compute first partial derivatives:

    fx(x,y)=∂∂x(y3−3xy+12x)=−3y+12f_x(x, y) = \frac{\partial}{\partial x}(y^3 - 3xy + 12x) = -3y + 12fx​(x,y)=∂x∂​(y3−3xy+12x)=−3y+12
    fy(x,y)=∂∂y(y3−3xy+12x)=3y2−3xf_y(x, y) = \frac{\partial}{\partial y}(y^3 - 3xy + 12x) = 3y^2 - 3xfy​(x,y)=∂y∂​(y3−3xy+12x)=3y2−3x

  2. Solve the simultaneous system: Set fx=0f_x = 0fx​=0:

    −3y+12=0  ⟹  3y=12  ⟹  y=4-3y + 12 = 0 \implies 3y = 12 \implies y = 4−3y+12=0⟹3y=12⟹y=4
    Substitute y=4y = 4y=4 into fy=0f_y = 0fy​=0:
    3(4)2−3x=0  ⟹  3(16)−3x=0  ⟹  48=3x  ⟹  x=163(4)^2 - 3x = 0 \implies 3(16) - 3x = 0 \implies 48 = 3x \implies x = 163(4)2−3x=0⟹3(16)−3x=0⟹48=3x⟹x=16

  3. Conclusion: There is exactly one critical point:

    (16,4)(16, 4)(16,4)


Connections & References

  • Prerequisites:
    • Partial Derivatives — Calculating fxf_xfx​ and fyf_yfy​.
    • The Gradient Vector — Vector definition ∇f=⟨fx,fy⟩=0\nabla f = \langle f_x, f_y \rangle = \mathbf{0}∇f=⟨fx​,fy​⟩=0.
  • Direct Successors:
    • Second Derivative Test for Multivariable Functions — Classifying critical points as local maxima, minima, or saddle points.
    • Extrema on Closed and Bounded Regions — Finding candidate points for global optimization.
    • Lagrange Multipliers — Finding constrained critical points along restricted boundaries.
  • Course Sessions:
    • Session 13 - Optimization with Constraints