13 Functions of Several Variables

13.8 Extreme Values

Given a function z=f(x,y), we are often interested in points where z takes on the largest or smallest values. For instance, if z represents a cost function, we would likely want to know what (x,y) values minimize the cost. If z represents the ratio of a volume to surface area, we would likely want to know where z is greatest. This leads to the following definition.

Definition 13.8.1 Relative and Absolute Extrema

Let z=f(x,y) be defined on a set S containing the point P=(x0,y0).

  1. (a)

    If there is an open disk D so that S contains D which contains P and f(x0,y0)f(x,y) for all (x,y) in D, then f has a relative maximum at P; if f(x0,y0)f(x,y) for all (x,y) in D, then f has a relative minimum at P.

  2. (b)

    If f(x0,y0)f(x,y) for all (x,y) in S, then f has an absolute maximum at P; if f(x0,y0)f(x,y) for all (x,y) in S, then f has an absolute minimum at P.

  3. (c)

    If f has a relative maximum or minimum at P, then f has a relative extremum at P; if f has an absolute maximum or minimum at P, then f has an absolute extremum at P.

If f has a relative or absolute maximum at P=(x0,y0), it means every curve on the surface of f through P will also have a relative or absolute maximum at P. Recalling what we learned in Section 3.1, the slopes of the tangent lines to these curves at P must be 0 or undefined. Since directional derivatives are computed using fx and fy, we are led to the following definition and theorem.

Definition 13.8.2 Critical Point

Let z=f(x,y) be continuous on an open set S. A critical point P=(x0,y0) of f is a point in S such that

  • fx(x0,y0)=0 and fy(x0,y0)=0, or

  • fx(x0,y0) or fy(x0,y0) is undefined.

Theorem 13.8.1 Critical Points and Relative Extrema

Let z=f(x,y) be defined on an open set S containing P=(x0,y0). If f has a relative extrema at P, then P is a critical point of f.

Therefore, to find relative extrema, we find the critical points of f and determine which correspond to relative maxima, relative minima, or neither.

The following examples demonstrate this process.

Example 13.8.1 Finding critical points and relative extrema

Let f(x,y)=x2+y2-xy-x-2. Find the relative extrema of f.

SolutionWe start by computing the partial derivatives of f: margin:
(fullscreen)
Figure 13.8.1: The surface in Example 13.8.1 with its absolute minimum indicated. Λ

fx(x,y)=2x-y-1  and  fy(x,y)=2y-x.

Each is never undefined. A critical point occurs when fx and fy are simultaneously 0, leading us to solve the following system of linear equations:

2x-y-1=0  and  -x+2y=0.

This solution to this system is x=2/3, y=1/3. (Check that at (2/3,1/3), both fx and fy are 0.)

The graph in Figure 13.8.1 shows f along with this critical point. It is clear from the graph that this is a relative minimum; further consideration of the function shows that this is actually the absolute minimum.

Example 13.8.2 Finding critical points and relative extrema

Let f(x,y)=-x2+y2+2. Find the relative extrema of f.

SolutionWe start by computing the partial derivatives of f:

fx(x,y)=-xx2+y2  and  fy(x,y)=-yx2+y2.

It is clear that fx=0 when x=0 & y0, and that fy=0 when y=0 & x0. At (0,0), both fx and fy are not 0, but rather undefined. The point (0,0) is still a critical point, though, because the partial derivatives are undefined. This is the only critical point of f.

margin:
(fullscreen)
Figure 13.8.2: The surface in Example 13.8.2 with its absolute maximum indicated. Λ

The surface of f is graphed in Figure 13.8.2 along with the point (0,0,2). The graph shows that this point is the absolute maximum of f.

In each of the previous two examples, we found a critical point of f and then determined whether or not it was a relative (or absolute) maximum or minimum by graphing. It would be nice to be able to determine whether a critical point corresponded to a max or a min without a graph. Before we develop such a test, we do one more example that sheds more light on the issues our test needs to consider.

Example 13.8.3 Finding critical points and relative extrema

Let f(x,y)=x3-3x-y2+4y. Find the relative extrema of f.

SolutionOnce again we start by finding the partial derivatives of f:

fx(x,y)=3x2-3  and  fy(x,y)=-2y+4.

Each is always defined. Setting each equal to 0 and solving for x and y, we find

fx(x,y)=0 x=±1
fy(x,y)=0 y=2.

We have two critical points: (-1,2) and (1,2). To determine if they correspond to a relative maximum or minimum, we consider the graph of f in Figure 13.8.3. margin:
(fullscreen)
Figure 13.8.3: The surface in Example 13.8.3 with both critical points marked. Λ

The critical point (-1,2) clearly corresponds to a relative maximum. However, the critical point at (1,2) is neither a maximum nor a minimum, displaying a different, interesting characteristic.

If one walks parallel to the y-axis towards this critical point, then this point becomes a relative maximum along this path. But if one walks towards this point parallel to the x-axis, this point becomes a relative minimum along this path. A point that seems to act as both a max and a min is a saddle point. A formal definition follows.

Definition 13.8.3 Saddle Point

Let P=(x0,y0) be in the domain of f where fx=0 and fy=0 at P. We say P is a saddle point of f if, for every open disk D containing P, there are points (x1,y1) and (x2,y2) in D such that f(x0,y0)>f(x1,y1) and f(x0,y0)<f(x2,y2).

At a saddle point, the instantaneous rate of change in all directions is 0 and there are points nearby with z-values both less than and greater than the z-value of the saddle point.

Before Example 13.8.3 we mentioned the need for a test to differentiate between relative maxima and minima. We now recognize that our test also needs to account for saddle points. To do so, we consider the second partial derivatives of f.

Recall that with single variable functions, such as y=f(x), if f′′(c)>0, then f is concave up at c, and if f(c)=0, then f has a relative minimum at x=c. (We called this the Second Derivative Test.) Note that at a saddle point, it seems the graph is “both” concave up and concave down, depending on which direction you are considering.

It would be nice if the following were true:

fxx and fyy>0 relative minimum
fxx and fyy<0 relative maximum
fxx and fyy have opposite signs saddle point.

However, this is not the case. Functions f exist where fxx and fyy are both positive but a saddle point still exists. In such a case, while the concavity in the x-direction is up (i.e., fxx>0) and the concavity in the y-direction is also up (i.e., fyy>0), the concavity switches somewhere in between the x- and y-directions.

To account for this, consider D=fxxfyy-fxyfyx. Since fxy and fyx are equal when continuous (refer back to Theorem 13.3.1), we can rewrite this as D=fxxfyy-fxy 2. Then D can be used to test whether the concavity at a point changes depending on direction. If D>0, the concavity does not switch (i.e., at that point, the graph is concave up or down in all directions). If D<0, the concavity does switch. If D=0, our test fails to determine whether concavity switches or not. We state the use of D in the following theorem.

Theorem 13.8.2 Second Derivative Test

Let z=f(x,y) be defined on an open set containing a critical point P=(x0,y0) where all second order derivatives of f are continuous at P. Define

D=fxx(x0,y0)fyy(x0,y0)-fxy 2(x0,y0).
  1. (a)

    If D>0 and fxx(x0,y0)>0, then P is a relative minimum of f.

  2. (b)

    If D>0 and fxx(x0,y0)<0, then P is a relative maximum of f.

  3. (c)

    If D<0, then P is a saddle point of f.

  4. (d)

    If D=0, the test is inconclusive.

  • Proof


    Let u=h,k be a unit vector. Then at the critical point P, Duf=0. This means that along the line h(y-y0)=k(x-x0), P is a critical point that is a maximum or minimum according to the sign of Du2f. Now,

    Du2f =Du(fxh+fyk)
    =(fxh)xh+(fxh)yk+(fyk)xh+(fyk)
    =fxxh2+2fxyhk+fyyk2

    because fxy and fyx are continuous and therefore equal.

    Suppose now that D>0. Then we must have fxx0, and we can complete the square to see that

    Du2f=fxx(h+fxykfxx)2+fyyk2-fxy 2k2fxx=fxx[(h+fxykfxx)2+Dk2fxx 2].

    Because we assumed D>0, everything in the brackets is positive, and Du2f always has the same sign as fxx. This shows parts 1 and 2.

    If D<0, our task is easier because we only need to find two different u that give Du2f opposite signs. If fxx0, let v=-fxy,fxx and we can choose

    u1=1vvu2=1,0    Du12f=1v2fxxDDu22f=fxx.

    Similarly, if fyy0, let v=fyy,-fxy and we can choose

    u1=1vvu2=0,1    Du12f=1v2fyyDDu22f=fyy.

    Finally, if fxx=fyy=0, then Du2f=2fxyhk has opposite signs for the vectors u1=121,1 and u2=121,-1. ∎

We first practice using this test with the function in the previous example, where we visually determined we had a relative maximum and a saddle point.

Example 13.8.4 Using the Second Derivative Test

Let f(x,y)=x3-3x-y2+4y as in Example 13.8.3. Determine whether the function has a relative minimum, maximum, or saddle point at each critical point.

SolutionWe determined previously that the critical points of f are (-1,2) and (1,2). To use the Second Derivative Test, we must find the second partial derivatives of f:

fxx=6x;fyy=-2;fxy=0.

Thus D(x,y)=-12x.

At (-1,2): D(-1,2)=12>0, and fxx(-1,2)=-6. By the Second Derivative Test, f has a relative maximum at (-1,2).

At (1,2): D(1,2)=-12<0. The Second Derivative Test states that f has a saddle point at (1,2).

The Second Derivative Test confirmed what we determined visually.

Example 13.8.5 Using the Second Derivative Test

Find the relative extrema of f(x,y)=x2y+y2+xy.

SolutionWe start by finding the first and second partial derivatives of f:

fx =2xy+y fy =x2+2y+x
fxx =2y fyy =2
fxy =2x+1 fyx =2x+1.

We find the critical points by finding where fx and fy are simultaneously 0 (they are both never undefined). Setting fx=0, we have:

fx=02xy+y=0y(2x+1)=0.

This implies that for fx=0, either y=0 or 2x+1=0.

Assume y=0 then consider fy=0:

fy =0
x2+2y+x =0,and since y=0, we have
x2+x =0
x(x+1) =0.

Thus if y=0, we have either x=0 or x=-1, giving two critical points: (-1,0) and (0,0).

Going back to fx, now assume 2x+1=0, i.e., that x=-1/2, then consider fy=0:

fy =0
x2+2y+x =0,and since x=-1/2, we have
1/4+2y-1/2 =0
y =1/8.

Thus if x=-1/2, y=1/8 giving the critical point (-1/2,1/8).

With D=4y-(2x+1)2, we apply the Second Derivative Test to each critical point.

At (-1,0), D<0, so (-1,0) is a saddle point.

At (0,0), D<0, so (0,0) is also a saddle point.

At (-1/2,1/8), D>0 and fxx>0, so (-1/2,1/8) is a relative minimum. margin:
(fullscreen)
Figure 13.8.4: Graphing f from Example 13.8.5 and its relative extrema. Λ

Figure 13.8.4 shows a graph of f and the three critical points. Note how this function does not vary much near the critical points — that is, visually it is difficult to determine whether a point is a saddle point or relative minimum (or even a critical point at all!). This is one reason why the Second Derivative Test is so important to have.

Constrained Optimization

When optimizing functions of one variable such as y=f(x), we made use of Theorem 3.1.1, the Extreme Value Theorem, that said that over a closed interval I, a continuous function has both a maximum and minimum value. To find these maximum and minimum values, we evaluated f at all critical points in the interval, as well as at the endpoints (the “boundary”) of the interval.

A similar theorem and procedure applies to functions of two variables. A continuous function over a closed set also attains a maximum and minimum value (see the following theorem). We can find these values by evaluating the function at the critical points in the set and over the boundary of the set. After formally stating this extreme value theorem, we give examples.

Theorem 13.8.3 Extreme Value Theorem

Let z=f(x,y) be a continuous function on a closed, bounded set S. Then f has an absolute maximum and an absolute minimum value on S.

margin:
(fullscreen)
(a)y=3x+1y=-3/2x+1y=-2xy (b)
Figure 13.8.5: Plotting the surface of f along with the restricted domain S. Λ
Example 13.8.6 Finding extrema on a closed set

Let f(x,y)=x2-y2+5 and let S be the triangle with vertices (-1,-2), (0,1) and (2,-2). Find the maximum and minimum values of f on S.

SolutionIt can help to see a graph of f along with the set S. In Figure 13.8.5(a) the triangle defining S is shown in the x-y plane in a dashed line. Above it is the surface of f; we are only concerned with the portion of f enclosed by the “triangle” on its surface.

We begin by finding the critical points of f. With fx=2x and fy=-2y, we find only one critical point, at (0,0).

We now find the maximum and minimum values that f attains along the boundary of S, that is, along the edges of the triangle. In Figure 13.8.5(b) we see the triangle sketched in the plane with the equations of the lines forming its edges labeled.

Start with the bottom edge, along the line y=-2. If y is -2, then on the surface, we are considering points f(x,-2); that is, our function reduces to f(x,-2)=x2-(-2)2+5=x2+1=f1(x). We want to maximize/minimize f1(x)=x2+1 on the interval [-1,2]. To do so, we evaluate f1(x) at its critical points and at the endpoints. The critical points of f1 are found by setting its derivative equal to 0:

f1(x)=0    x=0,

so that we will need to evaluate f at the points (-1,-2), (0,-2), and (2,-2).

We need to do this process twice more, for the other two edges of the triangle.

Along the left edge, along the line y=3x+1, we substitute 3x+1 in for y in f(x,y):

f(x,y)=f(x,3x+1)=x2-(3x+1)2+5=-8x2-6x+4=f2(x).

We want the maximum and minimum values of f2 on the interval [-1,0], so we evaluate f2 at its critical points and the endpoints of the interval. We find the critical points:

f2(x)=-16x-6=0    x=-3/8,

so that we will need to evaluate f at the points (-1,-2), (-38,-18), and (0,1).

Finally, we evaluate f along the right edge of the triangle, where y=-3/2x+1.

f(x,y)=f(x,-3/2x+1)=x2-(-3/2x+1)2+5=-54x2+3x+4=f3(x).

The critical points of f3(x) are:

f3(x)=0    x=6/5,

so that we will need to evaluate f at the points (0,1), (65,-45), and (2,-2).

margin:
(fullscreen)
Figure 13.8.6: The surface of f along with important points along the boundary of S and the interior. Λ

We now evaluate f at a total of 7 different places, all shown in Figure 13.8.6.

f(-1,-2)=2,f(0,-2)=1,f(2,-2)=5,f(-38,-18)=418,f(0,1)=4,andf(65,-45)=295.

Of all the z-values found, the maximum is 295, found at (65,-45); the minimum is 1, found at (0,-2).

This portion of the text is entitled “Constrained Optimization” because we want to optimize a function (i.e., find its maximum and/or minimum values) subject to a constraint — some limit to what values the function can attain. In the previous example, we constrained ourselves by considering a function only within the boundary of a triangle. This was largely arbitrary; the function and the boundary were chosen just as an example, with no real “meaning” behind the function or the chosen constraint.

However, solving constrained optimization problems is a very important topic in applied mathematics. The techniques developed here are the basis for solving larger problems, where more than two variables are involved.

We illustrate the technique once more with a classic problem.

Example 13.8.7 Constrained Optimization

The U.S. Postal Service states that the girth+length of Standard Post Package must not exceed 130”. Given a rectangular box, the “length” is the longest side, and the “girth” is twice the width+height.

Given a rectangular box where the width and height are equal, what are the dimensions of the box that give the maximum volume subject to the constraint of the size of a Standard Post Package?

SolutionLet w, h, and denote the width, height, and length of a rectangular box; we assume here that w=h. The girth is then 2(w+h)=4w. The volume of the box is V(w,)=wh=w2. We wish to maximize this volume subject to the constraint 4w+130, or 130-4w. (Common sense also indicates that >0,w>0, so that we don’t need to check the boundary where either is zero.)

We begin by finding the critical points of V. We find that Vw=2w and V=w2; these are simultaneously 0 only when w=0. These give a volume of 0, so we can ignore these critical points.

We now consider the volume along the constraint =130-4w. Along this line, we have:

V(w,)=V(w,130-4w)=w2(130-4w)=130w2-4w3=V1(w).

The constraint is applicable on the w-interval [0,32.5] as indicated in the figure. Thus we want to maximize V1 on [0,32.5].

Finding the critical points of V1, we take the derivative and set it equal to 0:

V1(w)=260w-12w2=0w(260-12w)=0w=0,2601221.67.

We found two critical points: when w=0 and when w=21.67. We again ignore the w=0 solution; the maximum volume, subject to the constraint, comes at w=h=21.67, =130-4(21.6)=43.33. This gives a volume of V(21.67,43.33)20,347in3.

margin:
(fullscreen)
Figure 13.8.7: Graphing the volume of a box with girth 4w and length , subject to a size constraint. Λ

The volume function V(w,) is shown in Figure 13.8.7 along with the constraint =130-4w. As done previously, the constraint is drawn dashed in the x-y plane and also along the surface of the function. The point where the volume is maximized is indicated.

It is hard to overemphasize the importance of optimization. In “the real world,” we routinely seek to make something better. By expressing the something as a mathematical function, “making something better” means “optimize some function.

The techniques shown here are only the beginning of an incredibly important field. Many functions that we seek to optimize are incredibly complex, making the step of “find the gradient and set it equal to 0” highly nontrivial. Mastery of the principles here are key to being able to tackle these more complicated problems.

Exercises 13.8

 

Terms and Concepts

  1. 1.

    T/F: Theorem 13.8.1 states that if f has a critical point at P, then f has a relative extrema at P.

  2. 2.

    T/F: A point P is a critical point of f if fx and fy are both 0 at P.

  3. 3.

    T/F: A point P is a critical point of f if fx or fy are undefined at P.

  4. 4.

    Explain what it means to “solve a constrained optimization” problem.

Problems

In Exercises 5–18., find the critical points of the given function. Use the Second Derivative Test to determine if each critical point corresponds to a relative maximum, minimum, or saddle point.

  1. 5.

    f(x,y)=12x2+2y2-8y+4x

  2. 6.

    f(x,y)=x2+4x+y2-9y+3xy

  3. 7.

    f(x,y)=x2+3y2-6y+4xy

  4. 8.

    f(x,y)=1x2+y2+1

  5. 9.

    f(x,y)=x2+y3-3y+1

  6. 10.

    f(x,y)=13x3-x+13y3-4y

  7. 11.

    f(x,y)=x2y2

  8. 12.

    f(x,y)=x4-2x2+y3-27y-15

  9. 13.

    f(x,y)=16-(x-3)2-y2

  10. 14.

    f(x,y)=x2+y2

  11. 15.

    f(x,y)=x3+3xy2-3x2-3y2+4

  12. 16.

    f(x,y)=y3+x2-6xy+3x+6y-7

  13. 17.

    f(x,y)=3x2y+x2-6x-3y-2

  14. 18.

    f(x,y)=(x2+3y2)e-2x

In Exercises 19–24., find the absolute maximum and minimum of the function subject to the given constraint.

  1. 19.

    f(x,y)=x2+y2+y+1, constrained to the triangle with vertices (0,1), (-1,-1) and (1,-1).

  2. 20.

    f(x,y)=5x-7y, constrained to the region bounded by y=x2 and y=1.

  3. 21.

    f(x,y)=x2+2x+y2+2y, constrained to the region bounded by the circle x2+y2=4.

  4. 22.

    f(x,y)=3y-2x2, constrained to the region bounded by the parabola y=x2+x-1 and the line y=x.

  5. 23.

    f(x,y)=4(x+y)-(2x2+y2), constrained to the square with vertices (0,0), (3,0), (3,3), and (0,3).

  6. 24.

    f(x,y)=x2+xy+y2, constrained to the region bounded by the circle x2+y2=9.

  1. 25.

    Find the dimensions of the box without a top that has a volume of 500 and the least possible surface area.

  2. 26.

    Show that there are boxes without a top that have a volume of 500 and arbitrarily large surface area.

Modern Campus CMS