Skip to main content
Logo image

Chapter 25 Series

Section 25.1 Definitions and examples

Recall that our motivation for studying sequences was the sequence of approximation values one could obtain by approximating a specific function value using Taylor polynomials of increasing degree. Consider the example of approximating ln(1.001) from Section 22.1 once more. Using Taylor polynomials based at t=1, we have
ln(1.001)T0,1(1.001)=0ln(1.001)T1,1(1.001)=0+0.001ln(1.001)T2,1(1.001)=0+0.0010.00122ln(1.001)T3,1(1.001)=0+0.0010.00122+0.00136.
(This time we have included the “zero-degree” Taylor polynomial approximation value.) This creates a sequence (tn) where
tn=Tn,1(1.001)=0+0.0010.00122++(1)n10.001nn!.
If we allow the possibility of an “infinite-degree” Taylor polynomial T,1, computing a value like T,1(1.001) of such a “polynomial” would involve adding up an infinite number of summands, while each term tn from the sequence above represents a partial summation of only a finite number of summands.

Definition 25.1.1. Partial sum.

For an infinite sequence (an) and a specific index n, the sum
sn=k=0nak
is called the nth partial sum of (an). The sequence (sn) that indexes all such sums is called the sequence of partial sums for (an).

Example 25.1.2.

  1. Consider the sequence with terms an=1/10n:
    a0=1,a1=0.1,a2=0.01,.
    The associated partial sums are:
    s0=1,s1=1+0.1=1.1,s2=1+0.1+0.01=1.11,s3=1+0.1+0.01+0.001=1.111,.
    It certainly seems that if we let this process continue indefinitely, these partial sums would trend toward 1.1¯.
  2. Consider the sequence (bn) whose terms are the digits of π:
    b0=3,b1=1,b2=4,b3=1,b4=5,b5=9,.
    Then create a new sequence with terms an=bn/10n. The partial sums for (an) are:
    s0=3,s1=3+0.1=3.1,s2=3+0.1+0.04=3.14,s3=3+0.1+0.04+0.001=3.141,s4=3+0.1+0.04+0.001+0.0005=3.1415,s5=3+0.1+0.04+0.001+0.0005+0.00009=3.14159,.
    It certainly seems that if we let this process continue indefinitely, these partial sums would trend toward π.
The preceding example demonstrates that sometimes partial sums can exhibit a specific pattern. But sometimes they do not.

Example 25.1.3.

Consider the sequence (an) with terms an=(1)nn2:
a0=0,a1=1,a2=4,a3=9,a4=16,.
The associated partial sums are:
s0=0,s1=0+(1)=1,s2=0+(1)+4=3,s3=0+(1)+4+(9)=6,s4=0+(1)+4+(9)+16=10,s5=0+(1)+4+(9)+16+(25)=15,.
These partial sums are oscillating between increasingly large positive and negative numbers, so there is no trend toward any specific number.

Definition 25.1.4. Infinite series.

Write
k=0ak
(or sometimes just ak) to represent the limit of the sequence of partial sums for the sequence (an), called an infinite series. We say that the series converges/diverges if the sequence of partial sums does.

Example 25.1.5.

We have already seen in Example 25.1.2 that
k=010k=109,k=0ak=π,
where (an) is the sequence of digits of π.

Remark 25.1.6.

Every real number r is equal to the series formed by the digits in its decimal expansion:
r=k=Nrk10k,
where each rk is an integer between 0 and 9 (inclusive) and N is the highest “place” that a non-zero digit appears. For example, for r=9876 then N=3 because the first digit r3=9 appears in the thousands (103) place, but for r=0.009876 then N=3 because the first digit r3=9 appears in the thousandths (103) place.
In a sense, this is what decimal expansion means as an expression of a real number.

Warning 25.1.7.

The usual associative and commutative properties of addition DO NOT apply to the terms in an infinite series.

Example 25.1.8. Grouping terms can produce an incorrect result.

Consider the “alternating” series
k=0(1)k=1+(1)+1+(1)+1+(1)+.
It is tempting to use the associative property of addition and group terms in this sum as follows:
k=0(1)k=?(1+(1))+(1+(1))+(1+(1))+=0+0+0+=0.
However, this would not be the correct result based on the definition of Infinite series. Instead of performing this dubious manipulation of the terms of the sequence, we should consider the sequence of partial sums:
s0=1s1=1+(1)=0s2=1+(1)+1=1s3=1+(1)+1+(1)=0.
As you can see, the sequence (sn) oscillates between 1 and 0, and so cannot converge to any specific value. In fact, the infinite series (1)k diverges.

Example 25.1.9. Re-ordering terms can produce different results.

It is possible to demonstrate that the alternating harmonic series
k=1(1)k1k=1+(12)+13+(14)+
converges to ln(2). (See Subsection 26.4.4.) In the Sage cell below you can investigate the behaviour of the partial sums numerically. Try increasing the partial sum upper bound value n to see how the partial sum values appear to approach ln(2).
However, if we rearrange the terms of the sequence we actually get a different result. It is possible to demonstrate that
1+13+(12)+15+17+(14)+=32ln(2).
Again, the Sage cell below is provided for you to investigate this convergence numerically.
In fact, it is a theorem of Riemann that the terms of this sequence can be rearranged to add up to any value you like! Suppose you would like the rearranged series to add up to a specific number s. Just add up positive terms until your partial sum is greater than s, then add on negative terms until your partial sum is less than s, then more positive terms until the partial sum is greater than s again, and so on. Try it with s equal to your favourite number!
While you shouldn’t rearrange/simplify an infinite sum, you certainly can rearrange/simplify the partial sums as you investigate the convergence of the infinite sum.

Example 25.1.10. A telescoping sum.

Consider
k=12k(k+2).
The terms can be rewritten as
2k(k+2)=1k1k+2,
and so the nth partial sum is
sn=k=1n(1k1k+2)=k=1n1kk=1n1k+2.
More explicitly,
sn=1+12+13+14++1n13141n1n+11n+2.
You can see that most of the terms of in the two finite sums will cancel, leaving only
sn=1+12+1n+1+1n+2.
But as n, the terms with n in the denominator will become negligibly small, and so (sn)1+12. That is,
k=12k(k+2)=32.
The following is an extremely important general example.

Justification of Statement 1.

For all values of r, the partial sum sn is
sn=k=0nrk=1+r+r2++rn.
Notice what happens if we multiply a partial sum by r and subtract:
sn=1+r+r2++rnrsn=r+r2++rn+rn+1snrsn=1rn+1.
Factoring the common sn on the left, we have
sn(1r)=1rn+1.
If r1, then 1r0 and we may divide both sides to obtain
sn=1rn+11r.

Justification of Statement 2.

Convergence of an infinite series is defined by the convergence of its sequence of partial sums. We will break the assumption 1<r<1 into several cases.
Case r=0.
Recall that in this case we are taking the first term in the series to be 1. But all other terms in the series are 0n=0, so that sn=1 for all n. Thus (sn) is a constant sequence that converges to 1, which agrees with the value of the conjectured formula 1/(1r) when r=0.
Case 0<r<1.
In this case the exponential function f(t)=rt represents exponential decay, and the terms of the sequence (rn+1) are discrete values along that decay curve. So we conclude that (rn+1)0 and
sn=1rn+11r11r,
as conjectured.
Case 1<r<0.
In this case 0<|r|<1, and both the exponential function f(t)=|r|t and its vertical reflection g(t)=|r|t have a horizontal asymptote at y=0. With a negative base r, the terms of the sequence (rn+1) bounce between the two curves, but still trend to 0 along with the curves. So again (rn+1)0 and
sn=1rn+11r11r,
as conjectured.

Justification of Statement 3.

Again we will consider different cases.
Case r=1.
In this case we have
sn=10+11+12++1n=n+1,
and this sequence clearly diverges to infinity.
Case r=1.
In this case the partial sums alternate between 1 and 0, and so diverge.
Case r>1.
In this case the exponential function f(t)=rt represents exponential growth, and the sequence (rn+1) diverges to infinity along with that function. Therefore, the formula for the partial sums provided by Statement 1 also diverges.
Case r<1.
As in the case 1<r<0 in the justification for Statement 2, when r is negative the terms of the sequence (rn+1) are bouncing between values on the graphs of the exponential function f(t)=|r|t and its vertical reflection. But this time, if r<1 then both these exponential functions experience unbounded growth, one in a positive direction and the other in a negative direction, so (rn+1) diverges. Therefore, the formula for the partial sums provided by Statement 1 also diverges.

Example 25.1.12. Two important geometric series.

  1. The infinite series of the sequence (1/2k) is geometric with r=1/2, which converges since 1/2 is less than 1, and we have
    k=012k=111/2=2.
  2. The infinite series of the sequence (1/10k) is geometric with r=1/10, which converges since 1/10 is less than 1, and we have
    k=0110k=111/10=109.
    We already looked at this series in Series 1 of Example 25.1.2 — you may wish to go back and compare the conjectured sum result expressed as a decimal with the result above.

Section 25.2 Properties

An infinite series can be thought of as an improper integral of a step function:
k=0ak=0a(t)dt,
where a(t) is the step function that takes on value a(t)=ak on the subdomain kt<k+1. Effectively we are viewing the infinite series as a regular Riemann sum with Δt=1, but with an unbounded domain (hence an infinite number of rectangles). From this point of view, partial sum effectively becomes the same thing as partial area. Usually Riemann sums are only an approximation of a definite integral, but in this case it is an equality because the function being integrated is already a step function.
With this in mind, the properties of infinite series mirror the properties of improper integrals.

Justification.

Suppose k1<k2. Then
k=k1ak=limnk=k1nak=limn(k=k1k21ak+k=k2nak)=k=k1k21ak+limnk=k2nak=k=k1k21ak+k=k2ak.
Since the sum over indices k1kk21 is just a number, the two series must both converge or both diverge.

Example 25.2.3.

We’ve previously seen that (1/2k)=2, so
k=312k=k=012kk=0212k=2(1+12+14)=14.
We may extend some of the patterns of finite sums (Subsection 5.3.2) to infinite series.

Example 25.2.5. Splitting an infinite series.

The series
k=05k+210k
looks complicated at first glance, but we can split it into two geometric series that we’ve already computed:
k=05k+210k=k=0(5k10k+210k)=k=05k10k+k=0210k=k=012k+2k=0110k=2+2109=389.
You may have heard that if a decimal number exhibits some repeating pattern in its decimal expansion, then it must be a rational number. Turning a rational number into a decimal one is not difficult: just use long division. Here is an example of turning a decimal number with a repeating pattern back into a rational number, using geometric series along with Property 1 of Pattern 25.2.4.

Example 25.2.6. Expressing a decimal as a fraction.

Let’s turn 2.317 back into a fraction. Because the repeating pattern is two digits long, instead of grouping digit-by-digit we’ll group them in pairs:
2.3171717=2310+17103+17105+=2310+17103(1+1102+1104+)=2310+171000k=01100k.
The series (1/100k) is geometric with r=100, so
2.317=2310+171000k=01100k=2310+171000111/100=2310+17100010099=2310+17990=2399+17990=2294990=1147495.
Just as with Fact 24.2.3, to be able to add an infinite number of terms those terms must tend to 0.

Justification.

Let (sn) be the sequence of partial sums. As ak converges, we have (sn)L for some limit value L. Let (tn) be the sequence of “delayed” partial sums: for n1 set
tn=k=0n1an
(and we’ll set t0=0). Then also (tn)L. By the Sequence limit laws, the difference sequence (sntn) converges to LL=0. But the terms of the difference sequence for n1 are
sntn=k=0nakk=0n1ak=[(k=0n1ak)+an]k=0n1ak=an
(and also s0t0=a00=a0). So the difference sequence (sntn) is identical to the sequence (an). Since we have determined that (sntn)0, then also (an)0.

Warning 25.2.8.

Do not get Fact 25.2.7 backwards! The next (important!) example will demonstrate that knowing (an)0 is not sufficient for ak to converge.

Example 25.2.9. Harmonic Series.

The infinite series 1/k (beginning at index k=1) has (1/n)0, but does not converge. To see this, we’ll consider a particular subsequence of the sequence of partial sums. But first, some analysis of some “partial” partial sums. Because this sequence is decreasing, in any sum of consecutive terms we can replace all terms by the last term and end up with a smaller result:
k=mn1k=1m+1m+1++1n>1n+1n++1n=nm+1n.
In particular, a “partial” partial sum between two indices that are consecutive powers of 2 exhibits the following pattern:
k=2m1+12m1k>2m(2m1+1)+12m=2m2m12m=22m112m12m=2m12m=12.
Now let’s use the inequality above to look at the subsequence of partial sums where the index is a power of 2:
s1=1s2=1+12=32s4=s2+k=341k>32+12=42s8=s4+k=581k>42+12=52s16=s8+k=9161k>52+12=62.
The pattern continues, so that
s2nn+22.
(We have used “or equal” here so that s1 and s2 can be included.) This particular subsequence of the sequence of partNow let’s use the ial sums diverges to infinity, hence it is not possible for the full sequence of partial sums to converge (see Pattern 22.3.13).

Example 25.2.10. Changing variables in a series.

We would expect the series 1/(k+1) to diverge because the terms are so similar to the harmonic series. In fact, by changing variables we see that this series is exactly the harmonic series. Let m=k+1. As k increments through the values 0,1,2,3,, m will increment through the values 1,2,3,4,. Then we have
k=01k+1=m=11m,
and so the series 1/(k+1) must diverge, being equivalent to the divergent harmonic series.
The contrapositive of Fact 25.2.7 is often useful to avoid unnecessary work.

Example 25.2.12.

The infinite series
k=02k33k+1k3+k25
must diverge because
(2k33k+1k3+k25)2.
In the case that the terms of (an) are non-negative, then the partial sums of ak are increasing (or, at least, non-decreasing), so their convergence is dependent on being bounded.

Example 25.2.14.

We have seen that the Harmonic Series 1/k diverges, not unlike the fact that the improper integral of 1/t diverges as t. Since the improper integral of 1/t2 converges, might we expect the infinite series 1/k2 to converge?
The terms of the sequence (1/n2) are all positive, so let’s try to bound the partial sums. Here we will take the opposite approach as in Example 25.2.9: we’ll compare “partial” partial sums to a larger value by replacing each term by the first. Since (1/k2) is a decreasing sequence, we have
k=mn1k2=1m2+1(m+1)2++1n2<1m2+1m2++1m2=nm+1m2.
Simiarly to Example 25.2.9, apply this to “partial” partial sums between indices that are consecutive two powers of 2:
k=2m2m+111k2<(2m+11)2m+1(2m)2=22m12m(2m)2=2m(2m)2=12m.
Now let’s use the inequality above to look at the subsequence of partial sums where the index is one less than a power of 2:
s1=1s3=1+k=231k2<1+12=32s7=s3+k=471k2<32+14=74s15=s7+k=8151k2<74+18=158.
The pattern continues, so that
s2n12n12n1<2n2n1=2.
But since the terms of (1/n2) are positive, the sequence of partical sums is increasing. And for all n1, we have n2n1, so that
sns2n1<2.
As the sequence of partial sums is monotonic and bounded, it must converge.
We know that for an infinite series ak to converge, it is necessary (but not sufficient) for (an)0. But even more, when the series does converge, the “amount left to add” must be getting small as well.

Justification.

Let (sn) be the sequence of partial sums of the full infinite series ak beginning at index k=0, and let S represent the sum value of that convergent series. Because (sn)S, applying Fact 22.3.31 tells us that (Ssn)0. Now, note that every term of (rn) is actually defined, because if ak converges beginning at index 0, then it converges beginning at any index, and in fact we have
rn=k=0akk=0nak=Ssn
from Fact 25.2.1. Thus (rn)=(Ssn)0.

Section 25.3 Comparison tests

Here we repeat the introductory remarks we made for comparison tests for improper integrals (see the beginning of Section 24.3) in the context of series. Fact 25.2.7 says that we need (an)0 for ak to converge, but Example 25.2.9 demonstrates that this is not sufficient; if (an)0 too slowly, then the series will diverge. The comparison tests in this section allow us to determine convergence without actually computing the sum value, by comparing the series to one whose convergence is already known. But we will also add a new technique: considering the remarks made at the beginning of Section 25.2 concerning the analogy between infinite series and improper integrals, we can also compare convergence across this analogy.

Subsection 25.3.1 Integral comparison test

Justification.
For simplicity, we will prove this for k0=0; every other starting index/domain boundary then just represents a “shift” of the k0=0 case.
Define the integral function
F(t)=0tf(u)du,
which is continuous on domain t0 by the Fundamental Theorem of Calculus. By definition, we have
0f(t)dt=limtF(t).
Note that F(t) is an increasing function, as we are accumulating more area as the integration domain endpoint t increases. (And the derivative function F(t)=f(t) is positive, as we have assumed that f(t) is a positive function.)
As usual, let (sn) be the sequence of partial sums for the infinite series f(k). Let (n) and (un) be the sequences with terms
n=sns0un=sn1=k=1nf(k)=k=0n1f(k).
(Take u0=0.) Then for n1, each n can be considered as a right Riemann sum and each un can be considered as a left Riemann sum for the integral F(n), with n steps and regular with Δt=1 in both cases.
A diagram of a partial series sum as a lower Riemann sum for a partial area of an improper integral.
(a) Partial sum as a lower Riemann sum for a partial area of an improper integral.
A diagram of a partial series sum as an upper Riemann sum for a partial area of an improper integral.
(b) Partial sum as an upper Riemann sum for a partial area of an improper integral.
Figure 25.3.2.
As f(t) is decreasing, each right sum n is a lower sum and each left sum un is an upper sum:
nF(n)unfor all n.
Convergent integral.
Suppose the improper integral of f(t) as t converges. By definition, this means that the limit of F(t) exists as t. But then the sequence (F(n)) also must converge (see Fact 23.5.10), and so is bounded. But since nF(n) for all n, then also (n) is bounded above. And since (n) is simply a constant shift of (sn), that too must be bounded above (and also bounded below by 0 because the terms f(n) are all positive.) We are now in the situation of Fact 25.2.13 and may conclude that f(k) converges.
Divergent integral.
Suppose the improper integral of f(t) as t diverges. This means that the limit of F(t) as t does not exist. In particular, as F(t) is an increasing function, we must have F(t) as t, which in turn implies that (F(n)) diverges to infinity. But since unF(n) for all n, then also (un) as well. And as the terms of (un) are the same as the terms of (sn) with shifted indexing, we also have (sn), so that f(k) diverges.
Convergent series.
If f(k) converges, then it cannot be that the improper integral of f(t) diverges, since if it did the “Divergent integral” case would imply that the series should diverge as well. Hence the integral converges when the series does.
Divergent series.
If f(k) diverges, then it cannot be that the improper integral of f(t) converges, since if it did the “Convergent integral” case would imply that the series should converge as well. Hence the integral diverges when the series does.
Example 25.3.3.
Consider the series ln(k)/k, starting at k=1. Set f(t)=ln(t)/t, a function that is continuous for t>0 and positive for t>1. Compute
f(t)=1ln(t)t2.
This derivative is negative as long as ln(t)>1, which occurs for t>e. So we may say that f is decreasing on domain t>3, and we have verified that f satisfies the conditions of the Integral Comparison Test for k0=3. Because of this, we can say that the convergence/divergence of the sum and integral below are equivalent:
k=3ln(k)k,3ln(t)tdt.
Also note that the convergence of the sum above is equivalent to the convergence of the full sum that begins at index 1 (Fact 25.2.1), so investigating the integral above is sufficient to determine the convergence/divergence of ln(k)/k.
For the integral, we have already noted that ln(t)>1 for t>e and so also for t3. Hence
ln(t)t>1t
on domain t3. And we know that an improper integral of 1/t diverges (Fact 24.1.9), hence our improper integral of ln(t)/t diverges as by the Comparison test for integrals.
From this we conclude that ln(k)/k diverges.
We have seen that 1/k2 converges but 1/k diverges, just as with improper integrals. Using the Integral Comparison Test, we can transfer all of Fact 24.1.9 to the analgous facts about infinite series.

Subsection 25.3.2 Comparing two series

We may compare two series by comparing their sequences of partial sums or by comparing their sequences of terms.
Justification for Statement 1.
Since (an) and (bn) are non-negative then (sn) and (tn) are increasing sequences (or, at least, non-decreasing). If bk converges then (tn) must be bounded, and from sntn we conclude that (sn) is bounded as well. The Monotone Convergence Theorem now implies that (sn) converges.
Justification for Statement 2.
As in the justification of Statement 1, (sn) and (tn) must be non-decreasing. But if ak diverges then (sn) cannot be bounded and must diverge to infinity. Then from sntn we conclude that (tn) as well.
Justification.
Let (sn) and (tn) represent the sequences of partial sums for ak and bk, respectively. Since (an) and (bn) are non-negative, our assumption anbn for all n implies that sntn for all n as well. So the patterns of convergence/divergence of ak and bk follow Pattern 25.3.5.
Remark 25.3.7.
With Fact 25.2.1 in mind, we see that the “for all n” conditions in the statements of both Pattern 25.3.5 and Pattern 25.3.6 may be relaxed. As long as the necessary conditions hold for tails of the sequences involved, then the conclusions of these two facts will hold for the “tails” of the infinite series involved, which is sufficient.
Example 25.3.8.
  1. Since
    12n+1<12n
    for all n, 1/(2k+1) converges by comparison with the geometric series 1/2k.
  2. For
    (✶)52k2+4k+3
    we have
    52n2+4n+3<521n2
    for all n, and 5/2k2 converges because 1/k2 does (see Pattern 25.2.4). So by comparison (✶) must converge.
  3. Since
    6n1>1n
    for all n2, the series
    k=26k1
    diverges by comparison with the harmonic series 1/k.

Subsection 25.3.3 Comparing rates

Just as with improper integrals, for a series ak to converge we need (an)0, but that on its own is not enough — if (an) doesn’t converge to zero fast enough, then it will diverge (for example, the harmonic series). So we can test convergence/divergence by comparing the rate at which the terms trend to 0 against the terms of a series whose convergence/divergence is known.
Justification.
Suppose (an/bn)L. Recall that we assume L is positive. Take (c,d) to be some open range around L with c>0. (For example, we could take c=L/2 and d=2L.) Then there is some tail (an/bn)nN that is completely contained in this range:
c<anbn<dcbn<an<dbn.
(Recall that all terms bn are positive, so multiplying by bn does not affect the inequalities.)
We may now use the above inequalities to analyze converge/divergence.
Case that bk converges.
Then dbk also converges, and ak converges by comparison with that series.
Case that bk diverges.
Then cbk also diverges, and ak diverges by comparison with that series.
Case that ak converges.
Then bk cannot diverge, because if it did we have already demonstrated that ak would diverge in that case.
Case that ak diverges.
Then bk cannot converge, because if it did we have already demonstrated that ak would converge in that case.
Example 25.3.10.
  1. Consider 6/(k+1). We have already verified that 1/(k+1) diverges (Example 25.2.10), so 6/(k+1) must diverge as well. But let’s check that the Limit comparison test for series says the same:
    6/(n+1)1/n=6nn+16as n.
    By comparison with the divergent harmonic series 1/k, the series 6/(k+1) diverges.
  2. Consider 1/(2k1). Compare with the geometric series 1/2k:
    1/(2n1)1/2n=2n2n11as n.
    So 1/(2k1) converges.
Example 25.3.12. Choosing a comparator series.
Consider
(✶✶)2k2+3k5+k7.
For large k we have
2k2+3k5+k72k2k7=2k3/2.
So we’ll attempt to compare with the convergent p-series 1/k3/2:
(2n2+3n)/5+n71/n3/2=2n7/2+3n5/25+n7=2+3/n5+n7/n7/2=2+3/n5/n7+12+00+1=2
as n. From this limit result we conclude that (✶✶) converges by comparison with the convergent p-series 1/k3/2.
The Limit comparison test for series states that when the trends of the two sequences of terms are progressing at the same rate (give or take a constant multiple), then the convergence/divergence of the associated series are equivalent. When the trends of the two sequences progress at different rates, then their convergence is not equivalent but we can still make conclusions based on knowledge of convergence/divergence of one of the sequences.
Remark 25.3.14.
In light of Pattern 25.3.13, it’s best to use the denominator sequence (bn) to represent the one whose convergence/divergence of the associated series is known when attempting a limit comparison.

Section 25.4 More convergence tests

Subsection 25.4.1 Root test

If the terms of a series involve the index variable as an exponent, we can determine the convergence of the series by examing the trend of the base sequence.
Justification for Statement 1.
We will attempt to compare ak with a convergent geometric series rk. We assume L<1, and note that we must also have L0 since the terms of (ann) are non-negative. We can create an open range (c,d) around L with d<1. (For example, we could take c=L/2 and d=(1L)/2.) Then there is some tail (ann)nN that is completely contained in this range:
c<ann<d.
Since power functions are always increasing functions on non-negative domains, we may raise each “side” of the above inequality to the nth power and the inequalities will be maintained:
cn<an<dn.
We know have our base r=d for a geometric series, and dk converges because 0<d<1. Since an<dn for all terms in the tail (an)nN, the series ak converges as well by comparison.
Justification for Statement 2.
Case of infinite L.
If the terms of (ann) diverge to infinity, then the sequence of nth powers of those terms (which is just (an)) will also diverge to infinity, and so the series ak will diverge in this case.
Case of finite L.
The argument in this case is identical to the one above, except this time we compare to a divergent geometric series. Since L>1 we can create an open range (c,d) around L with c>1. Then similarly to the previous argument we can determine some tail (an)nN with an>cn for all terms in that tail, and so ak diverges by comparison with the divergent geometric series ck.
Example 25.4.2.
  1. For series ak with terms
    an=(2n+33n+2)n
    we have
    ann=2n+33n+223as n
    so we conclude that ak converges.
  2. For series ak with terms
    an=2n(n+1)3n+1,
    we appear to have a mix of geometric behaviour and harmonic behaviour, but likely the geometric behaviour will win (exponentials beat polynomials) and the series should converge. Let’s verify with the Root test:
    ann=2(n+1)3n+1n=2n+1n3n3n=2n+1n33n.
    We have already seen that (1+t)1/t1 as t (Example 23.6.22), so also (n+1n)1. One may also verify with a logarithmic limit that (31/n)1. So we have (ann)2/3, and conclude that ak converges.
Checkpoint 25.4.3.
Verify that the case of Statement 3 of the Root test really is inconclusive by testing both the p-series 1/k2 and the harmonic series 1/k. You should find that the terms of both series satisfy (ann)1, but one series converges and one diverges.

Subsection 25.4.2 Ratio test

Again, we need (an)0 for ak to converge, but that’s not sufficient: we need the terms to get small fast enough that the partial sums don’t become unbounded. Another way to measure whether this is happening is to compare each term to the next in a ratio.
Justification for Statement 1.
Again we will attempt to compare ak with a convergent geometric series. And again we can create an open range (c,d) around L with d<1, and there will be some tail (an+1/an)nN entirely contained in that range. But we also assume that the terms of (an) to be positive, so all the ratios of those terms are positive as well. So for nN we have
0<an+1an<d0<an+1<dan.
(Recall that the terms of (an) are positive, so multiplying by an does not affect the inequalities.) Now we proceed inductively, starting at n=N:
0<aN+1<daN0<aN+2<daN+1<ddaN=d2aN0<aN+3<daN+2<dd2aN=d3aN.
The pattern continues, and we can say that
0<aN+k<dkaN
for all k1. Now, since 0<d<1, the geometric series dk converges, and by linearity so does dkaN. (Note that aN is just one specific term in the sequence (an), and so we may treat it as a constant.) Then by comparison, the “shifted” series bk with terms bn=aN+n converges. But since
k=0aN+k=aN+aN+1+aN+2+
we may rewrite this (convergent) series as
k=Nak.
Applying Fact 25.2.1 now tells us that the full series ak also converges.
Justification for Statement 2.
Here we may make a simpler argument. There is some tail (an+1/an)nN where the terms are all greater than 1. But then an+1>an for all nN, so in fact the sequence of terms is increasing and cannot trend to 0 as it needs to in order for the sum to converge. (Remember that we assume the terms are a positive sequence.)
Remark 25.4.5.
  • The ratio test is also a good choice for series where the terms involve variable exponents but the root test isn’t practical, because often there will be significant cancellation in the ratio of consecutive terms.
  • The justifiction for Statement 2 of Pattern 25.4.4 implies something interesting: if we have a sequence (an) where
    • (an)0
    • (an+1/an) converges
    • ak diverges
    then it must be that (an+1/an)1. Because if (an+1/an) converged to a limit value less than 1 then the series would converge, and if it converged to a limit value greater than 1 then (an)0. So in this divergent case the terms are trending to 0 but not very fast, because we eventually always have
    an+1an1,
    which implies that we eventually always have an+1an, and this approximation becomes better and better as we go further out in the sequence.
Example 25.4.6.
  1. For series k3/3k, the root test will not play nicely with the numerator, so let’s apply the ratio test instead:
    an+1an=(n+1)3/3n+1n3/3n=(n+1)33n33nn3=13(n+1n)3.
    This final expression converges to 1/3 as n, so we conclude that the series converges.
  2. For series k!/10k, again the root test will not play nicely with the factorial in the numerator, so let’s apply the ratio test:
    an+1an=(n+1)!/10n+1n!/10n=(n+1)!10n+110nn!=(n+1)n!10n1010nn!=n+110.
    This final expression diverges to as n, so we conclude that the series diverges. (Can you verify that the sequence (n!/10n) is eventually increasing? Hint: Consider each of the numerator and denominator as a product of n factors, and compare the factors.)
  3. For series kk/k!, again the root test will not play nicely with the factorial, so let’s apply the ratio test:
    an+1an=(n+1)n+1/(n+1)!nn/n!=(n+1)n+1(n+1)!n!nn=(n+1)n(n+1)(n+1)n!n!nn=(n+1n)n=(1+1n)n.
    As n, this final expression behaves exactly as the limit in Example 23.6.23, and so we can say (an+1/an)e. As this limit value is greater than 1, we conclude that the series diverges. (Again, can you verify that the sequence (nn/n!) is eventually increasing?)
Checkpoint 25.4.7.
Verify that the case of Statement 3 of the Ratio test really is inconclusive by testing both the p-series 1/k2 and the harmonic series 1/k. You should find that the terms of both series satisfy (an+1/an)1, but one series converges and one diverges.

Section 25.5 Absolute convergence

So far in this chapter, the convergence tests have all been for infinite series with positive or non-negative terms. If (an) is a sequence with all non-positive terms, then it should be clear the the convergence of ak is equivalent to the convergence of |ak|. But what if (an) has some positive and some negative terms? Can the convergence/divergence of |ak| tell us anything about ak in that case?

Subsection 25.5.1 Absolute versus conditional convergence

The answer to the question above is “yes.”
Justification.
The argument is effectively the same as for Fact 24.3.6, just with sums and terms instead of integrals and function values. Assume |ak| converges. Then from Pattern 25.2.4, so do both of
2|ak|,(|ak|).
For all n we have
|an|an|an|0an+|an|2|an|.
So by comparison, (ak+|ak|) must converge. But then adding this convergent series to another will yield a convergent series (Pattern 25.2.4), so
(ak+|ak|+(|ak|))=ak
converges.
Definition 25.5.2. Absolute and conditional convergence.
  1. If |ak| converges then we say that the infinite series ak is absolutely convergent.
  2. If ak converges but |ak| does not, then we say that the infinite series ak is conditionally convergent.
Remark 25.5.3.
Note that ak is convergent in both parts of Definition 25.5.2, by Fact 25.5.1, so it is not a misnomer to call ak absolutely convergent when it is known that |ak| is convergent.
Example 25.5.4.
  1. For the series (1)k1/k2 (beginning at index k=1), we have
    k=1|(1)k1k2|=k=11k2,
    which is a convergent p-series. So (1)k1/k2 converges absolutely, hence converges.
  2. For the series cos(k)/k2 (beginning at index k=1), we have
    k=1|cos(k)k2|=k=1|cos(k)|k2.
    Since 0|cos(k)|1 for all k, we have |cos(k)|/k21/k2, and so cos(k)/k2 converges absolutely by comparison with the convergent p-series 1/k2.
  3. For the series (1)k1/k (beginning at index k=1), we have
    k=1|(1)k1k|=k=11k,
    which is the divergent harmonic series. So (1)k1/k does not converge absolutely. However, we have investigated the partial sums of (1)k1/k numerically in Example 25.1.9 and it would appear that it converges to a value of ln(2). In Example 25.5.12 we will verify that this series does converge conditionally.
We have seen in Example 25.1.9 that it is possible to rearrange the terms in a conditionally convergent series and get a different sum result. But if a series converges absolutely then this is not possible.
Justification.
Let (sn) and (tn) represent the sequences of partial sums of ak and aφ(k), respectively, and let S represent the value of ak, so that (sn)S. We would like to verify that (tn)S as well. Using Fact 22.3.31, we will instead verify that (tnS)0. Following Corollary 22.3.32, consider an arbitrary half-open range [0,c). Our goal is to verify that some tail of the absolute sequence (|tnS|) is completely contained in this range.
As (sn)S, then also (snS)0, and there exists some tail (|snS|)nN1 completely contained in the half-open range [0,c/2). But we not only assume that ak converges, we assume it converges absolutely. That is, |ak| converges. Let (rn) be the sequence of “remainders” for this convergent sequence:
rn=k=n+1|ak|.
Fact 25.2.15 tells us that (rn)0, so there exists some tail (rn)nN2 also completely contained in the half-open range [0,c/2). (Note that (rn)) is a sequence of non-negative terms because a convergent series of non-negative terms must have a non-negative sum value.)
Now let N be the greater of N1 and N2, so that both the tails (|snS|)nN and (rn)nN are completely contained in [0,c/2). In particular, the first terms of these tails are both contained in this range:
(†)|sNS|<c/2,rN<c/2.
Remember that the series we would like to investigate is aφ(k), but the terms of this sequence are all mixed up. However, from the original series ak, the specific partial sum of the original series
sN=k=0Nak=a0+a1+a2++aN
involves only a finite number of terms, and all of these terms must appear eventually in the mixed-up sequence (aφ(n)). Choose M large enough that this happens. (For example, we could choose M to be the largest index so that the “shuffled” index φ(M) is between 0 and N, inclusive.) The two partial sums sN and tM involve only a finite number of terms each, and so we can subtract them and manipulate them without worrying about convergence. But we have chosen M so that in the partial sum
tM=k=0Maφ(k),
all the terms of sN appear, just in a mix-up order. So if we subtract tMsN, all those common terms will cancel and we will only be left will those terms from tM that did not appear in sN. Because sN involves all terms up to and including aN, the terms remaining must all have indices that are larger than N (as part of the original sequence of terms (an)):
|tMsN|=|aj1+aj2++aj|
for some collection of indices j1,,j that are all greater than N. Using the extended Triangle Inequality, we can say that
(††)|tMsN||aj1|+|aj2|++|aj|.
In this form, because the indices are all larger than N, each of these absolute terms appears in the Nth absolute remainder
rN=k=N+1|ak|.
We know the series defining rN converges, and since it is an infinite sum of non-negative terms, it must add up to a larger value than the finite sum in (††). So we can say
|tMsN|rN.
Now the partial sum tM already contains all of the terms from sN (and likely more), so if we go even further out into the partial sums (tn) that will still be true. In other words, all of the analysis above is actually true for every difference |tnsN| for nM, so that for such n it is always true that |tnsN|rN.
We’re now ready to confirm that the tail (|tnS|)nM is completely contained in the range [0,c). Because of the absolute values, we know that the terms of this tail will all be greater than or equal to zero; we just need to confirm that they are all less than c. So consider:
|tnS|=|tnsN+sNS||tnsN|+|sNS|rN+|sNS|<c2+c2=c,
as required, where the first inequality above is the Triangle Inequality, the second is from our analysis of the terms of (tn)nM compared to the specific partial sum sN, and the third is from (†).

Subsection 25.5.2 Alternating series

Notice that the terms in Series 1 and Series 3 in Example 25.5.4 alternate between positive and negative:
k=1(1)k1k2=1+(14)+19+(116)+=114+19116+
k=1(1)k1k=1+(12)+13+(14)+=112+1314+
Definition 25.5.6. Alternating series.
An infinite series where the terms alternate between positive and negative values.
Example 25.5.7.
  1. k=0cos(kπ)2k=112+1418+116
  2. k=0(1)k+13k=1+1319+127+181+
Note 25.5.9.
For every sequence (an), the convergence/divergence of ak and (ak) are equivalent. And if ak is alternating beginning with a negative term, then (ak) is alternating beginning with a positive term. So in the remainder of this subsection, we will generally assume that alternating series begin with a positive term (though in examples they might not).
Justification.
(⇒) 
If (1)kak converges then we must have ((1)nan)0 (Fact 25.2.7). But this implies (an)0.
(⇐) 
Assume (an)0. Let (sn) represent the sequence of partial sums as usual. Because of the alternating nature of the series, the partial sums also alternate, but not between positive and negative, but instead between growing and decaying since we will alternately be adding a positive term or a negative onto the previous partial sum. So we will apply Fact 22.3.20 and split (sn) into subsequences (tn) and (un) with terms
tn=s2n,un=s2n+1.
The subsequence (tn) represents the even-indexed terms in (sn) where the last term from (an) added on is positive, and the subsequence (un) represents the odd-indexed terms in (sn) where the last term from (an) added on is negative. Because of this even-odd index split, collectively (tn) and (un) account for every term from (sn), and so if we can demonstrate that these two subsequences converge to the same limit, then Fact 22.3.20 says that (sn) must converge to that limit as well.
We’ll begin with (tn):
tn=s2n=k=02n(1)kak=a0a1+a2a3++a2n2a2n1+a2n=(a0a1)+(a2a3)++(a2n2a2n1)+a2n.
Each of the bracketed binomials above is positive because we have assumed that (an) is positive and decreasing, so that ak>ak+1 for all k. And the final term a2n is positive as well, so we can say that (tn) is a positive sequence. But (tn) is decreasing as well:
tn+1=s2(n+1)=s2n+2=s2n+(1)2n+1a2n+1+(1)2n+2a2n+2=tn+(1)a2n+1+a2n+2=tn+(a2n+2a2n+1).
This time the bracketed binomial above is negative, because a2n+2<a2n+1, and so tn+1<tn. We have now established that (tn) is positive and decreasing, which means that it is bounded above by t0 and below by 0. The Monotone Convergence Theorem tells us that tn converges; let L represent its limit value.
Now consider (un). Let (bn) represent the subsequence of (an) with bn=a2n+1. (That is, (bn) is all the odd-indexed terms of (an).) We have
un=s2n+1un=s2n+(1)2n+1a2n+1un=tnbn.
This says that (un) is the difference of two convergent sequences: (tn)L and (bn)0 (since (an)0). The Sequence limit laws tell us that
(un)L0=L.
We have now established that both partial sum subsequences (tn) and (un) converge to the same limit, so Fact 22.3.20 says that (sn) must also converge to that limit.
Example 25.5.11.
  1. Consider the alternating series
    k=1(1)k1k2k3+1.
    This series is unlikely to converge absolutely, as
    |(1)k1k2k3+1|=k2k3+11kfor large k,
    and we know that the harmonic series diverges. Consider (an) with an=n2/(n3+1), beginning at index n=1, like our sum. This is a positive sequence, but is it decreasing? Let f(t)=t2/(t3+1). Then
    f(t)=t(2t3)(t3+1)2,
    and this derivative is negative on domain t23. So we can say that (an) is decreasing for n3. And from examining dominant terms it is clear that (an)n30, so the Alternating Series Test says that
    k=3(1)k+1k2k3+1
    converges. And since this “tail” converges, our original series must converge as well.
  2. Consider the alternating series
    k=1(1)k1k4k1.
    Let (an) represent the sequence of absolute terms: an=n/(4n1), beginning at index n=1, like our sum. This is a positive sequence, and you can verify via a derivative calculation as in the example above that it is a decreasing sequence. However, (an)1/40, so the Alternating Series Test says that our series diverges. In fact, the limit value for (an) tells us in what way it diverges: if n is large enough for an1/4 sufficiently closely and S=sn is that particular partial sum value, then all partial sum sequence terms will bounce back and forth between S and either S±1/4 (where the plus-or-minus depends on whether n is even or odd).
Example 25.5.12. Conditional convergence of the Alternating Harmonic Series.
Consider the alternating harmonic series
k=1(1)k1k.
Then the sequence of absolute terms (1/n) is positive, decreasing, and trends to 0. So the Alternating Series Test says that the series converges. As we have seen previously that this series does not converge absolutely, we instead say that (1)k1/k converges conditionally.

Subsection 25.5.3 Estimating alternating sums

Suppose (an) is positive, decreasing, and (an)0. Then the Alternating Series Test tells us that ak converges; let S represent its sum. As in the justification of the Alternating Series Test, let (tn) and (un) represent the sequences of even-indexed and odd-indexed partial sums:
tn=s2n,un=s2n+1.
As (sn)S, then also (tn)S and (un)S. We saw that (tn) decreases to S. What about (un)? We have
un+1=s2(n+1)+1=s2n+3=s2n+1+(1)2n+2a2n+2+(1)2n+3a2n+3=un+(a2n+2a2n+3).
This time un+1>un, as a2n+2a2n+3>0 because (an) is decreasing. So (un) increases to S.
To summarize, the terms of the partial sum sequence (sn) alternate between values of (tn), a sequence whose terms are greater than and decreasing down to S, and values of (un), a sequence whose terms are less than and increasing up to S. So the sum value S is squeezed between (tn) and (un), so that S is always between consecutive terms of (sn):
n even:sn+1<S<sn,n odd:sn<S<sn+1.
And in all cases, the distance between consecutive terms in the sequence of partial sums is the term of (an) to be next added onto the sum.
Recall that under the conditions in the fact above, the alternating sum converges if and only if (an)0. So the fact says that if we would like to estimate the alternating sum to within a specific tolerance, we simply need to determine the index at which the terms of (an) get within that tolerance of 0.
Example 25.5.14.
Suppose we would like to estimate the sum
k=0(1)kk+14k
to within a tolerance of ±5×105.
First let’s verify that the sequence ((n+1)/4n) satisfies the conditions of Alternating Series Test. Clearly this sequence is positive. To investigate whether the sequence decreases to 0, we will instead consider the corresponding continuous function f(t)=(t+1)/4t. We have
f(t)=1(t+1)ln(4)4t,
which is negative on domain t>11/ln(4), so we can say that ((n+1)/4n) is a decreasing sequence for n1. Furthermore, f(t) has / form as t, so
limtt+14t=l'Hlimt14tln(4)=0,
and we conclude that (an)0 as well. All of this confirms that (1)kak converges, and we can use partial sums to estimate its value.
Per Fact 25.5.13, we need to determine the index when an<5×105, and then we can backtrack one index from that. You may calculate that the denominator of the terms of (an) becomes greater than 105 at n=9. From 49>2×105 we can compute:
a9=9+149<102×105=5105.
This means that s8 will estimate the infinite sum to within ±5×105:
k=0(1)kk+14kk=08(1)kk+14k=124+316464+525661024+74096847+948
We can have Sage add this up for us.
As this is an even-indexed term, we know this is an over-estimate. And if you increase the digits parameter in the Sage cell above, you’ll see that it is already rounded up from the exact value. So we can be confident that
0.639979<k=0(1)kk+14k<0.640030
(where we have subtracted off 5.1×105 to account for the fact that 0.640030 is a rounded-up value).