Online Encyclopedia


Online Encyclopedia
Originally appearing in Volume V08, Page 225 of the 1911 Encyclopedia Britannica.
Spread the word: it!
CALCULUS OF DIFFERENCES (Theory of Finite Differences), that branch of mathematics which deals with the successive differences of the terms of a series. I. The most important of the cases to which mathematical methods can be applied are those in which the terms of the series are the values, taken at stated intervals (regular or irregular), of a continuously varying quantity. In these cases the formulae of finite differences enable certain quantities, whose exact value depends on the law of variation (i.e. the law which governs the relative magnitude of these terms) to be calculated, often with great accuracy, from the given terms of the series, without explicit reference to the law of variation itself. The methods used may be extended to cases where the series is a double series (series of double entry), i.e. where the value of each term depends on the values of a pair of other quantities. 2. The first differences of a series are obtained by subtracting from each term the term immediately preceding it. If these are treated as terms of a new series, the first differences of this series are the second differences of the original series; and so on. The successive differences are also called differences of the first, second, . . . order. The differences of successive orders are most conveniently arranged in successive columns of a table thus: Term. Ist Duff. 2nd Diff. 3rd Diff. 4th Diff. a b—a d—z~+b d—3c+3b-a e—4d+6c—4b+a b c—b a—2d+c a—3d { 3c—b d ed —c —d e Algebra of Differences and Sums. 3. The formal relations between the terms of the series and the differences may be seen by comparing the arrangements (A) and (B) in fig. r. In (A) the various terms and differences are the same as in § 2, but placed differently. In (B) we take a new series of terms a, 13, y, S, commencing with the same term a, and take the successive sums of pairs of terms, instead of the successive differences, but place them to the left instead of to the right. It will be seen, in the first place, that the successive terms in (A), reading downwards to the right, and the successive terms in (B), reading downwards to the left, consist each of a series of terms whose coefficients follow the binomial law; i. e. the coefficients in b-a, c—2b+a, d—3c+3b—a, . and in a+/3, a+2/3+-Y, a+30-1-37+3, . . are respectively the same as in y—x, (y—x)2, (y—x)3, . and in x+y, (x+y)2, (x+y)3, . In the second place, it will be seen that the relations between the various terms in (A) are identical with the relations between the similarly placed terms in (B) ; e.g. 13+y is the difference of a+2/3+y and a+R, just as c—b is the difference of c and b: and d—c is the sum of c—b and d—2c+b, just as 0+27+6 is the sum of 0+y and 7+6. Hence if we take ,B, y, 6, . . . of (B) as being the same as b—a, c—2b-{-a, d—3c+3b—a, . . . of (A), all corresponding terms in the two diagrams will be the same. Thus we obtain the two principal formulae connecting terms and differences. If we provisionally describe b—a, c -2b +a, . as thefirst, second, . differences of the particular term a (§ 7), then (i) the nth difference of a is l—nk...-~(-I)n-211 1.2 IC-~(—I)n-Inb~ (_I)^a, where 1, k . . . are the (n+1)th, nth, . terms of the series a, b, c, the coefficients being those of `the terms in the expansion of (y—x)11: and (ii.) the (n+i)th term of the series, i.e. the nth term after a, is a+nO+ I.2 Iy+ . . where 0, y, . are the first, second, differences of a; the coefficients being those of the terms in the expansion of (x+y)n. 4. Now suppose we treat the terms a, b, c, . . . as being them-selves the first differences of another series. Then, if the first term of this series is N, the subsequent terms are N+a, N+a+b, N+a+ b+c, .; i.e. the difference between the (n+i)th term and the first term is the sum of the first n terms of the original series. The term N, in the diagram (A), will come above and to the left of a; and we see, by (ii.) of § 3, that the sum of the first n terms of the original series is (N+na+n.n—ig+ . ) —N=na+n'n—113+n.n-i.n—2y+ I.2 ) I.2 1.2 . 3 5. As an example, take the arithmetical series a, a+p, a+2p, . The first differences are p, p, p, ..., and the differences of any higher orderarezero. Hence, by (ii.) of § 3, the (n+r)th term is a+np, and, by § 4, the sum of the first n terms is na+I n (n — )p = I n{2a+ (n— I) p). 6. As another example, take the series I, 8, 27, . . . the terms of which are the cubes of I, 2, 3, . . . The first, second and third differences of the first term are 7, 12 and 6; and it may be shown (§ 14 (i.)) that all differences of a higher order are zero. Hence the sum of the first n terms is n+7 n.n—I+I2 n.n—I.n—2+11.11—I.n—2.11—3= 1.2 I.2.3 1.2.3n4+. 4i4 n3+4n2 ={an(n+i)2• 7. In § 3 we have described b-a, c—2b+a, as the first, second, . . differences of a. This ascription of the differences to particular terms of the series is quite arbitrary. If we read the differences in the table of § 2 upwards to the right instead of down-wards to the right, we might describe e—d, e—2d+c, . . . as the first, second, . differences of e. On the other hand, the term of greatest weight in c-2b+a, i.e. the term which has the numerically greatest coefficient, is b, and therefore c—2b+a might properly be regarded as the secbnd difference of b ; and similarly e -4d +6c -4b+a might be regarded as the fourth difference of c. These three methods of regarding the differences lead to three different systems of notation, which are described in §§ 9, Io and II. Notation of Differences and Sums. 8. It is convenient to denote the terms a, b, c, . of the series by uo, u1, u2, u3 . . . . If we merely have the terms of the series, us may be regarded as meaning the (n+I)th term. Usually, however, the terms are the values of a quantity u, which is a function of another quantity x, and the values of x, to which a, b, c, . . correspond, proceed by a constant difference h. If xo and uo are a pair of corresponding values of x and u, and if any other value xo+mh of x and the corresponding value of u are denoted by x,,, and use then the terms of the series will be. . . uun_1, u,,, U., un+2... , corresponding to values of x denoted by...xn_2, x11_1, x,., x11+1, x,. 2, .. . 9. In the advancing-difference notation un+1—un is denoted by Au11. The differences Auo, Du1, Due ... may then be regarded as values of a function Au corresponding to values of x proceeding by constant difference h; and therefore Au„+1—Aun is denoted by AAu,,, or, more briefly, A2u,,; and so on. Hence the table of differences in §2, with the corresponding values of x and of u placed opposite each other in the ordinary manner of mathematical tables, becomes x u 1st Diff. 2nd Diff. 3rd Diff. 4th Diff. X11—2 un—2 A2un—3 A4u, 4••• Aun-2 A3u,—3 x,_, un—1 A2un—2 A4un—3. Au„—1 A3un—2 x,. un A2un—I A4un—2• • Ann A3u,—1 x11+1 un}1 A2un A4un—1•• Aun+1 A3un x11+2 2411+2 A2un+1 A4un ... The terms of the series of which . . . u,,_1, un, un+1, . . . are the first differences are denoted by Eu, with proper suffixes, so etc. that this series is . Eu„^h Eu„, Eu„}1 ... The suffixes are chosen so that we may have AZun=un, whatever n may be; and therefore (§ 4) run may be regarded as being the sum of the terms of the series up to and including un_l. Thus if we write Eun_1= C+un-2, where C is any constant, we shall have eun =Fun-1 +un_1 =C+nn-2+nn_l, F+un}I=C+Un—2+un—1~L I un, and so on. This is true whatever C may be, so that the knowledge of . un_1, un, . . . gives us no knowledge of the exact value of 'un; in other words, C is an arbitrary constant, the value of which must be supposed to be the same throughout any operations in which we are concerned with values of Eu corresponding to different suffixes. There is another symbol E, used in conjunction with u to denote the next term in the series. Thus Eun means u,, 1, so that Eun = un+iu,,. to. Corresponding to the advancing-difference notation there is a receding-difference notation, in which un+l-un is regarded as a difference of un+1, and may be denoted by A'un+1, and similarly u„+1—tun-Fun_1 may be denoted by A'2un+I. This notation is only required for certain special purposes, and the usage is not settled (§ 19 (ii.)). 11. The central-difference notation depends on treating un+1—2un—un_I as the second dfference of u,,, and therefore as corresponding to the value x,,; but there is no settled system of notation. The following seems to be the most convenient. Since un is a function of x,,, and the second difference u,,+2-2un+l+un is a function of x,,4.1, the first difference u„+1-un must be regarded as a function of xn}§, i.e. of 2(xn+xn+1). We therefore write u„+1-un =Sun+i, and each difference in the table in § 9 will have the same suffix as the value of x in the same horizontal line; or, if the difference is of an odd order, its suffix will be the means of those of the two nearest values of x. This is shown in the table below. In this notation, instead of using the symbol E, we use a symbol to denote the mean of two consecutive values of u, or of two consecutive differences of the same order, the suffixes being assigned on the same principle as in the case of the differences. Thus µanti = 2 (un+nn+1) , µfun = 3(&u,.4 +&un+i) , &c. ' If we take the means of the differences of odd order immediately above and below the horizontal line through any value of x, these means, with the differences of even order in that line, constitute the central differences of the corresponding value of u. Thus the table of central differences is as follows, the values obtained as means being placed in brackets to distinguish them from the actual differences : x u 1st Diff. 2nd Diff. 3rd Diff. 4th Diff. X,,-2 u,,_2 (/1&un—2) &2un—2 (i 3un—2 841g,,—2 . . . Sun-3 b3Un—'a xn—1 un_I (u&un—1) Stun—1 (1i63un—1) b4un—1" b3une, xn un (aSun) Stun (t1&3un) 'Pun . . . bun+i S3un+i xn+t un+1 (014,0 b2un+l (t1&Sun+l) b4un+1 . Sun+l s3un+z xn+2 14,0 (tlSun+2) &2un+2 (/1S3un+2) Soun+i Similarly, by taking the means of consecutive values of u and also of consecutive differences of even order, we should get a series of terms and differences central to the intervals xn_2 to to Ks, . The terms of the series of which the values of u are the first differences are denoted by au, with suffixes on the same principle; the suffixes being chosen so that &run shall be equal to u,,. Thus, if )hen aline; =C+un_2+un—1, au,,+ =C+un—2+un—1 +un, &c., nd also (Attune'=C+un—2+2un-1, wean =C+un—2+un—1+2un, &c., C being an arbitrary constant which must remain the same through-out any series of operations. Operators and Symbolic Methods. 12. There are two further stages in the use of the symbols A, E, S, a, &c., which are not essential for elementary treatment but lead to powerful methods of deduction. (i.) Instead of treating Du as a function of x, so that Dun means (Au),,, we may regard A as denoting an operation performed on u, and take es meaning z.un. This applies to the other symbols E, 6, &c., whether taken simply or in combination. Thus zEu,, means that we first replace u„ by un+i, and then replace this by un+2—un+l. (ii.) The operation§ A, E, S, and /2, whether performed separately or in combination, or in combination also with numerical multipliers and with the operation of differentiation denoted by D(=d/dx), follow the ordinary. rules of algebra: e.g. 0(u„+vn=Aun-}- .v,,, ODun = DOun, &c. Hence the symbols can be separated from the functions on which the operations are performed, and treated as if they were algebraical quantities. For instance, we have E.un = u„+1 = un+iun = I.un+A.u,,, so that we may write E = i +d, or 0 =E-1. The first of these is nothing more than a statement, in concise form, that if we take two quantities, subtract the first from the second, and add the result to the first, we get the second. This seems almost a truism. But, if we deduce En=(1+0)", i "=(E-I)n, and expand by the binomial theorem and then operate on uo, we get the general formulae un=uo+nLuo+I.2 I,,2us+ . . . +Muo, n.n I 0"up=u - n—nun—1~ I.2 Zln—2+ T(— 1)"u0, which are identical with the formulae in (ii.) and (i.) of § 3. (iii.) What has been said under (ii.) applies, with certain reservations, to the operations E and a, and to the operation which represents integration. The latter is sometimes denoted by D-1; and, since L1Fiun=un, and Bolin =un, we might similarly replace Z and a by 0-1 and 5-1. These symbols can be combined with A, E, &c. according to the ordinary laws of algebra, provided that proper account is taken of the arbitrary constants introduced by the operations D-1, A-1, Applications to Algebraical Series. 13. Summation of Series.—If u, denotes the (r+1)th term of a series, and if v, is a function of r such that Av,=u, for all integral values of r, then the sum of the terms u,,, u,n+1 un is vn+I-vm. Thus the sum of a number of terms of a series may often be found by inspection, in the same kind of way that an integral is found. 14. Rational Integral Functions.—(i.) If u,. is a rational integral function of r of degree p, then Au, is a rational integral function of r of degree p -1. (ii.) A particular case is that of a factorial, i.e. a product of the form (r+a+1) (r+a+2) . . (r+b), each factor exceeding the pre-ceding factor by 1. We have 0. (r+a+i) (r+a+2) . . . (r+b) = (b-a).(r+a+2) . . . (r+b), whence, changing a into a-t, E(r+a-+-1) (r+a+z) . . . (r+b)=const.+(r+a)(r+a+1) .. . (r+b)/(b-a+I). A similar method can be applied to the series whose (r+i)th term is of the form i/(r+a+I) (r+a+2) ... (r+b). (iii.) Any rational integral function can be converted into the sum of a number of factorials; and thus the sum of a series of which such a function is the general term can be found. For example, it may be shown in this way that the sum of the pth powers of the first n natural numbers is a rational integral function of n of degree p+1, the coefficient of nr+l being I/(p+i). 15. Difference-equations.—The summation of the series .. . +un+2tun—l+un is a solution of the difference-equation Ovn = un}l, which may also be written (E-i)vn=un+t. This is a simple form of difference-equation. There are several forms which have been investigated; a simple form, more general than the above, is the linear equation with constant coefficients- vn+m +alvn+m-1 +a2vn+m-2+ +amen=N, where al, a2, . . . am are constants, and N is a given function of n. This may be written (Em+aiE"1-1+ . . . +am)vn = N or (E-pi) (E-p2) ... (E-pm) vn = N. The solution, if Pi, P2, . . Pm are all different, is vn=C1p1"+ C2p2"+ . • • +Cmpm"+Vn, where C1, C2 . are constants, and vn = V,, is any one solution of the equation. The method of finding a value for V" depends on the form of N. Certain modifications are required when two or more of the p's are equal. It should be observed, in all cases of this kind, that, in describing Cl, Co as " constants," it is meant that the value of any one, as Cl, is the same for all values of n occurring in the series. A " constant " may, however, be a periodic function of n. Applications to Continuous Functions. 16. The cases of greatest practical importance are those in which u is a continuous function of x. The terms uI, u2 . . of the series then represent the successive values of u corresponding to x=x1, x2 The important applications of the theory in these cases are to (i.) relations between differences and differential coefficients, (ii.) dun—3 = C+un—2, interpolation, or the determination of intermediate values of u, and (iii.) relations between sums and integrals. 17. Starting from any pair of values xo and uo, we may suppose the interval h from xo to x, to be divided into q equal portions. If we suppose the corresponding values of u to be obtained, and their differences taken, the successive advancing differences of uo being denoted by alto, a2uo . we have (§ 3 (ii.)) u1=uo+gaue+ a2uo + T- . . . . 1.2 When $ is made indefinitely great, this (writing f(x) for u) becomes Taylor s Theorem (INFINITESIMAL CALCULUS) 2 .f(x+h)=f(x)+hf (x)+1--2f"(x)+ ..., which, expressed in terms of operators, is E=1+hD+I 2D2 + 1hD3+ ... =e t'. This gives the relation between 0 and D. Also we have u2=uo+24auo+2g'i z-Ia2uo+ U3 = uo+3qa Uo+ 34.3q - Ia2uo+ I.2 and, if p is any integer, up/ =uo+pauo+ p'1'2 Ia2uo+ . From these equations up/2 could be expressed in terms of uo, u2, . . . ; this is a particular case of interpolation (q.v.). 18. Differences and Differential Coefficients.—The various formulae are most quickly obtained by symbolical methods; i.e. by dealing with the operators L1, E, D, . . as if they were algebraical quantities. Thus the relation E=ehD (§ 17) gives hD =(log,(I +A) =0 - IA2+303. . . or h `fix) 0—Quo—3.2,2ue+§A2uo . . . . The formulae connecting central differences with differential coefficients are based on the relations It = cosh4hD = 3(e3h° +e-4hD ) 6=2 sinh 3hD=e3h' -e-ihD, and may be grouped as follows: uo = uo p6uo=(hD+sh3D3+I1oh6D6+ . . 62uo=(h2D2+1-ah4D4+r3hh6D6+ µ63u0=(h3D3+4h6D6+ . . .)uo 64uo=(h4D4+06D6+ . . .)uo pu;=(I+8h2D2+3kah4D4+ae8xeh6D6+ . . . )u; 6u;=(hD+34h2D3+13 -oh6jD6+ .. u62u;=(h2D2+z4h4D4+s4keh6D6+ ...)u; 83u; _ (h3D3+06D6+ . ..)u; u64ui = (h4D4+1'4h6D6+ ..=uo hDu = (u6- su63+1'sus6- ... )uo h2D2uo=(62— _3 64+.01 66— . . . )u0 h3D3uo = OAP- Iµ66+ . . . )uo h4D4uo=(64-8s3+ ... )uo =-eu62+1 au64-TihTUP+... )u4 hDu4 = (6— 34663+040666— . . . )u4 h2D2u4 = (u62- 34/~64+s76b/A66— .. . )u3 h3D3u; _ (63- 866+ ... )u4 h4D4u; _ (u64-i4µ66+ ... )u4 When u is a rational integral function of x, each of the above series is a terminating series. In other cases the series will be an infinite one, and may be divergent; but it may be used for purposes of approximation up to a certain point, and there will be a " remainder," the limits of whose magnitude will be determinate. 19. Sums and Integrals.—The relation between a sum and an integral is usually expressed by the Euler-Maclaurin formula. The principle of this formula is that, if um and um+i, are ordinates of a curve, distant h from one another, then for a first approximation to the area of the curve between um and um+i we have ;h(um+um+i), vnl. 8and the difference between this and the true value of the area can be expressed as the difference of two expressions, one of which is a function of xm, and the other is the same function of xm+i• Denoting these by ¢(xm) and ¢(xm+I), we have udx = h(um+um+i) +4(xm+i)—d)(xm) • xm Adding a series of similar expressions, we find f f udx=h{hum+um+l+um+2+ • • • +un—I+lun}---gs(xn)-O(xm). xm The function 1)(x) can be expressed in terms either of differential coefficients of u or of advancing or central differences; thus there are three formulae. (i.) The Euler-Maclaurin formula, properly so called, (due independently to Euler and Maclaurin) is udx=h.uQun-113h2d -2+~8 h4 dx3n'ss 413-h8d + .. . =h.poun--Bih2dun+B2 h4d3un B 3 hs-d6u5 d..... a ! dx 4 ! dx3 6! dx where Bi, B2, B3 . . . are Bernoulli's numbers. (ii.) If we express differential coefficients in terms of{ advancing. differences, we get a theorem which is due to Laplace: 7 ~xnudx=po(u, uo)-io(oun ouo)+T'4(o2un 6^2uo) xo -3 0 (03un—A2uo)+iea (Mu,,—o4uo)-....For practical calculations this may more conveniently be written xn 1 udx=pe(un uo)+ (Duo-1[12uo+I8&3uo- ..7y ) h xo +i3 (('un 2i'2un+k '3un • . •), where accented differences denote that the values of a are read back-wards from un; i.e. t'un denotes un_i-un, not (as in § 10)1inu;,-1. (iii.) Expressed in terms of central differences this becomes udx=p?(unuo) — 1'subun+720t163un—.. . xo +-i42u6uoyYou63uo+... =u(cr-1h6+712'b63--g$ 1a66+iFMa7aas7-... )(u, uo). (iv.) There are variants of these formulae, due to taking hum+4 as the first approximation to the area of the curve between um and um+i; the formulae involve the sum u4+u4+ . . . +un—;-o(un—uo) (see MENSURATION). 20. The formulae in the last section can be obtained by symbolical methods from the relation h fudx = h D 'u=hD'u. Thus for central differences, if we write Bee 3hD, we: have At =cosh 0, 6=2 sinh 0, 0=8 and the result in (iii.) corresponds to the formula sinh 0=0 cosh B/(i+3 sinh 26-1-25 sinh 60+22.j:42 sinh 60- ...).
End of Article: CALCULUS OF DIFFERENCES (Theory of Finite Differences)

Additional information and Comments

Any curve with portions in the firt and second quadrant is symmetric abouty-axis.
» Add information or comments to this article.
Please link directly to this article:
Highlight the code below, right click and select "copy." Paste it into a website, email, or other HTML document.