§ 14. The full meaning and bearing of such a substitution will only become apparent in some of the subsequent chapters, but it may be pointed out at once that it is in this way only that we can with perfect strictness introduce the notion of a ‘limit’ into our account of the matter, at any rate in reference to many of the applications of the subject to purely statistical enquiries. We say that a certain proportion begins to prevail among the events in the long run; but then on looking closer at the facts we find that we have to express ourselves hypothetically, and to say that if present circumstances remain as they are, the long run will show its characteristics without disturbance. When, as is often the case, we know nothing accurately of the circumstances by which the succession of events is brought about, but have strong reasons to suspect that these circumstances are likely to undergo some change, there is really nothing else to be done. We can only introduce the conception of a limit, towards which the numbers are tending, by assuming that these circumstances do not change; in other words, by substituting a series with a fixed uniformity for the actual one with the varying uniformity.[4]
§ 15. If the reader will study the following example, one well known to mathematicians under the name of the Petersburg[5] problem, he will find that it serves to illustrate several of the considerations mentioned in this chapter. It serves especially to bring out the facts that the series with which we are concerned must be regarded as indefinitely extensive in point of number or duration; and that when so regarded certain series, but certain series only (the one in question being a case in point), take advantage of the indefinite range to keep on producing individuals in it whose deviation from the previous average has no finite limit whatever. When rightly viewed it is a very simple problem, but it has given rise, at one time or another, to a good deal of confusion and perplexity.
The problem may be stated thus:—a penny is tossed up; if it gives head I receive one pound; if heads twice running two pounds; if heads three times running four pounds, and so on; the amount to be received doubling every time that a fresh head succeeds. That is, I am to go on as long as it continues to give a succession of heads, to regard this succession as a ‘turn’ or set, and then take another turn, and so on; and for each such turn I am to receive a payment; the occurrence of tail being understood to yield nothing, in fact being omitted from our consideration. However many times head may be given in succession, the number of pounds I may claim is found by raising two to a power one less than that number of times. Here then is a series formed by a succession of throws. We will assume,—what many persons will consider to admit of demonstration, and what certainly experience confirms within considerable limits,—that the rarity of these ‘runs’ of the same face is in direct proportion to the amount I receive for them when they do occur. In other words, if we regard only the occasions on which I receive payments, we shall find that every other time I get one pound, once in four times I get two pounds, once in eight times four pounds, and so on without any end. The question is then asked, what ought I to pay for this privilege? At the risk of a slight anticipation of the results of a subsequent chapter, we may assume that this is equivalent to asking, what amount paid each time would on the average leave me neither winner nor loser? In other words, what is the average amount I should receive on the above terms? Theory pronounces that I ought to give an infinite sum: that is, no finite sum, however great, would be an adequate equivalent. And this is really quite intelligible. There is a series of indefinite length before me, and the longer I continue to work it the richer are my returns, and this without any limit whatever. It is true that the very rich hauls are extremely rare, but still they do come, and when they come they make it up by their greater richness. On every occasion on which people have devoted themselves to the pursuit in question, they made acquaintance, of course, with but a limited portion of this series; but the series on which we base our calculation is unlimited; and the inferences usually drawn as to the sum which ought in the long run to be paid for the privilege in question are in perfect accordance with this supposition.
The common form of objection is given in the reply, that so far from paying an infinite sum, no sensible man would give anything approaching to £50 for such a chance. Probably not, because no man would see enough of the series to make it worth his while. What most persons form their practical opinion upon, is such small portions of the series as they have actually seen or can reasonably expect. Now in any such portion, say one which embraces 100 turns, the longest succession of heads would not amount on the average to more than seven or eight. This is observed, but it is forgotten that the formula which produced these, would, if it had greater scope, keep on producing better and better ones without any limit. Hence it arises that some persons are perplexed, because the conduct they would adopt, in reference to the curtailed portion of the series which they are practically likely to meet with, does not find its justification in inferences which are necessarily based upon the series in the completeness of its infinitude.
§ 16. This will be more clearly seen by considering the various possibilities, and the scope required in order to exhaust them, when we confine ourselves to a limited number of throws. Begin with three. This yields eight equally likely possibilities. In four of these cases the thrower starts with tail and therefore loses: in two he gains a single point (i.e. £1); in one he gains two points, and in one he gains four points. Hence his total gain being eight pounds achieved in four different contingencies, his average gain would be two pounds.
Now suppose he be allowed to go as far as n throws, so that we have to contemplate 2n possibilities. All of these have to be taken into account if we wish to consider what happens on the average. It will readily be seen that, when all the possible cases have been reckoned once, his total gain will be (reckoned in pounds),
2n−2 + 2n−3·2 + 2n−4·22 + … + 2·2n−3 + 2n−2 + 2n−1,
(n + 1) 2n−2.
This being spread over 2n−1 different occasions of gain his average gain will be 1/2(n + 1).
Now when we are referring to averages it must be remembered that the minimum number of different occurrences necessary in order to justify the average is that which enables each of them to present itself once. A man proposes to stop short at a succession of ten heads. Well and good. We tell him that his average gain will be £5.