A System of Logic, Ratiocinative and Inductive

by John Stuart Mill

Generalizing the result, we may say that if A occurs in a larger proportion of the cases where B is than of the cases where B is not, then will B also occur in a larger proportion of the cases where A is than of the cases where A is not; and there is some connection, through causation, between A and B. If we could ascend to the causes of the two phenomena, we should find, at some stage, either proximate or remote, some cause or causes common to both; and if we could ascertain what these are, we could frame a generalization which would be true without restriction of place or time; but until we can do so, the fact of a connection between the two phenomena remains an empirical law.

§ 3. Having considered in what manner it may be determined whether any given conjunction of phenomena is casual, or the result of some law, to complete the theory of chance it is necessary that we should now consider those effects which are partly the result of chance and partly of law, or, in other words, in which the effects of casual conjunctions of causes are habitually blended in one result with the effects of a constant cause.

This is a case of Composition of Causes; and the peculiarity of it is, that instead of two or more causes intermixing their effects in a regular manner with those of one another, we have now one constant cause, producing an effect which is successively modified by a series of variable causes. Thus, as summer advances, the approach of the sun to a vertical position tends to produce a constant increase of temperature; but with this effect of a constant cause, there are blended the effects of many variable causes, winds, clouds, evaporation, electric agencies and the like, so that the temperature of any given day depends in part on these fleeting causes, and only in part on the constant cause. If the effect of the constant cause is always accompanied and disguised by effects of variable causes, it is impossible to ascertain the law of the constant cause in the ordinary manner by separating it from all other causes and observing it apart. Hence arises the necessity of an additional rule of experimental inquiry.

When the action of a cause A is liable to be interfered with, not steadily by the same cause or causes, but by different causes at different times, and when these are so frequent, or so indeterminate, that we can not possibly exclude all of them from any experiment, though we may vary them; our resource is, to endeavor to ascertain what is the effect of all the variable causes taken together. In order to do this, we make as many trials as possible, preserving A invariable. The results of these different trials will naturally be different, since the indeterminate modifying causes are different in each; if, then, we do not find these results to be progressive, but, on the contrary, to oscillate about a certain point, one experiment giving a result a little greater, another a little less, one a result tending a little more in one direction, another a little more in the contrary direction; while the average or middle point does not vary, but different sets of experiments (taken in as great a variety of circumstances as possible) yield the same mean, provided only they be sufficiently numerous; then that mean, or average result, is the part, in each experiment, which is due to the cause A, and is the effect which would have been obtained if A could have acted alone; the variable remainder is the effect of chance, that is, of causes the co-existence of which with the cause A was merely casual. The test of the sufficiency of the induction in this case is, when any increase of the number of trials from which the average is struck does not materially alter the average.

This kind of elimination, in which we do not eliminate any one assignable cause, but the multitude of floating unassignable ones, may be termed the Elimination of Chance. We afford an example of it when we repeat an experiment, in order, by taking the mean of different results, to get rid of the effects of the unavoidable errors of each individual experiment. When there is no permanent cause, such as would produce a tendency to error peculiarly in one direction, we are warranted by experience in assuming that the errors on one side will, in a certain number of experiments, about balance the errors on the contrary side. We therefore repeat the experiment, until any change which is produced in the average of the whole by further repetition, falls within limits of error consistent with the degree of accuracy required by the purpose we have in view.[175]

§ 4. In the supposition hitherto made, the effect of the constant cause A has been assumed to form so great and conspicuous a part of the general result, that its existence never could be a matter of uncertainty, and the object of the eliminating process was only to ascertain how much is attributable to that cause; what is its exact law. Cases, however, occur in which the effect of a constant cause is so small, compared with that of some of the changeable causes with which it is liable to be casually conjoined, that of itself it escapes notice, and the very existence of any effect arising from a constant cause is first learned by the process which in general serves only for ascertaining the quantity of that effect. This case of induction may be characterized as follows: A given effect is known to be chiefly, and not known not to be wholly, determined by changeable causes. If it be wholly so produced, then if the aggregate be taken of a sufficient number of instances, the effects of these different causes will cancel one another. If, therefore, we do not find this to be the case, but, on the contrary, after such a number of trials has been made that no further increase alters the average result, we find that average to be, not zero, but some other quantity, about which, though small in comparison with the total effect, the effect nevertheless oscillates, and which is the middle point in its oscillation; we may conclude this to be the effect of some constant cause; which cause, by some of the methods already treated of, we may hope to detect. This may be called the discovery of a residual phenomenon by eliminating the effects of chance.

It is in this manner, for example, that loaded dice may be discovered. Of course no dice are so clumsily loaded that they must always throw certain numbers; otherwise the fraud would be instantly detected. The loading, a constant cause, mingles with the changeable causes which determine what cast will be thrown in each individual instance. If the dice were not [pg 378] loaded, and the throw were left to depend entirely on the changeable causes, these in a sufficient number of instances would balance one another, and there would be no preponderant number of throws of any one kind. If, therefore, after such a number of trials that no further increase of their number has any material effect upon the average, we find a preponderance in favor of a particular throw; we may conclude with assurance that there is some constant cause acting in favor of that throw, or, in other words, that the dice are not fair; and the exact amount of the unfairness. In a similar manner, what is called the diurnal variation of the barometer, which is very small compared with the variations arising from the irregular changes in the state of the atmosphere, was discovered by comparing the average height of the barometer at different hours of the day. When this comparison was made, it was found that there was a small difference, which on the average was constant, however the absolute quantities might vary, and which difference, therefore, must be the effect of a constant cause. This cause was afterward ascertained, deductively, to be the rarefaction of the air, occasioned by the increase of temperature as the day advances.

§ 5. After these general remarks on the nature of chance, we are prepared to consider in what manner assurance may be obtained that a conjunction between two phenomena, which has been observed a certain number of times, is not casual, but a result of causation, and to be received, therefore, as one of the uniformities of nature, though (until accounted for a priori) only as an empirical law.

We will suppose the strongest case, namely, that the phenomenon B has never been observed except in conjunction with A. Even then, the probability that they are connected is not measured by the total number of instances in which they have been found together, but by the excess of that number above the number due to the absolutely frequency of A. If, for example, A exists always, and therefore co-exists with every thing, no number of instances of its co-existence with B would prove a connection; as in our example of the fixed stars. If A be a fact of such common occurrence that it may be presumed to be present in half of all the cases that occur, and therefore in half the cases in which B occurs, it is only the proportional excess above half that is to be reckoned as evidence toward proving a connection between A and B.

In addition to the question, What is the number of coincidences which, on an average of a great multitude of trials, may be expected to arise from chance alone? there is also another question, namely, Of what extent of deviation from that average is the occurrence credible, from chance alone, in some number of instances smaller than that required for striking a fair average? It is not only to be considered what is the general result of the chances in the long run, but also what are the extreme limits of variation from the general result, which may occasionally be expected as the result of some smaller number of instances.