RPKP Update No. 9

October 8th, 1997
by John Walker
This message was originally sent to members of the RPKP mailing list. If you would like to receive future updates, please see the instructions explaining how to subscribe to the mailing list.

RPKP Experiments: Initial Results

Background

Since its inception, the goal of The RetroPsychoKinesis Project has been to make available, on the World-Wide Web, experiments which explore whether subjects can influence, with statistical significance, prerecorded but unobserved streams of binary data from a hardware random number generator. The Web is an ideal medium for experiments of this kind since volunteer subjects with Web access can participate from anywhere in the world, on their own schedule, without the need to transfer data on physical media such as floppy discs. The experiment programs are written in Java, which allows them to run on any computer with a Web browser that supports Java applets.

Since January of 1997, the on-line RPKP experiments have been available to anybody with Web access and a Java-equipped browser. To date, a total of 177 volunteer subjects have performed 2642 "on-the-record" experiments, the results of which are summarised below. For additional details on how the experiments are conducted, please see RPKP Update No. 8 or the RPKP Experiments home page.

During this pilot phase of RPKP experiments, no attempt was made to publicise them other than by word of mouth. Now, with nearly a year of experience to increase confidence that all is working as intended, we can now encourage those interested in experiments such as this to make links to the RPKP Home Page to invite interested volunteers to try the experiments for themselves.

Overview of the Experiments

Each RPKP experiment withdraws 1024 previously generated but unexamined bits from the hardware random number generator, adds them to the cumulative experiment log, then transmits the random data to the subject, accompanied by a Java application which provides visual feedback for the experiment. The subject attempts to bias the random bits toward an excess of ones or zeroes, reflected in the display of the visual feedback component.

Such an experiment is particularly simple to analyse with the tools of probability and statistics. For a genuinely random sequence of bits, and in the absence of anomalous sources of bias, results will converge, as more and more experiments are run, toward a binomial distribution for 1024 trials with a probability of 0.5: thus a mean value of 512 one and zero bits per experiment. Since the data and the subject's intent to bias it (toward an excess of ones or zeroes) are recorded in the log before the data are transmitted to the subject, many of the concerns about outright cheating and/or after-the-fact selection of favourable experiments can be excluded.

(Of course, this assumes the hardware random number generator I am using has no bias, the log of experiments is genuine and unexpurgated, and that no program involved contains an error which could bias the results. Finally, you're assuming I have not fabricated all of these results from whole cloth out of some obscure motive. Given the scientific and philosophical significance should consistent, statistically significant, divergences from chance emerge from such experiments, these concerns are entirely legitimate. That is why complete source code for all the programs involved has been made available for downloading, along with complete documentation on how to build a hardware random number generator identical to the one used in these experiments and the theory underlying the generator. Raw data for all experiments run to date can be downloaded by anybody, allowing them to independently verify the analysis performed by the log summary program and in status reports such as this. Further, subjects can verify that the log contains a full and accurate summary of their own experiments and, should discrepancies be found, notify all subscribers to this list by sending a message to rpkp@fourmilab.ch.)

In any case, other researchers are encouraged to replicate this experiment, ideally with a hardware random number generator based on a different technology (for example, a noise diode). All programs used in the RPKP experiments are in the public domain and may be downloaded, used, modified, and redistributed with no restrictions whatsoever.

All-Experiment Summary

The following chart summarises the results of all for-the-record experiments (excluding runs designated in advance as "practice" runs by the subject, which are logged for completeness, but do not figure in the statistical analysis) performed since the RPKP experiments were begun in January of 1997.

All experiment hit histogram vs. normal distribution expectation

A few words about the legend are in order. The blue curve gives the normal distribution for a large number of trials of 1024 events with probability 0.5. (For a number of trials as large as 1024, the binomial and normal distributions are equal on the scale of this plot.) The red bars show the actual number of experimental runs which resulted in the given number of hits. A "hit" is defined as the number of bits in the 1024 bit stream which agreed with the subject's previously chosen one-or-zero goal. "Subjects" is the number of different E-mail addresses or "handles" in the log file; there is no assurance a given individual may not have entered a number of different identities, either intentionally or by accident. The number of experiments includes only "for the record" experiments, as noted above. Since each experiment involves 1024 bits, the total number of "Bits" in the next line is 2642×1024, or 2705408. Examination of the logged bit sequences sent to the subjects shows that 1353558 of the total of 2705408 bits were "Hits"--they agree with the subject's previously-chosen goal. There were, then, 854 more bits among a total of 2705408 consistent with the subjects' intent to bias the generator. This is equivalent to changing one bit in every 3168 (or about one bit in every three 1024 bit experiments) in the direction desired by the subject. The measured bias amounts to a little more than 1 standard deviation.

Any experiment involving a random data source can be expected to, in the absence of perturbing influences, follow a random walk around the most probable value. As the number of experiments increases, overall divergences should decrease. When examining the results of such experiments, it's important to satisfy yourself that any non-chance effect you observe doesn't result from the experimenter choosing to show you results at a peak or trough of a series which is swinging to both sides of the chance expectation with a mean value equal to chance. The following is a deviation plot of the all 2642 RPKP experiments to date; it shows the absolute divergence of the experimental results in the direction of bias preselected by the subject compared to that expected by chance, and the divergence in terms of standard deviations for the cumulative number of trials for a probability of 0.5 on each trial.

All experiment divergence (absolute and Std.dev. from expectation

Principal Subject Summary

From the very first days of the RPKP Experiments, the Project has been graced by a volunteer subject on the East Coast of North America who has invested the time to run a total of 1606 RPKP experiment runs as of the date this document was compiled. This individual's contribution toward the understanding of this elusive, if existent, phenomenon, will be of tremendous value in pinning down its behaviour under various circumstances. For example, a recent article by James Spottiswoode in the Journal of Scientific Exploration suggests that anomalous cognition events occur with an enhanced probability at times close to 13:30 hours Local Sidereal Time. Our growing database allows tests of such claims, but only when we are able to determine the longitude of the subject. In the case of our 1606-run subject, the duration of experiments does not yet equally cover the sidereal day, so analysis of any influence of sidereal time is not possible at this time.

At the risk of being accused of after-the-fact data selection, results are presented below for the subject who ran the 1606 runs and for other 176 subjects together, none of whom ran more than 174 runs, and most of which did only a few experiments. I performed this analysis because the total RPKP database thus is a composite in which more than 60% of the experiments were performed by a single individual, with the balance consisting of modest number of runs by a variety of people all over the world. Analysing the data sets separately allows comparison between results obtained by a dedicated volunteer making a large number of runs over a period of many months and those of largely casual visitors who, for the most part, try only a few experiments. Here are hit histogram and deviation plots for the 1606-run subject.

Principal Subject hit histogram vs. normal distribution expectation

Principal subject divergence (absolute and Std.dev. from expectation

Short Run Sequence Summary

Experiments
Run
Number of
Subjects
  Experiments
Run
Number of
Subjects
159 144
228 152
324 162
413 171
510 181
67 212
74 291
83 301
91 501
103 521
112 1741
123 16061
132

The following plots are for the balance of runs, excluding those by the subject who ran the 1606 experiments. The table above gives the number of subjects who made a given number of runs.

Occasional Visitor hit histogram vs. normal distribution expectation

Occasional Visitor divergence (absolute and Std.dev. from expectation

Discussion of the Results

The objective of The RetroPsychoKinesis Project is to develop tools, perform experiments, and collect data, making all of these freely available to researchers to analyse or to conduct their own experiments. The Project does not encompass speculation on the significance or meaning of the results obtained. It is, however, worth spending a few words discussing one aspect of the data obtained so far.

Both the composite data set and the two subsets show a bias in the direction chosen by the subject, which subjectively appears to remain as the number of experiments rises. Analysis of the log indicates that most subjects choose one bits rather than zero bits as a goal (expressed in terms of the effect on the visual feedback program: for example, the clock advancing rather than running backward). Out of a total of 2642 experiments, 2237 chose a goal of one bits, as opposed to 405 with zero bits as the objective. This might simply be due to one bits being, for each experiment, the default setting in the goal check box.

The predominant choice of one bits as a goal, combined with the bias toward the subjects' goal in the results of the 2642 experiments might, if not merely a statistical fluctuation, be due to a small excess of one bits in the output of the random number source. It is therefore worth briefly discussing why I believe no such bias exists in the HotBits generator used in these experiments. HotBits employs a Krypton-85 beta-emitting radiation source, which irradiates a Geiger-Müller tube detector interfaced to a dedicated 80486 computer. See the HotBits hardware description for additional details. To generate each bit, the intervals, timed by a software loop run with interrupts prevented on the microprocessor, between two pairs of consecutive decays are measured. Since the time of individual decays are completely uncorrelated, the relative length of the two intervals should be random, except for a tiny bias toward the second interval being longer due to the decay rate falling as fewer Krypton-85 nuclei remain in the source. This effect is negligible, as discussed in more detail in the HotBits How it Works document, being on the order of 10-14 the length of the intervals measured. Further, pairs of intervals with identical timing are discarded to avoid errors due to the measurement resolution of the computer.

As an additional precaution, and to preclude other unanticipated sources of systematic error, the sense of the comparison of the two intervals is reversed for each consecutive bit. For example, in generating bit n, we emit a zero if the first interval is longer than the second and a one otherwise, then for bit n+1 we emit a zero if the first interval is shorter and a one if it is longer. Bit n+2 flips back to the same comparison used for bit n and so on. Thus, even if there were some form of bias in the generator's measurements of the first and second intervals (and I know of neither any theoretical reason to suspect such, other than the insignificant effect of long-term decay of the sample, nor did I find any experimental evidence of bias in multi-million bit tests of the generator I performed before opening public access to it), that measurement bias would manifest itself as a bias toward ones (say) in even numbered bits in the generator output stream and an equal and opposite bias for odd numbered bits. Since every RPKP experiment uses 1024 bits from the generator, even were the generator biased, the bias would not yield a net excess of zeroes or ones, but instead a bias in even and odd bits which would cancel over an even numbered set of bits.

To reiterate, I have no reason to believe there is any significant source of bias in the output of the generator whatsoever. (The finite half-life effect is present, but not significant.) But even if there were, the swapping of the sense of comparison between bits would cancel any tendency for the mean output of the generator to diverge from the expectation of 0.5. If the deviation from expectation observed in these experiments persists and/or increases as more and more experiments are performed in the future, it will be interesting to compare the results obtained in RPKP experiments using the HotBits generator and other control tests of the output of the generator. If other sites conduct their own versions of these experiments, using different random sources, that will increase confidence that, should significant results be obtained, they do not stem from a deficiency in the random source.

RPKP Site Connectivity Improvements

In February 1997, the www.fourmilab.ch site which hosts the RPKP experiments doubled the speed of its Internet connection to 256 Kb. Unfortunately, within a few months, the request rate had grown sufficiently to saturate even 256 Kb, and recently has been averaging about 60,000 requests a day. (Resources on the site other than RPKP account for the vast majority of this traffic.) An upgrade to 512 Kb has been ordered, and should be in place by mid-November. Further, sometime in November the long-delayed North American mirror site will open, with a dedicated 1 megabit per second Internet connection. By directing requests from North America to this site, they will avoid delays due to transatlantic congestion as well as that on the Swiss server's own link to the Internet.

Further Updates

It has been a long time since the last RPKP Update. I decided to defer compiling this document until enough experiments had been run in the pilot phase so first-look results were available. I'll try to publish updates to this document, in essentially the same format, when the number of accumulated experiments doubles to 5000, then redoubles to 10,000. You can, of course, observe the evolution of the RPKP experiment log yourself, or perform your own analysis of the raw data, by consulting the online experiment log.


Experiments Table of Contents

RetroPsychoKinesis Project Home