| 1. | Hodgkin, A. L., and Huxley, A. L., |
| “A Quantitative Description of Membrane Current and its Application to Conduction and Excitation in Nerve,” | |
| J. Physiol. 117:500-544 (August 1952) | |
| 2. | Crane, H. D., |
| “Neuristor—A Novel Device and System Concept,” | |
| Proc. IRE 50:2048-2060 (Oct. 1962) | |
| 3. | Harmon, L. D., Levinson, J., and Van Bergeijk, W. A., |
| “Analog Models of Neural Mechanism,” | |
| IRE Trans. on Information Theory IT-8:107-112 | |
| (Feb. 1962) | |
| 4. | Widrow, B., and Hoff, M. E., |
| “Adaptive Switching Circuits,” | |
| Stanford Electronics Lab Tech Report 1553-1, June 1960 | |
| 5. | Stewart, R. M., |
| “Electrochemical Wave Interactions and Extensive Field Effects in Excitable Cellular Structures,” | |
| First Pasadena Invitational Symposium on Self-Organizing Systems, | |
| Calif. Institute of Technology, Pasadena, Calif., 14 Nov. 1963 | |
| 6. | Nagy, G., |
| “A Survey of Analog Memory Devices,” | |
| IEEE Trans. on Electronic Cmptrs. EC-12:388-393 (Aug. 1963) | |
| 7. | Widrow, B., |
| “An Adaptive Adaline Neuron Using Chemical Memistors,” | |
| Stanford Electronics Lab Tech Report 1553-2, Oct. 1960 | |
| 8. | Vendelin, G. D., |
| “A Solid State Adaptive Component,” | |
| Stanford Electronics Lab Tech Report 1853-1, Jan. 1963 | |
| 9. | “Solion Principles of Electrochemistry and Low-Power Electrochemical Devices,” |
| Dept. of Comm., Office of Tech. Serv. PB 131931 | |
| (U. S. Naval Ord. Lab., Silver Spring, Md., Aug. 1958) |
Selection of Parameters for
Neural Net Simulations[22]
R. K. Overton
Autonetics Research Center
Anaheim, California
Research of high quality has been presented at this Symposium. Of particular interest to me were the reports of the Aeronutronic group and the Librascope group. The Aeronutronic group was commendably systematic in its investigations of different arrangements of linear threshold elements, and the Librascope data, presenting the effects of attaching different values to the parameters of simulated neurons, are both systematic and interesting.
Unfortunately, however, interest in such research can obscure a more fundamental question which seems to merit study. That question concerns the parameters, or attributes, which describe the simulated neuron. Specifically, which parameters or attributes should be selected for simulation? (For example, should a period of supernormal sensitivity be simulated following an absolutely refractory period?)
Some selection obviously has to be made. Librascope, which is trying to simulate neurons more or less faithfully, plans to build a net of ten simulated neurons. In contrast, General Dynamics/Fort Worth, with roughly the same degree of effort, is working with 3900 unfaithfully-simulated neurons. This comparison is not a criticism of either group; the Librascope team has simply selected many more parameters for simulation than has the General Dynamics group. Each can make the selections it prefers, because the parameters of real neurons which are necessary and sufficient for learning have not been exhaustively identified.
From the point of view of one whose interests include real neurons, this lack of identification is unfortunate. I once wrote a book which included some guesses about the essential attributes of neurons. Since that time, many neuron simulation programs have been written. But these programs, although interesting and worthwhile in their own right, have done little to answer the question of the necessary parameters. That is, they do not make much better guesses possible. And yet better guesses would also make for more “intelligent” machines.
INDEX OF INVITED PARTICIPANTS
| MICHAEL ARBIB | Massachusetts Institute of Technology |
| ROBERT H. ASENDORF | Hughes Research Laboratories/ Malibu |
| J. A. DALY | Astropower/Newport Beach |
| GEORGE DeFLORIO | System Development Corp./Santa Monica |
| DEREK H. FENDER | California Institute of Technology |
| LEONARD FRIEDMAN | Space Technology Labs./Redondo Beach |
| JAMES EMMETT GARVEY | ONR/Pasadena |
| THOMAS L. GRETTENBERG | California Institute of Technology |
| HAROLD HAMILTON | Librascope/Glendale |
| JOSEPH HAWKINS | Aeronutronic/Newport Beach |
| CHARLES HENDRIX | Space-General Corp./El Monte |
| R. D. JOSEPH | Astropower/Newport Beach |
| PETER A. KLEYN | Nortronics/Anaheim |
| JOHN KUHN | Space-General Corp./El Monte |
| FRANK LEHAN | Space-General Corp./El Monte |
| EDWIN LEWIS | Librascope/Glendale |
| PETER C. LOCKEMANN | California Institute of Technology |
| GILBERT D. McCANN | California Institute of Technology |
| C. J. MUNCIE | Aeronutronic/Newport Beach |
| C. OVERMIER | Nortronics/Anaheim |
| RICHARD K. OVERTON | Autonetics/Anaheim |
| DIANE RAMSEY | Astropower/Newport Beach |
| RICHARD REISS | Librascope/Glendale |
| R. I. ŚCIBOR-MARCHOCKI | Nortronics/Anaheim |
| JAMES J. SPILKER | Philco/Palo Alto |
| ROBERT M. STEWART | Space-General Corp./El Monte |
| HENNIG STIEVE | California Institute of Technology |
| RICHARD TEW | Space-General Corp./El Monte |
| JOHN THORSEN | University of California/Los Angeles |
| RICHARD VINETZ | Librascope/Glendale |
| CHRISTOPH von CAMPENHAUSEN | California Institute of Technology |
| DAVID VOWLES | California Institute of Technology |
| HORST WOLF | Astropower/Newport Beach |