On Principles VI: Uncertainty Principle

"The uncertainty principle refers to the degree of indeterminateness in the possible present knowledge of the simultaneous values of various quantities with which the quantum theory deals; it does not restrict, for example, the exactness of a position measurement alone or a velocity measurement alone." (Werner Heisenberg, "The Uncertainty Principle", [in James R Newman, "The World of Mathematics" Vol. II], 1956)

"Both the uncertainty principle and the negentropy principle of information make Laplace's scheme [of exact determinism] completely unrealistic. The problem is an artificial one; it belongs to imaginative poetry, not to experimental science." (Léon Brillouin, "Science and Information Theory" 2^nd Ed., 1962)

"No branch of number theory is more saturated with mystery than the study of prime numbers: those exasperating, unruly integers that refuse to be divided evenly by any integers except themselves and 1. Some problems concerning primes are so simple that a child can understand them and yet so deep and far from solved that many mathematicians now suspect they have no solution. Perhaps they are 'undecideable'. Perhaps number theory, like quantum mechanics, has its own uncertainty principle that makes it necessary, in certain areas, to abandon exactness for probabilistic formulations." (Martin Gardner, "The remarkable lore of the prime numbers", Scientific American, 1964)

"In particular, the uncertainty principle has stood for a generation, barring the way to more detailed descriptions of nature; and yet, with the lesson of parity still fresh in our minds, how can anyone be quite so sure of its universal validity when we note that, to this day, it has never been subjected to even one direct experimental test?" (Edwin T Jaynes, "Foundations of Probability Theory and Statistical Mechanics", 1967)

"Because of mathematical indeterminancy and the uncertainty principle, it may be a law of nature that no nervous system is capable of acquiring enough knowledge to significantly predict the future of any other intelligent system in detail. Nor can intelligent minds gain enough self-knowledge to know their own future, capture fate, and in this sense eliminate free will." (Edward O Wilson, "On Human Nature", 1978)

"In physics, there are numerous phenomena that are said to be 'true on all scales', such as the Heisenberg uncertainty relation, to which no exception has been found over vast ranges of the variables involved (such as energy versus time, or momentum versus position). But even when the size ranges are limited, as in galaxy clusters (by the size of the universe) or the magnetic domains in a piece of iron near the transition point to ferromagnetism (by the size of the magnet), the concept true on all scales is an important postulate in analyzing otherwise often obscure observations." (Manfred Schroeder, "Fractals, Chaos, Power Laws Minutes from an Infinite Paradise", 1990)

"A bell curve shows the 'spread' or variance in our knowledge or certainty. The wider the bell the less we know. An infinitely wide bell is a flat line. Then we know nothing. The value of the quantity, position, or speed could lie anywhere on the axis. An infinitely narrow bell is a spike that is infinitely tall. Then we have complete knowledge of the value of the quantity. The uncertainty principle says that as one bell curve gets wider the other gets thinner. As one curve peaks the other spreads. So if the position bell curve becomes a spike and we have total knowledge of position, then the speed bell curve goes flat and we have total uncertainty (infinite variance) of speed." (Bart Kosko, "Fuzzy Thinking: The new science of fuzzy logic", 1993)

"According to quantum theory, the ground state, or lowest energy state, of a pendulum is not just sitting at the lowest energy point, pointing straight down. That would have both a definite position and a definite velocity, zero. This would be a violation of the uncertainty principle, which forbids the precise measurement of both position and velocity at the same time. The uncertainty in the position multiplied by the uncertainty in the momentum must be greater than a certain quantity, known as Planck's constant - a number that is too long to keep writing down, so we use a symbol for it: ħ." (Stephen W Hawking, "The Universe in a Nutshell", 2001)

"The uncertainty principle expresses a seesaw relationship between the fluctuations of certain pairs of variables, such as an electron's position and its speed. Anything that lowers the uncertainty of one must necessarily raise the uncertainty of the other; you can't push both down at the same time. For example, the more tightly you confine an electron, the more wildly it thrashes. By lowering the position end of the seesaw, you force the velocity end to lift up. On the other hand, if you try to constrain the electron's velocity instead, its position becomes fuzzier and fuzzier; the electron can turn up almost anywhere." (Steven Strogatz, "Sync: The Emerging Science of Spontaneous Order", 2003)

"The inherent nature of complexity is to doubt certainty and any pretense to finite and flawless data. Put another way, under uncertainty principles, any attempt by political systems to 'impose order' has an equal chance to instead 'impose disorder'." (Lawrence K Samuels, "Defense of Chaos: The Chaology of Politics, Economics and Human Action", 2013)

On Conservation Laws (2000-)

"Perhaps the most profound synthesis of physical sciences came from the realization that everything could be understood from 'conservation laws' and symmetry principals." (Didier Sornette, "Why Stock Markets Crash: Critical Events in Complex Systems", 2003)

"According to a 'sociological' view of mathematics, a system, in general, should be able to do whatever is permitted by the laws governing it: the normal state of anarchy is chaos! From this point of view, we should expect that, in the absence of conservation laws, typical motions should be dense in the space available to them; Kolomogorov’s theorem denies this, saying that when the laws are relaxed a bit, the majority of motions stay 'pretty much' where they were, as if in fear of a non-existent police force." (John H Hubbard, "The KAM Theorem", 2004)

"A great deal of the results in many areas of physics are presented in the form of conservation laws, stating that some quantities do not change during evolution of the system. However, the formulations in cybernetical physics are different. Since the results in cybernetical physics establish how the evolution of the system can be changed by control, they should be formulated as transformation laws, specifying the classes of changes in the evolution of the system attainable by control function from the given class, i.e., specifying the limits of control." (Alexander L Fradkov, "Cybernetical Physics: From Control of Chaos to Quantum Control", 2007)

"Each of the most basic physical laws that we know corresponds to some invariance, which in turn is equivalent to a collection of changes which form a symmetry group. […] whilst leaving some underlying theme unchanged. […] for example, the conservation of energy is equivalent to the invariance of the laws of motion with respect to translations backwards or forwards in time […] the conservation of linear momentum is equivalent to the invariance of the laws of motion with respect to the position of your laboratory in space, and the conservation of angular momentum to an invariance with respect to directional orientation [...] discovery of conservation laws indicated that Nature possessed built-in sustaining principles which prevented the world from just ceasing to be." (John D Barrow, "New Theories of Everything", 2007)

"The methodology of feedback design is borrowed from cybernetics (control theory). It is based upon methods of controlled system model’s building, methods of system states and parameters estimation (identification), and methods of feedback synthesis. The models of controlled system used in cybernetics differ from conventional models of physics and mechanics in that they have explicitly specified inputs and outputs. Unlike conventional physics results, often formulated as conservation laws, the results of cybernetical physics are formulated in the form of transformation laws, establishing the possibilities and limits of changing properties of a physical system by means of control." (Alexander L Fradkov, "Cybernetical Physics: From Control of Chaos to Quantum Control", 2007)

"Entanglement (non-separability) has been interpreted in several non-physical ways, including recourse to telekinesis; it has also been claimed that it refutes realism and confirms holism. In my view, all entanglement does is to confirm the thesis Once a system, always a system. However, this is not an independent postulate, but a consequence of conservation laws." (Mario Bunge, "Matter and Mind: A Philosophical Inquiry", 2010)

"Symmetries are transformations that keep certain parameters (properties, equations, and so on) invariant, that is, the parameters they refer to are conserved under these transformations. It is to be expected, therefore, that the identification of conserved quantities is inseparable from the identification of fundamental symmetries in the laws of nature. Symmetries single out 'privileged' operations, conservation laws single out 'privileged' quantities or properties that correspond to these operations. Yet the specific connections between a particular symmetry and the invariance it entails are far from obvious. For instance, the isotropy of space (the indistinguishability of its directions) is intuitive enough, but the conservation of angular momentum based on that symmetry, and indeed, the concept of angular momentum, are far less intuitive." (Yemima Ben-Menahem, "Causation in Science", 2018)

On Conservation Laws (-1949)

"A true philosopher does not engage in vain disputes about the nature of motion; rather, he wishes to know the laws by which it is distributed, conserved or destroyed, knowing that such laws is the basis for all natural philosophy." (Pierre L Maupertuis, "Les Loix du Mouvement et du Repos, déduites d'un Principe Métaphysique", 1746) 

"The supreme Being is everywhere; but He is not equally visible everywhere. Let us seek Him in the simplest things, in the most fundamental laws of Nature, in the universal rules by which movement is conserved, distributed or destroyed; and let us not seek Him in phenomena that are merely complex consequences of these laws." (Pierre L Maupertuis, "Les Loix du Mouvement et du Repos, déduites d'un Principe Métaphysique", 1746) 

"Nature as a whole possesses a store of force which cannot in any way be either increased or diminished [...] therefore, the quantity of force in Nature is just as eternal and unalterable as the quantity of matter [...]. I have named [this] general law 'The Principle of the Conservation of Force'." (Hermann von Helmholtz, "Uber die Erhaltung der Kraft", 1847)

"Energy really is only an integral; now, what we want to have is a substantial definition, like that of Leibniz, and this demand is justifiable to a certain degree, since our very conviction of the conservation of energy rests in great part on this foundation. [..] And so the manuals of physics contain really two discordant definitions of energy, the first which is verbal, intelligible, capable of establishing our conviction, and false; and the second which is mathematical, exact, but lacking verbal expression." (Emile Meyerson, "Identity & Reality", 1908)

"The miracles of religion are to be discredited, not because we cannot conceive of them, but because they run counter to all the rest of our knowledge; while the mysteries of science, such as chemical affinity, the conservation of energy, the indivisibility of the atom, the change of the non-living into the living […] extend the boundaries of our knowledge, though the modus operandi of the changes remains hidden." (John Burroughs, "Scientific Faith", The Atlantic Monthly, 1915)

"The most important result of a general character to which the special theory has led is concerned with the conception of mass. Before the advent of relativity, physics recognized two conservation laws of fundamental importance, namely, the law of conservation of energy and the law of the conservation of mass; these two fundamental laws appeared to be quite independent of each other. By means of the theory of relativity they have been united into one law." (Albert Einstein, 1920)

"Matter [...] could be measured as a quantity and [...] its characteristic expression as a substance was the Law of Conservation of Matter [...] This, which has hitherto represented our knowledge of space and matter, and which was in many quarters claimed by philosophers as a priori knowledge, absolutely general and necessary, stands to-day a tottering structure." (Hermann Weyl, "Space, Time, Matter", 1922)

On Synergy II

"The constructive process inheres in all forms of synergy, and the cooperation of antithetical forces in nature always results in making, that is, in creating something that did not exist before. But in the organic world this character of structure becomes the leading feature, and we have synthetic products consisting of tissues and organs serving definite purposes, which we call functions." (Lester F Ward, "Pure Sociology", 1903)

"[...] there is a universal principle, operating in every department of nature and at every stage of evolution, which is conservative, creative and constructive. [...] I have at last fixed upon the word synergy, as the term best adapted to express its twofold character of ‘energy’ and ‘mutuality’ or the systematic and organic ‘working together’ of the antithetical forces of nature. [...] Synergy is a synthesis of work, or synthetic work, and this is what is everywhere taking place. It may be said to begin with the primary atomic collision in which mass, motion, time, and space are involved, and to find its simplest expression in the formula for force, which implies a plurality of elements, and signifies an interaction of these elements." (Lester F Ward, "Pure Sociology", 1903)

"This compromise among the contending forces of nature was effected through organization and the formation of chemical systems, which are so many reservoirs of power, this power being represented by what we call the properties of matter. These systems store up energy and expend it in work, but the work is always a collaboration or cooperation of all the competing forces involved. It is synergy." (Lester F Ward, "Pure Sociology", 1903)

"Social equilibration under the principle of social synergy, while it involves a perpetual and vigorous struggle among the antagonistic social forces, still works out social structures and conserves them, and these structures perform their prescribed functions. Upon the perfection of these structures and the consequent success with which they perform their functions depends the degree of social efficiency. In the organic world the struggle has the appearance of a struggle for existence. The weaker species go to the wall and the stronger persist. There is a constant elimination of the defective and survival of the fittest. On the social plane it is the same, and weak races succumb in the struggle while strong races persist. But in both cases it is the best structures that survive." (James Q Dealey & Lester F Ward, "A Text-book of Sociology", 1905)

"Social structures are the products of social synergy, i.e., of the interaction of different social forces, all of which, in and of themselves, are destructive, but whose combined effect, mutually checking, constraining, and equilibrating one another, is to produce structures. The entire drift is toward economy, conservatism, and the prevention of waste. Social structures are mechanisms for the production of results, and the results cannot be secured without them. They are reservoirs of power." (James Q Dealey & Lester F Ward, "A Text-book of Sociology", 1905)

"The true nature of the universal principle of synergy pervading all nature and creating all the different kinds of structure that we observe to exist, must now be made clearer. Primarily and essentially it is a process of equilibration, i.e., the several forces are first brought into a state of partial equilibrium. It begins in collision, conflict, antagonism, and opposition, and then we have the milder phases of antithesis, competition, and interaction, passing next into a modus vivendi, or compromise, and ending in collaboration and cooperation." (James Q Dealey & Lester F Ward, "A Text-book of Sociology", 1905)

"Synergy is the principle that explains all organization and creates all structures. The products of cosmic synergy are found in all fields of phenomena. Celestial structures are worlds and world systems; chemical structures are atoms, molecules, and substances; biotic structures are protoplasm, cells, tissues, organs, and organisms. There are also psychic structures - feelings, emotions, passions, volitions, perceptions, cognitions, memory, imagination, reason, thought, and all the acts of consciousness. And then there are social structures […]. These are the products of the social forces acting under the principle of social synergy." (James Q Dealey & Lester F Ward, "A Text-book of Sociology", 1905)

"[...] synergy is the consequence of the energy expended in creating order. It is locked up in the viable system created, be it an organism or a social system. It is at the level of the system. It is not discernible at the level of the system. It is not discernible at the level of the system’s components. Whenever the system is dismembered to examine its components, this binding energy dissipates." (J-C Spender, "Organizational Knowledge, Collective Practice and Penrose Rents", 1999)

[synergy:] "Measure describing how one agent or system increases the satisfaction of other agents or systems." (Carlos Gershenson, "Design and Control of Self-organizing Systems", 2007)

"To develop a Control, the designer should find aspect systems, subsystems, or constraints that will prevent the negative interferences between elements (friction) and promote positive interferences (synergy). In other words, the designer should search for ways of minimizing frictions that will result in maximization of the global satisfaction" (Carlos Gershenson, "Design and Control of Self-organizing Systems", 2007)

On Principles (1975-1999)

"No theory ever agrees with all the facts in its domain, yet it is not always the theory that is to blame. Facts are constituted by older ideologies, and a clash between facts and theories may be proof of progress. It is also a first step in our attempt to find the principles implicit in familiar observational notions." (Paul K Feyerabend, "Against Method: Outline of an Anarchistic Theory of Knowledge", 1975)

"The conception of the mental construction which is the fully analysed proof as being an infinite structure must, of course, be interpreted in the light of the intuitionist view that all infinity is potential infinity: the mental construction consists of a grasp of general principles according to which any finite segment of the proof could be explicitly constructed." (Michael Dummett, "The philosophical basis of intuitionistic logic", 1975)

"A good theorem will almost always have a wide-ranging influence on later mathematics, simply by virtue of the fact that it is true. Since it is true, it must be true for some reason; and if that reason lies deep, then the uncovering of it will usually require a deeper understanding of neighboring facts and principles." (Ian Richards, "Number theory", 1978)

"Real progress in understanding nature is rarely incremental. All important advances are sudden intuitions, new principles, new ways of seeing." (Marilyn Ferguson, "The Aquarian Conspiracy: Personal and Social Transformation in the 1980s", 1980)

"For the great majority of mathematicians, mathematics is […] a whole world of invention and discovery - an art. The construction of a new theorem, the intuition of some new principle, or the creation of a new branch of mathematics is the triumph of the creative imagination of the mathematician, which can be compared to that of a poet, the painter and the sculptor." (George F J Temple, "100 Years of Mathematics: a Personal Viewpoint", 1981)

"Both religion and science must preserve their autonomy and their distinctiveness. Religion is not founded on science nor is science an extension of religion. Each should possess its own principles, its pattern of procedures, its diversities of interpretation and its own conclusions." (Pope John Paul II, [Letter to Father George V Coyne], 1988)

"[…] mathematics does not come to us written indelibly on Nature’s Tablets, but rather is the product of a controlled search governed by metaphorical considerations, the premier instance being the heuristics of the conservation principles." (Philip Mirowski, "More Heat than Light: Economics as Social Physics: Physics as Nature’s Economics", 1989)

"Principles are the territory. Values are maps. When we value correct principles, we have truth - a knowledge of things as they are." (Stephen R Covey, "The 7 Habits of Highly Effective People", 1989)

"The ‘objective reality’, or the territory itself, is composed of ‘lighthouse’ principles that govern human growth and happiness - natural laws that are woven into the fabric of every civilized society throughout history and comprise the roots of every family and institution that has endured and prospered. The degree to which our mental maps accurately describe the territory does not alter its existence." (Stephen Covey, "The 7 Habits of Highly Effective People", 1989)

"A distinctive feature of mathematics, that feature in virtue of which it stands as a paradigmatically rational discipline, is that assertions are not accepted without proof. […] By proof is meant a deductively valid, rationally compelling argument which shows why this must be so, given what it is to be a triangle. But arguments always have premises so that if there are to be any proofs there must also be starting points, premises which are agreed to be necessarily true, self-evident, neither capable of, nor standing in need of, further justification. The conception of mathematics as a discipline in which proofs are required must therefore also be a conception of a discipline in which a systematic and hierarchical order is imposed on its various branches. Some propositions appear as first principles, accepted without proof, and others are ordered on the basis of how directly they can be proved from these first principle. Basic theorems, once proved, are then used to prove further results, and so on. Thus there is a sense in which, so long as mathematicians demand and provide proofs, they must necessarily organize their discipline along lines approximating to the pattern to be found in Euclid's Elements." (Mary Tiles,"Mathematics and the Image of Reason" , 1991)

"The word theory, as used in the natural sciences, doesn’t mean an idea tentatively held for purposes of argument - that we call a hypothesis. Rather, a theory is a set of logically consistent abstract principles that explain a body of concrete facts. It is the logical connections among the principles and the facts that characterize a theory as truth. No one element of a theory [...] can be changed without creating a logical contradiction that invalidates the entire system. Thus, although it may not be possible to substantiate directly a particular principle in the theory, the principle is validated by the consistency of the entire logical structure." (Alan Cromer, "Uncommon Sense: The Heretical Nature of Science", 1993)

"Within image theory, it is suggested that important components of decision-making processes are the different 'images' that a person may use to evaluate choice options. Images may represent a person's principles, goals, or plans. Decision options may then match or not match these images and be adopted, rejected, considered further, depending on circumstances." (Deborah J Terry & Michael A Hogg, "Attitudes, Behavior, and Social Context: The Role of Norms and Group Membership", 1999)

On Principles (1950-1974)

 "It is more important to have a clear understanding of general principles, without, however, thinking of them as fixed laws, than to load the mind with a mass of detailed technical information which can readily be found in reference books or card indexes." (William I B Beveridge, "The Art of Scientific Investigation", 1950)

"[…] the chief reason in favor of any theory on the principles of mathematics must always be inductive, i.e., it must lie in the fact that the theory in question enables us to deduce ordinary mathematics. In mathematics, the greatest degree of self-evidence is usually not to be found quite at the beginning, but at some later point; hence the early deductions, until they reach this point, give reasons rather from them, than for believing the premises because true consequences follow from them, than for believing the consequences because they follow from the premises." (Alfred N Whitehead, "Principia Mathematica", 1950)

"The principle of complementarity states that no single model is possible which could provide a precise and rational analysis of the connections between these phenomena [before and after measurement]. In such a case, we are not supposed, for example, to attempt to describe in detail how future phenomena arise out of past phenomena. Instead, we should simply accept without further analysis the fact that future phenomena do in fact somehow manage to be produced, in a way that is, however, necessarily beyond the possibility of a detailed description. The only aim of a mathematical theory is then to predict the statistical relations, if any, connecting the phenomena." (David Bohm, "A Suggested Interpretation of the Quantum Theory in Terms of ‘Hidden’ Variables", 1952)

"We have thus assigned to pure reason and experience their places in a theoretical system of physics. The structure of the system is the work of reason: the empirical contents and their mutual relations must find their representation in the conclusions of the theory. In the possibility of such a representation lie the sole value and justification of the whole system, and especially of the concepts and fundamental principles which underlie it. Apart from that, these latter are free inventions of human intellect, which cannot be justified either by the nature of that intellect or in any other fashion a priori." (Albert Einstein, "Ideas and Opinions", 1954)

"For a physicist mathematics is not just a tool by means of which phenomena can be calculated, it is the main source of concepts and principles by means of which new theories can be created." (Freeman Dyson, "Mathematics in the Physical Sciences", Scientific American, 1964)

"The method of guessing the equation seems to be a pretty effective way of guessing new laws. This shows again that mathematics is a deep way of expressing nature, and any attempt to express nature in philosophical principles, or in seat-of-the-pants mechanical feelings, is not an efficient way." (Richard Feynman, "The Character of Physical Law", 1965)

"Traditional organizational theories have tended to view the human organization as a closed system. This tendency has led to a disregard of differing organizational environments and the nature of organizational dependency on environment. It has led also to an over-concentration on principles of internal organizational functioning, with consequent failure to develop and understand the processes of feedback which are essential to survival." (Daniel Katz, "The Social Psychology of Organizations", 1966)

"The parallelism of general conceptions or even special laws in different fields therefore is a consequence of the fact that these are concerned with 'systems' and that certain general principles apply to systems irrespective of their nature. Hence principles such as those of wholeness and sum, mechanization, hierarchic order, approached to steady states, equifinality, etc., may appear in quite different disciplines. The isomorphism found in different realms is based of the existence of general system principles, of a more or less well-developed ‘general system theory’." (Ludwig von Bertalanffy, "General System Theory", 1968)

"Thus, there exist models, principles, and laws that apply to generalized systems or their subclasses, irrespective of their particular kind, the nature of their component elements, and the relations or 'forces' between them. It seems legitimate to ask for a theory, not of systems of a more or less special kind, but of universal principles applying to systems in general. In this way we postulate a new discipline called General System Theory. Its subject matter is the formulation and derivation of those principles which are valid for ‘systems’ in general." (Ludwig von Bertalanffy, „General System Theory: Foundations, Development, Applications", 1968)

"Modern scientific principle has been drawn from the investigation of natural laws, technology has developed from the experience of doing, and the two have been combined by means of mathematical system to form what we call engineering." (George S Emmerson, "Engineering Education: A Social History", 1973)

On Principles (1900-1949)

 "The fact that all Mathematics is Symbolic Logic is one of the greatest discoveries of our age; and when this fact has been established, the remainder of the principles of mathematics consists in the analysis of Symbolic Logic itself." (Bertrand Russell, "Principles of Mathematics", 1903)

"A physical theory is not an explanation. It is a system of mathematical propositions, deduced from a small number of principles, which aim to represent as simply, as completely, and as exactly as possible a set of experimental laws. […] Thus a true theory is not a theory which gives an explanation of physical appearances in conformity with reality; it is a theory which represents in a satisfactory manner a group of experimental laws. A false theory is not an attempt at an explanation based on assumptions contrary to reality; it is a ·group of propositions which do not agree with the experimental laws. Agreement with experiment is the sole criterion of truth for a physical theory." (Pierre-Maurice-Marie Duhem, "La théorie physique. Son objet, sa structure", 1906)

"Today it is no longer questioned that the principles of the analysts are the more far-reaching. Indeed, the synthesists lack two things in order to engage in a general theory of algebraic configurations: these are on the one hand a definition of imaginary elements, on the other an interpretation of general algebraic concepts. Both of these have subsequently been developed in synthetic form, but to do this the essential principle of synthetic geometry had to be set aside. This principle which manifests itself so brilliantly in the theory of linear forms and the forms of the second degree, is the possibility of immediate proof by means of visualized constructions." (Felix Klein, "Riemannsche Flächen", 1906)

"Banishing fundamental facts or problems from science merely because they cannot be dealt with by means of certain prescribed principles would be like forbidding the further extension of the theory of parallels in geometry because the axiom upon which this theory rests has been shown to be unprovable. Actually, principles must be judged from the point of view of science, and not science from the point of view of principles fixed once and for all." (Ernst Zermelo, "Neuer Beweis für die Möglichkeit einer Wohlordnung", Mathematische Annalen 65, 1908)

"Now even in mathematics unprovability, as is well known, is in no way equivalent to nonvalidity, since, after all, not everything can be proved, but every proof in turn presupposes unproved principles. Thus, in order to reject such a fundamental principle, one would have to ascertain that in some particular case it did not hold or to derive contradictory consequences from it; but none of my opponents has made any attempt to do this." (Ernst Zermelo, "Neuer Beweis für die Möglichkeit einer Wohlordnung", Mathematische Annalen 65, 1908)

"Every one knows there are mathematical axioms. Mathematicians have, from the days of Euclid, very wisely laid down the axioms or first principles on which they reason. And the effect which this appears to have had upon the stability and happy progress of this science, gives no small encouragement to attempt to lay the foundation of other sciences in a similar manner, as far as we are able." (William K Clifford et al, "Scottish Philosophy of Common Sense", 1915)

"A modern mathematical proof is not very different from a modern machine, or a modern test setup: the simple fundamental principles are hidden and almost invisible under a mass of technical details." (Hermann Weyl, "Unterrichtsblätter für Mathematik und Naturwissenschaften", 1932)

"It goes without saying that the laws of nature are in themselves independent of the properties of the instruments with which they are measured. Therefore in every observation of natural phenomena we must remember the principle that the reliability of the measuring apparatus must always play an important role." (Max Planck,"Where is Science Going?", 1932)

"I think that we shall have to get accustomed to the idea that we must not look upon science as a 'body of knowledge,' but rather as a system of hypotheses; that is to say, as a system of guesses or anticipations which in principle cannot be justified, but with which we work as long as they stand up to tests, and of which we are never justified in saying that we know they are 'true' or 'more or less certain' or even 'probable’." (Karl R Popper, "The Logic of Scientific Discovery", 1934)

"The fundamental gospel of statistics is to push back the domain of ignorance, prejudice, rule-of-thumb, arbitrary or premature decisions, tradition, and dogmatism and to increase the domain in which decisions are made and principles are formulated on the basis of analyzed quantitative facts." (Robert W Burgess, "The Whole Duty of the Statistical Forecaster", Journal of the American Statistical Association , Vol. 32, No. 200, 1937)  

"When an active individual of sound common sense perceives the sordid state of the world, desire to change it becomes the guiding principle by which he organizes given facts and shapes them into a theory. The methods and categories as well as the transformation of the theory can be understood only in connection with his taking of sides. This, in turn, discloses both his sound common sense and the character of the world. Right thinking depends as much on right willing as right willing on right thinking." (Max Horkheimer, "The Latest Attack on Metaphysics", 1937)

"The question of the origin of the hypothesis belongs to a domain in which no very general rules can be given; experiment, analogy and constructive intuition play their part here. But once the correct hypothesis is formulated, the principle of mathematical induction is often sufficient to provide the proof." (Richard Courant & Herbert Robbins, "What Is Mathematics?: An Elementary Approach to Ideas and Methods" , 1941)

"It is to be hoped that in the future more and more theoretical physicists will command a deep knowledge of mathematical principles; and also that mathematicians will no longer limit themselves so exclusively to the aesthetic development of mathematical abstractions." (George D Birkhoff, "Mathematical Nature of Physical Theories" American Scientific Vol. 31 (4), 1943)

"Of course we have still to face the question why these analogies between different mechanisms - these similarities of relation-structure - should exist. To see common principles and simple rules running through such complexity is at first perplexing though intriguing. When, however, we find that the apparently complex objects around us are combinations of a few almost indestructible units, such as electrons, it becomes less perplexing." (Kenneth Craik, "The Nature of Explanation", 1943)

"We can put it down as one of the principles learned from the history of science that a theory is only overthrown by a better theory, never merely by contradictory facts." (James B Conant, "On Understanding Science", 1947)

"It is always more easy to discover and proclaim general principles than it is to apply them." (Winston Churchill, "The Second World War: The gathering storm", 1948)

On Principles (1850-1899)

 "In the original discovery of a proposition of practical utility, by deduction from general principles and from experimental data, a complex algebraical investigation is often not merely useful, but indispensable; but in expounding such a proposition as a part of practical science, and applying it to practical purposes, simplicity is of the importance: - and […] the more thoroughly a scientific man has studied higher mathematics, the more fully does he become aware of this truth – and […] the better qualified does he become to free the exposition and application of principles from mathematical intricacy." (William J M Rankine, "On the Harmony of Theory and Practice in Mechanics", 1856)

"It is easily seen from a consideration of the nature of demonstration and analysis that there can and must be truths which cannot be reduced by any analysis to identities or to the principle of contradiction but which involve an infinite series of reasons which only God can see through." (Gottfried W Leibniz, "Nouvelles lettres et opuscules inédits", 1857)

"It is, after all, a principle of logic not to multiply entities unnecessarily." (Antoine-Laurent Lavoisier, "Réflexions sur le phlogistique", 1862)

"The more man inquires into the laws which regulate the material universe, the more he is convinced that all its varied forms arise from the action of a few simple principles. These principles themselves converge, with accelerating force, towards some still more comprehensive law to which all matter seems to be submitted. Simple as that law may possibly be, it must be remembered that it is only one amongst an infinite number of simple laws: that each of these laws has consequences at least as extensive as the existing one, and therefore that the Creator who selected the present law must have foreseen the consequences of all other laws." (Charles Babbage, "Passages From the Life of a Philosopher", 1864)

"As in the experimental sciences, truth cannot be distinguished from error as long as firm principles have not been established through the rigorous observation of facts." (Louis Pasteur, "Étude sur la maladie des vers à soie", 1870)

"Some definite interpretation of a linear algebra would, at first sight, appear indispensable to its successful application. But on the contrary, it is a singular fact, and one quite consonant with the principles of sound logic, that its first and general use is mostly to be expected from its want of significance. The interpretation is a trammel to the use. Symbols are essential to comprehensive argument." (Benjamin Peirce, "On the Uses and Transformations of Linear Algebra", 1875)

"I say that a manifold (a collection, a set) of elements that belong to any conceptual sphere is well-defined, when on the basis of its definition and as a consequence of the logical principle of excluded middle it must be regarded as internally determined, both whether an object pertaining to the same conceptual sphere belongs or not as an element to the manifold, and whether two objects belonging to the set are equal to each other or not, despite formal differences in the ways of determination." (Georg Cantor, "Ober unendliche, lineare Punktmannichfaltigkeiten", 1879)

"It is of the nature of true science to take nothing on trust or on authority. Every fact must be established by accurate observation, experiment, or calculation. Every law and principle must rest on inductive argument. The apostolic motto, ‘Prove all things, hold fast that which is good’, is thoroughly scientific. It is true that the mere reader of popular science must often be content to take that on testimony which he cannot personally verify; but it is desirable that even the most cursory reader should fully comprehend the modes in which facts are ascertained and the reasons on which the conclusions are based." (Sir John W Dawson, "The Chain of Life in Geological Time", 1880)

"[…] not only a knowledge of the ideas that have been accepted and cultivated by subsequent teachers is necessary for the historical understanding of a science, but also that the rejected and transient thoughts of the inquirers, nay even apparently erroneous notions, may be very important and very instructive. The historical investigation of the development of a science is most needful, lest the principles treasured up in it become a system of half-understood prescripts, or worse, a system of prejudices." (Ernst Mach, "The Science of Mechanics", 1883)

"As for me (and probably I am not alone in this opinion), I believe that a single universally valid principle summarizing an abundance of established experimental facts according to the rules of induction, is more reliable than a theory which by its nature can never be directly verified; so I prefer to give up the theory rather than the principle, if the two are incompatible." (Ernst Zermelo, "Über mechanische Erklärungen irreversibler Vorgänge. Eine Antwort auf Hrn. Boltzmann’s ‘Entgegnung’" Annalen der Physik und Chemie 59, 1896)

On Principles (1800-1849)

"Mathematical analysis is as extensive as nature itself; it defines all perceptible relations, measures times, spaces, forces, temperatures; this difficult science is formed slowly, but it preserves every principle which it has once acquired; it grows and strengthens itself incessantly in the midst of the many variations and errors of the human mind. It's chief attribute is clearness; it has no marks to express confused notations. It brings together phenomena the most diverse, and discovers the hidden analogies which unite them." (J B Joseph Fourier, "The Analytical Theory of Heat", 1822)

"The aim of every science is foresight. For the laws of established observation of phenomena are generally employed to foresee their succession. All men, however little advanced make true predictions, which are always based on the same principle, the knowledge of the future from the past." (Auguste Compte, "Plan des travaux scientifiques nécessaires pour réorganiser la société", 1822)

"It is true that of far the greater part of things, we must content ourselves with such knowledge as description may exhibit, or analogy supply; but it is true likewise, that these ideas are always incomplete, and that at least, till we have compared them with realities, we do not know them to be just. As we see more, we become possessed of more certainties, and consequently gain more principles of reasoning, and found a wider base of analogy." (Samuel Johnson, 1825)

"To invent without scruple a new principle to every new phenomenon, instead of adapting it to the old; to overload our hypothesis with a variety of this kind, are certain proofs that none of these principles is the just one, and that we only desire, by a number of falsehoods, to cover our ignorance of the truth." (David Hume, "Of the passions", 1826)

"In Pure Mathematics, where all the various truths are necessarily connected with each other, (being all necessarily connected with those hypotheses which are the principles of the science), an arrangement is beautiful in proportion as the principles are few; and what we admire perhaps chiefly in the science, is the astonishing variety of consequences which may be demonstrably deduced from so small a number of premises." (Dugald Stewart, "Elements of the Philosophy of the Human Mind" Vol. 3, 1827)

"For one person who is blessed with the power of invention, many will always be found who have the capacity of applying principles." (Charles Babbage, "Reflections on the Decline of Science in England, and on Some of Its Causes", 1830)

"A maxim is a conclusion upon observation of matters of fact, and is merely speculative; a ‘principle’ carries knowledge within itself, and is prospective." (Samuel T Coleridge, "The Table Talk and Omniana of Samuel Taylor Coleridge", 1831)

"The function of theory is to put all this in systematic order, clearly and comprehensively, and to trace each action to an adequate, compelling cause. […] Theory should cast a steady light on all phenomena so that we can more easily recognize and eliminate the weeds that always spring from ignorance; it should show how one thing is related to another, and keep the important and the unimportant separate. If concepts combine of their own accord to form that nucleus of truth we call a principle, if they spontaneously compose a pattern that becomes a rule, it is the task of the theorist to make this clear." (Carl von Clausewitz, "On War", 1832)

"The insights gained and garnered by the mind in its wanderings among basic concepts are benefits that theory can provide. Theory cannot equip the mind with formulas for solving problems, nor can it mark the narrow path on which the sole solution is supposed to lie by planting a hedge of principles on either side. But it can give the mind insight into the great mass of phenomena and of their relationships, then leave it free to rise into the higher realms of action." (Carl von Clausewitz, "On War", 1832)

"Algebra, as an art, can be of no use to any one in the business of life; certainly not as taught in the schools. I appeal to every man who has been through the school routine whether this be not the case. Taught as an art it is of little use in the higher mathematics, as those are made to feel who attempt to study the differential calculus without knowing more of the principles than is contained in books of rules." (Augustus de Morgan, "Elements of Algebra", 1837)

"These sciences, Geometry, Theoretical Arithmetic and Algebra, have no principles besides definitions and axioms, and no process of proof but deduction; this process, however, assuming a most remarkable character; and exhibiting a combination of simplicity and complexity, of rigour and generality, quite unparalleled in other subjects." (William Whewell, "The Philosophy of the Inductive Sciences", 1840)

"[…] in order to observe, our mind has need of some theory or other. If in contemplating phenomena we did not immediately connect them with principles, not only would it be impossible for us to combine these isolated observations, and therefore to derive profit from them, but we should even be entirely incapable of remembering facts, which would for the most remain unnoted by us." (Auguste Comte, "Cours de Philosophie Positive", 1830-1842)

"There are, undoubtedly, the most ample reasons for stating both the principles and theorems [of geometry] in their general form […] But, that an unpractised learner, even in making use of one theorem to demonstrate another, reasons rather from particular to particular than from the general proposition, is manifest from the difficulty he finds in applying a theorem to a case in which the configuration of the diagram is extremely unlike that of the diagram by which the original theorem was demonstrated. A difficulty which, except in cases of unusual mental powers, long practice can alone remove, and removes chiefly by rendering us familiar with all the configurations consistent with the general conditions of the theorem." (John S Mill, "A System of Logic", 1843)

"In truth, ideas and principles are independent of men; the application of them and their illustration is man's duty and merit." (Edward Forbes, 1847)

On Principles (1799-1799)

"[…] for the saving the long progression of the thoughts to remote and first principles in every case, the mind should provide itself several stages; that is to say, intermediate principles, which it might have recourse to in the examining those positions that come in its way. These, though they are not self-evident principles, yet, if they have been made out from them by a wary and unquestionable deduction, may be depended on as certain and infallible truths, and serve as unquestionable truths to prove other points depending upon them, by a nearer and shorter view than remote and general maxims. […] And thus mathematicians do, who do not in every new problem run it back to the first axioms through all the whole train of intermediate propositions. Certain theorems that they have settled to themselves upon sure demonstration, serve to resolve to them multitudes of propositions which depend on them, and are as firmly made out from thence as if the mind went afresh over every link of the whole chain that tie them to first self-evident principles." (John Locke, "The Conduct of the Understanding", 1706)

"[Mathematics] guides our minds in an orderly way, and furnishes us simple and rational principles by means of which ambiguities are clarified, disorder is converted into order, and complexities are analyzed into their component parts." (Johann B Mencken, "The Charlatanry of the Learned", 1715)

"Principles taken upon trust, consequences lamely deduced from them, want of coherence in the parts, and of evidence in the whole, these are every where to be met with in the systems of the most eminent philosophers, and seem to have drawn disgrace upon philosophy itself." (David Hume, "A Treatise of Human Nature", 1739-40)

"In mathematics it [sophistry] had no place from the beginning: Mathematicians having had the wisdom to define accurately the terms they use, and to lay down, as axioms, the first principles on which their reasoning is grounded. Accordingly we find no parties among mathematicians, and hardly any disputes." (Thomas Reid, "Essays on the Intellectual Powers of Man", 1785)

"Men are often led into errors by the love of simplicity, which disposes us to reduce things to few principles, and to conceive a greater simplicity in nature than there really is." (Thomas Reid, "Essays on the Intellectual Powers of Man", 1785)

"Metaphysical truths can only be established by producing effects from corresponding causes; and though we may confront such demonstrative evidence with the immutable laws of mathematical decision, we must be sensible that there will still remain some pretense for doubt; thus the basis of that knowledge, which on these principles we have been long labouring to accomplish, will become an endless toil, an endless force for controversy: and having the passions and the prejudices of mankind to combat, which mathematical certainty can alone effectually suppress, we must content ourselves only with making converts of those who have minds sufficiently expansive without the shackles of Euclid, and the vanity of displaying their own learning and pedantry." (James Douglas, "A Dissertation on the Antiquity of the Earth", 1785)

"Every science has for its basis a system of principles as fixed and unalterable as those by which the universe is regulated and governed. Man cannot make principles; he can only discover them." (Thomas Paine, "The Age of Reason", 1794)

On Principles (-1699)

"In all disciplines in which there is systematic knowledge of things with principles, causes, or elements, it arises from a grasp of those: we think we have knowledge of a thing when we have found its primary causes and principles, and followed it back to its elements." (Aristotle, "Physics", cca. 350 BC)

"The chief forms of beauty are order and symmetry and definiteness, which the mathematical sciences demonstrate in a special degree. And since these (e.g. order and definiteness) are obviously causes of many things, evidently these sciences must treat this sort of causative principle also (i.e. the beautiful) as in some sense a cause." (Aristotle, "Metaphysica", cca. 350 BC)

"Reflexion is careful and laborious thought, and watchful attention directed to the agreeable effect of one's plan. Invention, on the other hand, is the solving of intricate problems and the discovery of new principles by means of brilliancy and versatility." (Marcus Vitruvius Pollio, "De architectura" ["On Architecture], cca. 15BC)

"[…] the least initial deviation from the truth is multiplied later a thousand-fold. Admit, for instance, the existence of a minimum magnitude, and you will find that the minimum which you have introduced, small as it is, causes the greatest truths of mathematics to totter. The reason is that a principle is great rather in power than in extent; hence that which was small at the start turns out a giant at the end." (St. Thomas Aquinas, "De Ente et Essentia", cca. 1252)

"All that is required between cognizer and cognized is a likeness in terms of representation, not a likeness in terms of an agreement in nature. For it's plain that the form of a stone in the soul is of a far higher nature than the form of a stone in matter. But that form, insofar as it represents the stone, is to that extent the principle leading to its cognition." (Thomas Aquinas, "Quaestiones disputatae de veritate", cca. 1256-1259)

"It is superfluous to suppose that what can be accounted for by a few principles has been produced by many." (Thomas Aquinas, "Summa Theologica", cca. 1266-1273)

"Reason may be employed in two ways to establish a point: first for the purpose of furnishing sufficient proof of some principle, as in natural science, where sufficient proof can be brought to show that the movement of the heavens is always of uniform velocity. Reason is employed in another way, not as furnishing a sufficient proof of a principle, but as confirming an already established principle, by showing the congruity of its results […]" (Saint Thomas Aquinas, "Summa Theologica", cca. 1266-1273)

"There are and can be only two ways of searching into and discovering truth. The one flies from the senses and particulars to the most general axioms, and from these principles, the truth of which it takes for settled and immovable, proceeds to judgment and to the discovery of middle axioms. And this way is now in fashion. The other derives axioms from the senses and particulars, rising by a gradual and unbroken ascent, so that it arrives at the most general axioms last of all. This is the true way, but as yet untried." (Francis Bacon, "Novum Organum", 1620)

"Reality cannot be found except in One single source, because of the interconnection of all things with one another. […] It is a good thing to proceed in order and to establish propositions (principles). This is the way to gain ground and to progress with certainty." (Gottfried Leibniz, 1670)

On Principles (Unsourced)

 "A small error in the beginning (or in principles) leads to a big error in the end (or in conclusions)." (ancient axiom)

"A theory of physics is not an explanation; it is a system of mathematical oppositions deduced from a small number of principles the aim of which is to represent as simply, as completely, and as exactly as possible, a group of experimental laws." (Pierre-Maurice-Marie Duhem)

"It [science] has as its highest principle and most coveted aim the solution of the problem to condense all natural phenomena which have been observed and are still to be observed into one simple principle, that allows the computation of past and more especially of future processes from present ones. [...] Amid the more or less general laws which mark the achievements of physical science during the course of the last centuries, the principle of least action is perhaps that which, as regards form and content, may claim to come nearest to that ideal final aim of theoretical research." (Max Planck)

"No mathematical exactness without explicit proof from assumed principles – such is the motto of the modern geometer." (George Bruce Halsted)

"The aim of every science is foresight (prevoyance). For the laws of established observation of phenomena are generally employed to foresee their succession. All men, however little advanced make true predictions, which are always based on the same principle, the knowledge of the future from the past." (Auguste Compte)

"The mathematician is entirely free, within the limits of his imagination, to construct what worlds he pleases. What he is to imagine is a matter for his own caprice; he is not thereby discovering the fundamental principles of the universe nor becoming acquainted with the ideas of God." (John W N Sullivan)

"The most general law in nature is equity - the principle of balance and symmetry which guides the growth of forms along the lines of the greatest structural efficiency." (Herbert Read)

"[…] the mathematician learns early to accept no fact, to believe no statement, however apparently reasonable or obvious or trivial, until it has been proved, rigorously and totally by a series of steps proceeding from universally accepted first principles." (Alfred Adler)

"There is a great difference between the spirit of Mathematics and the spirit of Observation. In the former, the principles are palpable, but remote from common use; so that from want of custom it is not easy to turn our head in that direction; but if it be thus turned ever so little, the principles are seen fully confessed, and it would argue a mind incorrigibly false to reason inconsequentially on principles so obtrusive that it is hardly possible to overlook them." (Blaise Pascal)

"There is no law of physics that does not lend itself to most economical derivation from a symmetry principle. However, a symmetry principle hides from view any sight of the deeper structure that underpins that law and therefore also prevents any immediate sight of how in each case that mutability comes about." (John A Wheeler)

"We consider it a good principle to explain the phenomena by the simplest hypothesis possible." (Ptolemy)

"What makes a great mathematician? A feel for form, a strong sense of what is important. Möbius had both in abundance. He knew that topology was important. He knew that symmetry is a fundamental and powerful mathematical principle. The judgment of posterity is clear: Möbius was right." (Ian Stewart)

On Knowledge (1800-1824)

"Knowledge is only real and can only be set forth fully in the form of science, in the form of system." (G W Friedrich Hegel, "The Phenomenology of Mind", 1807)

"It is not knowledge, but the act of learning, not possession but the act of getting there, which grants the greatest enjoyment. When I have clarified and exhausted a subject, then I turn away from it, in order to go into darkness again; the never satisfied man is so strange if he has completed a structure, then it is not in order to dwell in it peacefully, but in order to begin another. I imagine the world conqueror must feel thus, who, after one kingdom is scarcely conquered, stretched out his arms for others." (Carl F Gauss, [Letter to Farkas Bolyai] 1808)

"Thus then does the Doctrine of Knowledge, which in its substance is the realisation of the absolute Power of intelligising which has now been defined, end with the recognition of itself as a mere Schema in a Doctrine of Wisdom, although indeed a necessary and indispensable means to such a Doctrine: - a Schema, the sole aim of which is, with the knowledge thus acquired, - by which knowledge alone a Will, clear and intelligible to itself and reposing upon itself without wavering or perplexity, is possible, - to return wholly into Actual Life; - not into the Life of blind and irrational Instinct which we have laid bare in all its nothingness, but into the Divine Life which shall become visible to us." (Johann G Fichte, "Outline of the Doctrine of Knowledge", 1810)

"The most important questions of life are, for the most part, really only problems of probability. Strictly speaking one may even say that nearly all our knowledge is problematical; and in the small number of things which we are able to know with certainty, even in the mathematical sciences themselves, induction and analogy, the principal means for discovering truth, are based on probabilities, so that the entire system of human knowledge is connected with this theory." (Pierre-Simon Laplace, "Theorie Analytique des Probabilités", 1812)

"One may even say, strictly speaking, that almost all our knowledge is only probable; and in the small number of things that we are able to know with certainty, in the mathematical sciences themselves, the principal means of arriving at the truth - induction and analogy - are based on probabilities, so that the whole system of human knowledge is tied up with the theory set out in this essay." (Pierre-Simon Laplace, "Philosophical Essay on Probabilities", 1814) 

"[...] all knowledge, and especially the weightiest knowledge of the truth, to which only a brief triumph is allotted between the two long periods in which it is condemned as paradoxical or disparaged as trivial." (Arthur Schopenhauer, "The World as Will and Representation", 1819)

"The highest knowledge can be nothing more than the shortest and clearest road to truth; all the rest is pretension, not performance, mere verbiage and grandiloquence, from which we can learn nothing." (Charles C Colton, "Lacon", 1820)

"We [...] are profiting not only by the knowledge, but also by the ignorance, not only by the discoveries, but also by the errors of our forefathers; for the march of science, like that of time, has been progressing in the darkness, no less than in the light." (Charles C Colton, "Lacon", 1820)

"The aim of every science is foresight. For the laws of established observation of phenomena are generally employed to foresee their succession. All men, however little advanced make true predictions, which are always based on the same principle, the knowledge of the future from the past." (Auguste Compte, "Plan des travaux scientifiques nécessaires pour réorganiser la société", 1822)

Sophie Germain - Collected Quotes

"It appears that in everything the interest of ideas is in inverse proportion to the usefulness they have in practice. This is not surprising when we consider that the human intellect, when working for its own satisfaction, should encounter the greatest intellectual beauties rather than when guided by an external motive [...]" (Sophie Germain, [letter to Gauss] 1809)

"But by far the greatest obstacle to the progress of science and to the undertaking of new tasks and provinces therein is found in this: that men despair and think things impossible." (Sophie Germain, 1813)

"If a hypothesis contains all that is part of the problem, if it can be regarded as a true definition, it suffices to introduce this hypothesis into the calculus, in order to obtain all the analytical consequences that belong to the solution of the same problem."(Sophie Germain, 1821) 

"Let me be permitted to recall that the object of mathematics is not to investigate the causes that one can assign to natural phenomena. This science would lose both its character and credit if, renouncing the support of general well-confirmed facts, it sought within the realm of nebulous conjectures, a realm which has always been a fertile source of error for ways of satisfying the thirst fo rexplanation." (Sophie Germain, "Examen des principes qui peuvent conduire a la connaissance des lois de requilibre et du mouvement des solides elastiques", Annales de Chimie 38, 1828)

"The more one reflects, the more one acknowledges that necessity governs the world. At each new progress of science ,that which seemed contingent is recognized as being necessary. Multiple relations are established between the branches that we had thought to be separate; we observe laws where we had thought there were only accidental events. We approach more and more the unity of being […]" (Sophie Germain, "Considerations sur l’etat des sciences et lettres, aux differentes epoques de leur culture", 1833)

"Algebra is but written geometry and geometry is but figured algebra." (Sophie Germain, "Mémoire sur les Surfaces Élastiques", 1880)

"It matters little who first arrives at an idea, rather what is significant is how far that idea can go." (Sophie Germain)

"Space and time: these man proposes to measure. The one circumscribes his momentary existence, the other accompanies his successive stages in life. These two dimensions are tied together through a necessary relationship, namely, motion. When motion is constant and uniform, space is known by time and time is measured by space. Man has nothing within him that is constant and uniform; continually modified every instant. he is changing, irregular. and hardly durable enough to be a measure of duration." (Sophie Germain)

On Gravity II

"The weight of any heavy body of known weight at a particular distance from the center of the world varies according to the variation of its distance therefrom: so that as often as it is removed from the center, it becomes heavier, and when brought near to it, is lighter. On this account, the relation of gravity to gravity is as the relation of distance to distance from the center." (Al Khazini, "Book of the Balance of Wisdom", cca. 12th century)

"I have not been able to discover the cause of those properties of gravity from phenomena, and I frame no hypotheses; for whatever is not deduced from the phenomena is to be called a hypothesis, and hypotheses, whether metaphysical or physical, whether of occult qualities or mechanical, have no place in experimental philosophy." (Sir Isaac Newton, "Philosophiæ Naturalis Principia Mathematica" ["The Mathematical Principles of Natural Philosophy"], 1687)

"It is inconceivable, that inanimate brute matter should, without the mediation of something else, which is not material, operate upon and affect other matter without mutual contact [...]That gravity should be innate, inherent, and essential to matter, so that one body may act upon another at a distance, through a vacuum, without the mediation of anything else, by and through which their action and force may be conveyed from one to another, is to me so great an absurdity, that I believe no man who has in philosophical matters a competent faculty of thinking, can ever fall into it. Gravity must be caused by an agent, acting constantly according to certain laws; but whether this agent be material or immaterial, I have left to the consideration of my readers." (Sir Isaac Newton, [letter to Bentley] 1693)

"And thus Nature will be very conformable to her self and very simple, performing all the great Motions of the heavenly Bodies by the Attraction of Gravity which intercedes those Bodies, and almost all the small ones of their Particles by some other attractive and repelling Powers which intercede the Particles. The Vis inertiae is a passive Principle by which Bodies persist in their Motion or Rest, receive Motion in proportion to the Force impressing it, and resist as much as they are resisted. By this Principle alone there never could have been any Motion in the World. Some other Principle was necessary for putting Bodies into Motion; and now they are in Motion, some other Principle is necessary for conserving the Motion." (Sir Isaac Newton, "Opticks", 1704)

"Primary causes are unknown to us; but are subject to simple and constant laws, which may be discovered by observation, the study of them being the object of natural philosophy. Heat, like gravity, penetrates every substance of the universe, its rays occupy all parts of space. The object of our work is to set forth the mathematical laws which this element obeys. The theory of heat will hereafter form one of the most important branches of general physics." (Jean-Baptiste-Joseph Fourier, "The Analytical Theory of Heat", 1822)

"Science and knowledge are subject, in their extension and increase, to laws quite opposite to those which regulate the material world. Unlike the forces of molecular attraction, which cease at sensible distances; or that of gravity, which decreases rapidly with the increasing distance from the point of its origin; the farther we advance from the origin of our knowledge, the larger it becomes, and the greater power it bestows upon its cultivators, to add new fields to its dominions." (Charles Babbage, "On the Economy of Machinery and Manufactures", 1832)

"It is a mathematical fact that the casting of this pebble from my hand alters the centre of gravity of the universe." (Thomas Carlyle, "Sartor Resartus", 1836)

"Gravity. Surely this force must be capable of an experimental relation to electricity, magnetism, and the other forces, so as to bind it up with them in reciprocal action and equivalent effect." (Michael Faraday, [Notebook entry] 1849) 

"It is no valid objection that science as yet throws no light on the far higher problem of the essence or origin of life. Who can explain gravity? No one now objects to following out the results consequent on this unknown element of attraction" (Charles Darwin, "The Origin of Species", 1859)

"Any opinion as to the form in which the energy of gravitation exists in space is of great importance, and whoever can make his opinion probable will have, made an enormous stride in physical speculation. The apparent universality of gravitation, and the equality of its effects on matter of all kinds are most remarkable facts, hitherto without exception; but they are purely experimental facts, liable to be corrected by a single observed exception. We cannot conceive of matter with negative inertia or mass; but we see no way of accounting for the proportionality of gravitation to mass by any legitimate method of demonstration. If we can see the tails of comets fly off in the direction opposed to the sun with an accelerated velocity, and if we believe these tails to be matter and not optical illusions or mere tracks of vibrating disturbance, then we must admit a force in that direction, and we may establish that it is caused by the sun if it always depends upon his position and distance." (James C Maxwell, [Letter to William Huggins] 1868)

On Heuristics I

"The materialistic point of view in psychology can claim, at best, only the value of an heuristic hypothesis." (Wilhelm Wundt, "Principles of Physiological Psychology", 1874)

"Heuristic reasoning is good in itself. What is bad is to mix up heuristic reasoning with rigorous proof. What is worse is to sell heuristic reasoning for rigorous proof." (George Pólya, "How to Solve It", 1945)

"Heuristic, or heuretic, or 'ars inveniendi' was the name of a certain branch of study, not very clearly circumscribed, belonging to logic, or to philosophy, or to psychology, often outlined, seldom presented in detail, and as good as forgotten today. The aim of heuristic is to study the methods and rules of discovery and invention. [...] Heuristic, as an adjective, means 'serving to discover'." (George Pólya, "How to Solve It", 1945)

"Heuristic reasoning is reasoning not regarded as final and strict but as provisional and plausible only, whose purpose is to discover the solution of the present problem. We are often obliged to use heuristic reasoning. We shall attain complete certainty when we shall have obtained the complete solution, but before obtaining certainty we must often be satisfied with a more or less plausible guess. We may need the provisional before we attain the final. We need heuristic reasoning when we construct a strict proof as we need scaffolding when we erect a building." (George Pólya, "How to Solve It", 1945)

"The attempt to characterize exactly models of an empirical theory almost inevitably yields a more precise and clearer understanding of the exact character of a theory. The emptiness and shallowness of many classical theories in the social sciences is well brought out by the attempt to formulate in any exact fashion what constitutes a model of the theory. The kind of theory which mainly consists of insightful remarks and heuristic slogans will not be amenable to this treatment. The effort to make it exact will at the same time reveal the weakness of the theory." (Patrick Suppes," A Comparison of the Meaning and Uses of Models in Mathematics and the Empirical Sciences", Synthese  Vol. 12 (2/3), 1960)

"Factoring big numbers is a strange kind of mathematics that closely resembles the experimental sciences, where nature has the last and definitive word. […] as with the experimental sciences, both rigorous and heuristic analyses can be valuable in understanding the subject and moving it forward. And, as with the experimental sciences, there is sometimes a tension between pure and applied practitioners." (Carl B Pomerance, "A Tale of Two Sieves", The Notices of the American Mathematical Society 43, 1996)

"[…] mathematics does not come to us written indelibly on Nature’s Tablets, but rather is the product of a controlled search governed by metaphorical considerations, the premier instance being the heuristics of the conservation principles." (Philip Mirowski, "More Heat than Light: Economics as Social Physics: Physics as Nature’s Economics", 1989)

"Mathematicians, like the rest of us, cherish clever ideas; in particular they delight in an ingenious picture. But this appreciation does not overwhelm a prevailing skepticism. After all, a diagram is - at best - just a special case and so can't establish a general theorem. Even worse, it can be downright misleading. Though not universal, the prevailing attitude is that pictures are really no more than heuristic devices; they are psychologically suggestive and pedagogically important - but they prove nothing. I want to oppose this view and to make a case for pictures having a legitimate role to play as evidence and justification - a role well beyond the heuristic.  In short, pictures can prove theorems." (James R Brown, "Philosophy of Mathematics: An Introduction to the World of Proofs and Pictures", 1999)

"In the language of mental models, such past experience provided the default assumptions necessary to fill the gaps in the emerging and necessarily incomplete framework of a relativistic theory of gravitation. It was precisely the nature of these default assumptions that allowed them to be discarded again in the light of novel information - provided, for instance, by the further elaboration of the mathematical formalism - without, however, having to abandon the underlying mental models which could thus continue to function as heuristic orientations." (Jürgen Renn, "Before the Riemann Tensor: The Emergence of Einstein’s Double Strategy", [in "The Universe of General Relativity"] 2000)

"You can often hear from non-mathematicians, especially from philosophers, that mathematics consists exclusively in drawing conclusions from clearly stated premises; and that in this process, it makes no difference what these premises signify, whether they are true or fa1se, provided only that they do not contradict one another. But a per. son who has done productive mathematical work will talk quite differently. In fact these people [the non-mathematicians] are thinking only of the crystallized form into which finished mathematica1 theories are finally cast. However, the investigator himself, in mathematics as in every other science, does not work in this rigorous deductive fashion. On the contrary, he makes essential use of his imagination and proceeds inductively aided by heuristic expedients. One can give numerous examples of mathematicians who have discovered theorems of the greatest importance which they were unable to prove. Should one then refuse to recognize this as a great accomplishment and in deference to the above definition insist that this is not mathematics? After all it is an arbitrary thing how the word is to be used, but no judgment of value can deny that the inductive work of the person who first announces the theorem is at least as valuable as the deductive work. of the one who proves it. For both are equally necessary and the discovery is the presupposition of the later conclusion." (Felix Klein)

On Facts (1825-1849)

"Facts are the mere dross of history. It is from the abstract truth which interpenetrates them, and lies latent among them, like gold in the ore, that the mass derives its whole value: and the precious particles are generally combined with the baser in such a manner that the separation is a task of the utmost difficulty." (Thomas B Macaulay, "History", 1828)

"The domain of physics is no proper field for mathematical pastimes. The best security would be in giving a geometrical training to physicists, who need not then have recourse to mathematicians, whose tendency is to despise experimental science. By this method will that union between the abstract and the concrete be effected which will perfect the uses of mathematical, while extending the positive value of physical science. Meantime, the uses of analysis in physics is clear enough. Without it we should have no precision, and no co-ordination; and what account could we give of our study of heat, weight, light, etc.? We should have merely series of unconnected facts, in which we could foresee nothing but by constant recourse to experiment; whereas, they now have a character of rationality which fits them for purposes of prevision." (Auguste Comte, "The Positive Philosophy", 1830)

"There is nothing more difficult than a good definition, for it is scarcely possible to express, in a few words, the abstracted view of an infinite variety of facts." (Humphry Davy, "Consolations in Travel, or the Last Days of a Philosopher" , 1830)

"Whilst chemical pursuits exalt the understanding, they do not depress the imagination or weaken genuine feeling; whilst they give the mind habits of accuracy, by obliging it to attend to facts, they likewise extend its analogies; and, though conversant with the minute forms of things, they have for their ultimate end the great and magnificent objects of nature." (Sir Humphry Davy, "Consolations in Travel, or the Last Days of a Philosopher", 1830)

"A maxim is a conclusion upon observation of matters of fact, and is merely speculative; a ‘principle’ carries knowledge within itself, and is prospective." (Samuel T Coleridge, "The Table Talk and Omniana of Samuel Taylor Coleridge", 1831)

"Facts, however numerous, do not constitute a science. Like innumerable grains of sand on the sea shore, single facts appear isolated, useless, shapeless; it is only when compared, when arranged in their natural relations, when crystallised by the intellect, that they constitute the eternal truths of science." (William Farr, "Observation", Br. Ann. Med. 1, 1837)

"Statistics is a science which ought to be honourable, the basis of many most important sciences; but it is not to be carried on by steam, this science, any more than others are; a wise hand is requisite for carrying it on. Conclusive facts are inseparable from unconclusive except by a head that already understands and knows." (Thomas Carlyle, "Critical and Miscellaneous Essays", 1838)

"[…] in order that the facts obtained by observation and experiment may be capable of being used in furtherance of our exact and solid knowledge, they must be apprehended and analysed according to some Conception which, applied for this purpose, gives distinct and definite results, such as can be steadily taken hold of and reasoned from […]" (William Whewell, "The Philosophy of the Inductive Sciences Founded Upon their History" Vol. 2, 1840)

"[…] in order to observe, our mind has need of some theory or other. If in contemplating phenomena we did not immediately connect them with principles, not only would it be impossible for us to combine these isolated observations, and therefore to derive profit from them, but we should even be entirely incapable of remembering facts, which would for the most remain unnoted by us." (Auguste Comte, "Cours de Philosophie Positive", 1830-1842)

On Facts (1870-1879)

"As in the experimental sciences, truth cannot be distinguished from error as long as firm principles have not been established through the rigorous observation of facts." (Louis Pasteur, "Étude sur la maladie des vers à soie", 1870)

"Therefore, the great business of the scientific teacher is, to imprint the fundamental, irrefragable facts of his science, not only by words upon the mind, but by sensible impressions upon the eye, and ear, and touch of the student, in so complete a manner, that every term used, or law enunciated, should afterwards call up vivid images of the particular structural, or other, facts which furnished the demonstration of the law, or the illustration of the term." (Thomas H Huxley, "Lay Sermons, Addresses and Reviews", 1870)

"Modern discoveries have not been made by large collections of facts, with subsequent discussion, separation, and resulting deduction of a truth thus rendered perceptible. A few facts have suggested an hypothesis, which means a supposition, proper to explain them. The necessary results of this supposition are worked out, and then, and not till then, other facts are examined to see if their ulterior results are found in Nature." (Augustus de Morgan, "A Budget of Paradoxes", 1872)

"A law of nature, however, is not a mere logical conception that we have adopted as a kind of memoria technical to enable us to more readily remember facts. We of the present day have already sufficient insight to know that the laws of nature are not things which we can evolve by any speculative method. On the contrary, we have to discover them in the facts; we have to test them by repeated observation or experiment, in constantly new cases, under ever-varying circumstances; and in proportion only as they hold good under a constantly increasing change of conditions, in a constantly increasing number of cases with greater delicacy in the means of observation, does our confidence in their trustworthiness rise." (Hermann von Helmholtz, "Popular Lectures on Scientific Subjects", 1873)

"Summing up, then, it would seem as if the mind of the great discoverer must combine contradictory attributes. He must be fertile in theories and hypotheses, and yet full of facts and precise results of experience. He must entertain the feeblest analogies, and the merest guesses at truth, and yet he must hold them as worthless till they are verified in experiment. When there are any grounds of probability he must hold tenaciously to an old opinion, and yet he must be prepared at any moment to relinquish it when a clearly contradictory fact is encountered." (William S Jevons, "The Principles of Science: A Treatise on Logic and Scientific Method", 1874)

"In every physical science we have carefully to distinguish between the facts which form its subject-matter and the theories by which we attempt to explain these facts, and group them in our scientific systems." (Josiah P Cooke, "The New Chemistry", 1876)

"As long as the training of a naturalist enables him to trace the action only of a particular material system, without giving him the power of dealing with the general properties of all such systems, he must proceed by the method so often described in histories of science - he must imagine model after model of hypothetical apparatus, till he finds one which will do the required work. If this apparatus should afterwards be found capable of accounting for many of the known phenomena, and not demonstrably inconsistent with any of them, he is strongly tempted to conclude that his hypothesis is a fact, at least until an equally good rival hypothesis has been invented." (James C Maxwell, "Tait’s Thermodynamics", Nature Vol. XVII (431), 1878)

On Facts (1900-1909)

"Brightness and freshness take possession of the mind when it is crossed by the light of principles, shewing the facts of Nature to be organically connected." (John Tyndall, "Six Lectures on Light Delivered in America in 1872-1873" 3rd Ed., 1901)

"We form in the imagination some sort of diagrammatic, that is, iconic, representation of the facts, as skeletonized as possible. The impression of the present writer is that with ordinary persons this is always a visual image, or mixed visual and muscular; but this is an opinion not founded on any systematic examination." (Charles S Peirce, "Notes on Ampliative Reasoning", 1901)

"[…] to kill an error is as good a service as, and sometimes even better than, the establishing of a new truth or fact." (Charles R Darwin, "More Letters of Charles Darwin", Vol 2, 1903)

"Entia non sunt multiplicanda praeter necessitatem. That is to say; before you try a complicated hypothesis, you should make quite sure that no simplification of it will explain the facts equally well." (Charles S Peirce," Pragmatism and Pragmaticism", [lecture] 1903)

"The most important fundamental laws and facts of physical science have all been discovered, and these are now so firmly established that the possibility of their ever being supplemented in consequence by new discoveries is exceedingly remote." (Albert Michelson, 1903)

"The new mathematics is a sort of supplement to language, affording a means of thought about form and quantity and a means of expression, more exact, compact, and ready than ordinary language. The great body of physical science, a great deal of the essential facts of financial science, and endless social and political problems are only accessible and only thinkable to those who have had a sound training in mathematical analysis, and the time may not be very remote when it will be understood that for complete initiation as an efficient citizen of the great complex world-wide States that are now developing, it is as necessary to be able to compute, to think in averages and maxima and minima, as it is now to be able to read and write." (Herbert G Wells, "Mankind in the Making", 1903)

"By [diagrams] it is possible to present at a glance all the facts which could be obtained from figures as to the increase,  fluctuations, and relative importance of prices, quantities, and values of different classes of goods and trade with various countries; while the sharp irregularities of the curves give emphasis to the disturbing causes which produce any striking change." (Arthur L Bowley, "A Short Account of England's Foreign Trade in the Nineteenth Century, its Economic and Social Results", 1905)

"The most violent revolutions in an individual's beliefs leave most of his old order standing. Time and space, cause and effect, nature and history, and one's own biography remain untouched. New truth is always a go-between, a smoother-over of transitions. It marries old opinion to new fact so as ever to show a minimum of jolt, a maximum of continuity." (William James, "What Pragmatism Means", 1907)

"But, once again, what the physical states as the result of an experiment is not the recital of observed facts, but the interpretation and the transposing of these facts into the ideal, abstract, symbolic world created by the theories he regards as established." (Pierre-Maurice-Marie Duhem, "The Aim and Structure of Physical Theory", 1908)

"Modern masters of science are much impressed with the need of beginning all inquiry with a fact. The ancient masters of religion were quite equally impressed with that necessity. They began with the fact of sin - a fact as practical as potatoes. Whether or not man could be washed in miraculous waters, there was no doubt at any rate that he wanted washing." (Gilbert K Chesterton, "Orthodoxy", 1908)

"Of course, we must be careful about what has to be ‘known’ and ‘judged’ and ‘willed’. This problem seems rather easy to answer in the light of morphological restitutions Here the end to be attained is the normal organisation ; that ‘means’ towards this end are known and found may seem very strange, but it is a fact; and it in a fact also, in the case of what we have called ‘equifinal regulations’, that different means leading to one and the same final state may be known and adopted." (Hans Driesch, "The Science and Philosophy of the Organism", 1908)

"Science is not the monopoly of the naturalist or the scholar, nor is it anything mysterious or esoteric. Science is the search for truth, and truth is the adequacy of a description of facts." (Paul Carus, "Philosophy as a Science", 1909)

Frederick Mosteller - Collected Quotes

 "As usual we may make the errors of I) rejecting the null hypothesis when it is true, II) accepting the null hypothesis when it is false. But there is a third kind of error which is of interest because the present test of significance is tied up closely with the idea of making a correct decision about which distribution function has slipped furthest to the right. We may make the error of III) correctly rejecting the null hypothesis for the wrong reason." (Frederick Mosteller, "A k-Sample Slippage Test for an Extreme Population", The Annals of Mathematical Statistics 19, 1948)

"Errors of the third kind happen in conventional tests of differences of means, but they are usually not considered, although their existence is probably recognized. It seems to the author that there may be several reasons for this among which are 1) a preoccupation on the part of mathematical statisticians with the formal questions of acceptance and rejection of null hypotheses without adequate consideration of the implications of the error of the third kind for the practical experimenter, 2) the rarity with which an error of the third kind arises in the usual tests of significance." (Frederick Mosteller, "A k-Sample Slippage Test for an Extreme Population", The Annals of Mathematical Statistics 19, 1948)

"For many purposes graphical accuracy is sufficient. The speed of graphical processes, and more especially the advantages of visual presentation in pointing out facts or clues which might otherwise be overlooked, make graphical analysis very valuable." (Frederick Mosteller & John W Tukey, "The Uses and Usefulness of Binomial Probability Paper?", Journal of the American Statistical Association 44, 1949)

"If significance tests are required for still larger samples, graphical accuracy is insufficient, and arithmetical methods are advised. A word to the wise is in order here, however. Almost never does it make sense to use exact binomial significance tests on such data - for the inevitable small deviations from the mathematical model of independence and constant split have piled up to such an extent that the binomial variability is deeply buried and unnoticeable. Graphical treatment of such large samples may still be worthwhile because it brings the results more vividly to the eye." (Frederick Mosteller & John W Tukey, "The Uses and Usefulness of Binomial Probability Paper?", Journal of the American Statistical Association 44, 1949)

"Scientific and technological advances have made the world we live in complex and hard to understand. […] Science itself shows the same growing complexity. We often hear that 'one man can no longer cover a broad enough field' and that 'there is too much narrow specialization'. And yet these complexities must be met - and resolved. At all levels, decisions must be made which involve consideration of more than a single field." (Frederick Mosteller et al, "The Education of a Scientific Generalist", Science 109,1949)

"Mathematical models for empirical phenomena aid the development of a science when a sufficient body of quantitative information has been accumulated. This accumulation can be used to point the direction in which models should be constructed and to test the adequacy of such models in their interim states. Models, in turn, frequently are useful in organizing and interpreting experimental data and in suggesting new directions for experimental research." (Robert R. Bush & Frederick Mosteller, "A Mathematical Model for Simple Learning", Psychological Review 58, 1951)

"Almost any sort of inquiry that is general and not particular involves both sampling and measurement […]. Further, both the measurement and the sampling will be imperfect in almost every case. We can define away either imperfection in certain cases. But the resulting appearance of perfection is usually only an illusion." (Frederick Mosteller et al, "Principles of Sampling", Journal of the American Statistical Association Vol. 49 (265), 1954)

"Because representativeness is inherent in the sampling plan and not in the particular sample at hand, we can never make adequate use of sample results without some measure of how well the results of this particular sample are likely to agree with the results of other samples which the same sampling plan might have provided. The ability to assess stability fairly is as important as the ability to represent the population fairly. Modern sampling plans concentrate on both." (Frederick Mosteller et al, "Principles of Sampling", Journal of the American Statistical Association Vol. 49 (265), 1954)

"By sampling we can learn only about collective properties of populations, not about properties of individuals. We can study the average height, the percentage who wear hats, or the variability in weight of college juniors [...]. The population we study may be small or large, but there must be a population - and what we are studying must be a population characteristic. By sampling, we cannot study individuals as particular entities with unique idiosyncrasies; we can study regularities (including typical variabilities as well as typical levels) in a population as exemplified by the individuals in the sample." (Frederick Mosteller et al, "Principles of Sampling", Journal of the American Statistical Association Vol. 49 (265), 1954)

"In many cases general probability samples can be thought of in terms of (1) a subdivision of the population into strata, (2) a self-weighting probability sample in each stratum, and (3) combination of the stratum sample means weighted by the size of the stratum." (Frederick Mosteller et al, "Principles of Sampling", Journal of the American Statistical Association Vol. 49 (265), 1954)

"That which can be and should be representative is the sampling plan, which includes the manner in which the sample was drawn (essentially a specification of what other samples might have been drawn and what the relative chances of selection were for any two possible samples) and how it is to be analyzed. [...] It is clear that many [...] groups fail to be represented in any particular sample, yet this is not a criticism of that sample. Representation is not, and should not be, by groups. It is, and should be, by individuals as members of the sampled population. Representation is not, and should not be, in any particular sample. It is, and should be, in the sampling plan." (Frederick Mosteller et al, "Principles of Sampling", Journal of the American Statistical Association Vol. 49 (265), 1954)

"The main purpose of a significance test is to inhibit the natural enthusiasm of the investigator." (Frederick Mosteller, "Selected Quantitative Techniques", 1954)

"We must emphasize that such terms as 'select at random', 'choose at random', and the like, always mean that some mechanical device, such as coins, cards, dice, or tables of random numbers, is used." (Frederick Mosteller et al, "Principles of Sampling", Journal of the American Statistical Association Vol. 49 (265), 1954)

"We have made the sampling plan representative, not by giving each individual an equal chance to enter the sample and then weighting them equally, but by a more noticeable process of compensation, where those individuals very likely to enter the sample are weighted less, while those unlikely to enter are weighted more when they do appear. The net result is to give each individual an equal chance of affecting the (weighted) sample mean." (Frederick Mosteller et al, "Principles of Sampling", Journal of the American Statistical Association Vol. 49 (265), 1954)

"We realize that if someone just 'grabs a handful', the individuals in the handful almost always resemble one another (on the average) more than do the members of a simple random sample. Even if the 'grabs' [sampling] are randomly spread around so that every individual has an equal chance of entering the sample, there are difficulties. Since the individuals of grab samples resemble one another more than do individuals of random samples, it follows (by a simple mathematical argument) that the means of grab samples resemble one another less than the means of random samples of the same size. From a grab sample, therefore, we tend to underestimate the variability in the population, although we should have to overestimate it in order to obtain valid estimates of variability of grab sample means by substituting such an estimate into the formula for the variability of means of simple random samples. Thus using simple random sample formulas for grab sample means introduces a double bias, both parts of which lead to an unwarranted appearance of higher stability." (Frederick Mosteller et al, "Principles of Sampling", Journal of the American Statistical Association Vol. 49 (265), 1954)

"Weighing a sample appropriately is no more fudging the data than is correcting a gas volume for barometric pressure." (Frederick Mosteller et al, "Principles of Sampling", Journal of the American Statistical Association Vol. 49 (265), 1954)

"A primary goal of any learning model is to predict correctly the learning curve - proportions of correct responses versus trials. Almost any sensible model with two or three free parameters, however, can closely fit the curve, and so other criteria must be invoked when one is comparing several models." (Robert R Bush & Frederick Mosteller, "A Comparison of Eight Models?", Studies in Mathematical Learning Theory, 1959)

"A satisfactory prediction of the sequential properties of learning data from a single experiment is by no means a final test of a model. Numerous other criteria - and some more demanding - can be specified. For example, a model with specific numerical parameter values should be invariant to changes in independent variables that explicitly enter in the model." (Robert R Bush & Frederick Mosteller,"A Comparison of Eight Models?", Studies in Mathematical Learning Theory, 1959)

"In the testing of a scientific model or theory, one rarely has a general measure of goodness-of-fit, a universal yardstick by which one accepts or rejects the model. Indeed, science does not and should not work this way; a theory is kept until a better one is found. One way that science does work is by comparing two or more theories to determine their relative merits in handling relevant data."(Robert R Bush & Frederick Mosteller, "A Comparison of Eight Models?", Studies in Mathematical Learning Theory, 1959)

"In a problem, the great thing is the challenge. A problem can be challenging for many reasons: because the subject matter is intriguing, because the answer defies unsophisticated intuition, because it illustrates an important principle, because of its vast generality, because of its difficulty, because of a clever solution, or even because of the simplicity or beauty of the answer." (Frederick Mosteller, "Fifty Challenging Problems in Probability with Solutions", 1965)

"Using data from the population as it stands is a dangerous substitute for testing." (Frederick Mosteller & Gale Mosteller, "New Statistical Methods in Public Policy. Part I: Experimentation", Journal of Contemporary Business 8, 1979)

"Although we often hear that data speak for themselves, their voices can be soft and sly." (Frederick Mosteller, "Beginning Statistics with Data Analysis", 1983)

"The law of truly large numbers states: With a large enough sample, any outrageous thing is likely to happen." (Frederick Mosteller, "Methods for Studying Coincidences", Journal of the American Statistical Association Vol. 84, 1989)

"It is easy to lie with statistics, but easier to lie without them [...]" (Frederick Mosteller)