Theories: On Relativity Theory (1925-1949)

"The meaning of relativity [...] has been widely misunderstood. Philosophers play with the word, like a child with a doll. Relativity, as I see it, merely denotes that certain physical and mechanical facts, which have been regarded as positive and permanent, are relative with regard to certain other facts in the sphere of physics and mechanics. It does not mean that everything in life is mischievously topsy-turvy." (Albert Einstein [in George Sy Viereck, "What Life Means to Einstein", The Saturday Evening Post, 1929]) 

"[...] the most outstanding achievement of twentieth-century physics is not the theory of relativity with its welding together of space and time, or the theory of quanta with its present apparent negation of the laws of causation, or the dissection of the atom with the resultant discovery that things are not what they seem; it is the general recognition that we are not yet in contact with ultimate reality." (James H Jeans, "The Mysterious Universe", 1930) 

"There is another side to the theory of relativity. [...]×the development of science is in the direction to make it less subjective, to separate more and more in the observed facts that which belongs to the reality behind the phenomena, the absolute, from the subjective element, which is introduced by the observer, the relative. Einstein's theory is a great step in that direction. We can say that the theory of relativity is intended to remove entirely the relative and exhibit the pure absolute." (Willem de Sitter, "Relativity and Modern Theories of the Universe", Kosmos, 1932)

"Two points should be specially emphasized in connection with the general theory of relativity. First, it is a purely physical theory, invented to explain empirical physical facts, especially the identity of gravitational and inertial mass, and to coordinate and harmonize different chapters of physical theory, especially mechanics and electromagnetic theory. It has nothing metaphysical about it. Its importance from a metaphysical or philosophical point of view is that it aids us to distinguish in the observed phenomena what is absolute, or due to the reality behind the phenomena, from what is relative, i.e. due to the observer.S econd, it is a pure generalization, or abstraction, like Newton's system of mechanics and law of gravitation. It contains no hypothesis, as contrasted with the atomic theory or the theory of quanta, which are based on hypothesis. It may be considered as the logical sequence and completion of Newton's Principia. The science of mechanics was founded by Archimedes, who had a clear conception of the relativity of motion, and may be called the first relativist. Galileo, who was inspired by the reading of the works of Archimedes, took the subject up where his great predecessor had left it. His fundamental discovery is the law of inertia, which is the backbone of Newton's classical system of mechanics, and retains the same central position in Einstein's relativistic system. Thus one continuous line of thought can be traced through the development of our insight into the mechanical processes of nature... characterized by the sequence [...] Archimedes, Galileo, Newton, Einstein." (Willem de Sitter, "The Astronomical Aspect of the Theory of Relativity", 1933)

"The fundamental presuppositions of classical physics, which led to the scientific picture of the 19th century, had been challenged for the first time by Einstein’s special relativity." (Werner K Heisenberg, 1934)

"We know, since the theory of relativity at least, that empirical sciences are to some degree free in defining dynamical concepts or even in assuming laws, and that only a system as a whole which includes concepts, coordinating definitions, and laws can be said to be either true or false, to be adequate or inadequate to empirical facts. This 'freedom', however, is a somewhat doubtful gift. The manifold of possibilities implies uncertainty, and such uncertainty can become rather painful in a science as young as psychology, where nearly all concepts are open and unsettled. As psychology approaches the state of a logically sound science, definitions cease to be an arbitrary matter. They become far-reaching decisions which presuppose the mastering of the conceptual problems but which have to be guided entirely by the objective facts." (Kurt Lewin, "Principles of topological psychology", 1936)

"The modern theory of relativity, on its mathematical side, is merely an elaboration of Riemann's analysis." (Julian L Coolidge, "A History of Geometrical Methods", 1940)

"Then the theory of relativity came and explained the cause of the failure. Electric action requires time to travel from one point of space to another, the simplest instance of this being the finite speed of travel of light […] Thus electromagnetic action may be said to travel through space and time jointly. But by filling space and space alone [excluding time] with an ether, the pictorial representations had all supposed a clear-cut distinction between space and time." (James H Jeans, "Physics and Philosophy", 1942)

"But Einstein came along and took space and time out of the realm of stationary things and put them in the realm of relativity - giving the onlooker dominion over time and space, because time and space are modes by which we think and not conditions in which we live." (Dimitri Marianoff & Palma Wayne, "Einstein: An Intimate Study of a Great Man", 1944)

"Not the state of rest, but the states of uniform translation form an objectively distinguished class of motions, and this puts an end to the substantial ether. Finally, and fourthly, the general relativity theory re-endows this metric world structure with the capacity of reacting to the forces of matter. Thus, in a sense, the circle is closed." (Hermann Weyl, "Philosophy of Mathematics and Natural Science" II, 1949

"The field equation may [...] be given a geometrical foundation, at least to a first approximation, by replacing it with the requirement that the mean curvature of the space vanish at any point at which no heat is being applied to the medium - in complete analogy with […] the general theory of relativity by which classical field equations are replaced by the requirement that the Ricci contracted curvature tensor vanish." (Howard P Robertson, "Geometry as a Branch of Physics", 1949)

"We may sum up as follows: According to the general theory of relativity space is endowed with physical qualities; in this sense, therefore, an ether exists. Space without an ether is inconceivable." (Albert Einstein, "The World as I See It", 1949) 

Theories: On Relativity Theory (1975-1999)

"According to the special theory there is a finite limit to the speed of causal chains, whereas classical causality allowed arbitrarily fast signals. Foundational studies […] soon revealed that this departure from classical causality in the special theory is intimately related to its most dramatic consequences: the relativity of simultaneity, time dilation, and length contraction. By now it had become clear that these kinematical effects are best seen as consequences of Minkowski space-time, which in turn incorporates a nonclassical theory of causal structure. However, it has not widely been recognized that the converse of this proposition is also true: the causal structure of Minkowski space-time contains within itself the entire geometry (topological and metrical structure) of Minkowski space-time." (John A. Winnie," The Causal Theory of Space-Time", 1977)

"The ‘eyes of the mind’ must be able to see in the phase space of mechanics, in the space of elementary events of probability theory, in the curved four-dimensional space-time of general relativity, in the complex infinite dimensional projective space of quantum theory. To comprehend what is visible to the ‘actual eyes’, we must understand that it is only the projection of an infinite dimensional world on the retina." (Yuri I Manin, "Mathematics and Physics", 1981)

"The theory of relativity does, however, force us to change fundamentally our ideas of space and time. We must accept that time is not completely separate from and independent of space, but is combined with it to form an object called space-time." (Stephen Hawking, "A Brief History of Time: From the Big Bang to Black Holes", 1988)

"Theoretical physicists accept the need for mathematical beauty as an act of faith.… For example, the main reason why the theory of relativity is so universally accepted is its mathematical beauty." (Paul A M Dirac,"Methods in Theoretical Physics", 1989)

"All the implications of special relativity [...] have been con firmed by direct experiments. There are still people who believe it is “just a theory.” But they are wrong." (Paul C W Davies & John Gribbin, "The Matter Myth: Dramatic Discoveries That Challenge Our Understanding of Physical Reality", 1992)

"Our theories are very esoteric - necessarily so, because we are forced to develop these theories using a language, the language of mathematics, that has not become part of the general equipment of the educated public. Physicists generally do not like the fact that our theories arc so eso teric. On the other hand, I have occasionally heard artists talk proudly about their work being accessible only to a band of cognoscenti and justify this attitude by quoting the example of physical theories like general relativity that also can be understood only by initiates. Artists like physicists may not always be able to make themselves understood by the general public, but esotericism for its own sake is just silly." (Steven Weinberg, "Dreams of a Final Theory: The Scientist’s Search for the Ultimate Laws of Nature", 1992)

"Einstein was thus faced with the following apparent problem. Either give up the principle of relativity, which appears to make physics possible by saying that the laws of physics are independent of where you measure them, as long as you are in a state of uniform motion; or give up Maxwell’s beautiful theory of electromagnetism and electromagnetic waves. In a truly revolutionary move, he chose to give up neither. [...] It is a testimony to his boldness and creativity not that he chose to throw out existing laws that clearly worked, but rather that he found a creative way to live within their framework. So creative, in fact, that it sounds nuts." (Lawrence M Krauss, "Fear of Physics: A Guide for the Perplexed", 1993)

"Quantum mechanics - the theory that explains phenomena on the size of atoms - is right. It is also so conceptually weird that physicists to this day feel uncomfortable with it." (Tony Rothman, "Instant Physics: From Aristotle to Einstein, and Beyond", 1995)

"Relativity theory, of course, does not find that truth depends on the point of view of the observer but, on the contrary, reformulates the laws of physics so that they hold good for all observers, no matter how they move or where they stand. Its central meaning is that the most valued truths in science are independent of the point of view. [...] Einstein did not prove the work of Newton wrong; he provided a larger setting within which some limitations, contradictions, and asymmetries in the earlier physics disappeared." (Gerald Holton, Einstein, History, and Other Passions: The Rebellion Against Science at the End of the Twentieth Century, 1995)

"Use of the term 'model' makes it easier to keep in mind this distinction between theory and reality. By its very nature a model cannot include all the details of the reality it seeks to represent, for then it would be just as hard to comprehend and describe as the reality we want to model. At best, our model should give a reasonable picture of some small part of reality. It has to be a simple (even crude) description; and we must always be ready to scrap or improve a model if it fails in this task of accurate depiction. That having been said, old models are often still useful. The theory of relativity supersedes the Newtonian model, but all engineers use Newtonian mechanics when building bridges or motor cars, or probing the solar system." (David Stirzaker, "Probability and Random Variables: A Beginner’s Guide", 1999)

"What makes writing relativity so tricky is this: Built into ordinary language — in its use of tenses, for example - are many implicit assumptions about the nature of temporal relations that we now know to be false. Most importantly, we have known since 1905 that when you say that two events in different places happen at the same time you are not referring to anything inherent in the events themselves. You are merely adopting a conventional way of locating them that can differ from other equally valid conventional assignments of temporal order which do not have the events happening at the same time." (N David Mermin, "Writing Physics", 1999)

Theories: On Relativity Theory (1900-1924)

"By laying down the relativity postulate from the outset, sufficient means have been created for deducing henceforth the complete series of Laws of Mechanics from the principle of conservation of energy (and statements concerning the form of the energy) alone." (Hermann Minkowski, "The Fundamental Equations for Electromagnetic Processes in Moving Bodies", 1907)

"The most important result of a general character to which the special theory has led is concerned with the conception of mass. Before the advent of relativity, physics recognized two conservation laws of fundamental importance, namely, the law of conservation of energy and the law of the conservation of mass; these two fundamental laws appeared to be quite independent of each other. By means of the theory of relativity they have been united into one law." (Albert Einstein, 1920)

"The discovery of Minkowski […] is to be found […] in the fact of his recognition that the four-dimensional space-time continuum of the theory of relativity, in its most essential formal properties, shows a pronounced relationship to the three-dimensional continuum of Euclidean geometrical space. In order to give due prominence to this relationship, however, we must replace the usual time co-ordinate t by an imaginary magnitude, √-1*ct, proportional to it. Under these conditions, the natural laws satisfying the demands of the (special) theory of relativity assume mathematical forms, in which the time co-ordinate plays exactly the same role as the three space-coordinates. Formally, these four co-ordinates correspond exactly to the three space co-ordinates in Euclidean geometry." (Albert Einstein,"Relativity: The Special and General Theory", 1920)

"The relativity theory of physics reduces everything to relations; that is to say, it is structure, not material, which counts. The structure cannot be built up without material; but the nature of the material is of no importance." (Arthur S Eddington, "Space, Time and Gravitation: An Outline of the General Relativity Theory", 1920)

"There is something attractive in presenting the evolution of a sequence of ideas in as brief a form as possible, and yet with a completeness suffi cient to preserve throughout the continuity of development. We shall endeavor to do this for the Theory of Relativity, and to show that the whole ascent is composed of small, almost self-evident steps of thought." (Albert Einstein, "A Brief Outline of the Development of the Theory of Relativity Nature Vol. 106 (2677) 1921) 

"Einstein's theory of relativity has advanced our ideas of the structure of the cosmos a step further. It is as if a wall which separated us from Truth has collapsed. Wider expanses and greater depths are now exposed to the searching eye of knowledge, regions of which we had not even a presentiment. It has brought us much nearer to grasping the plan that underlies all physical happening." (Hermann Weyl, "Space - Time - Matter (1922)

"In the realm of physics it is perhaps only the theory of relativity which has made it quite clear that the two essences, space and time, entering into our intuition, have no place in the world constructed by mathematical physics. Colours are thus 'really' not even æther-vibrations, but merely a series of values of mathematical functions in which occur four independent parameters corresponding to the three dimensions of space, and the one of time." (Hermann Weyl, "Space, Time, Matter", 1922)

"The numerical side of the theory of relativity is derived from the failure of all attempts to detect the relative motion of matter and ether." (Herbert Dingle, "Relativity for All", 1922) 

"Results of measurements are the subject-matter of physics; and the moral of the theory of relativity is that we can only comprehend what the physical quantities stand for if we first comprehend what they are." (Arthur S Eddington, "The Mathematical Theory of Relativity", 1923)

"By means of a revision of the concept of simultaneity in a shapable form I arrived at the special relativity theory.” (Albert Einstein, 1924) 

Theories: On Relativity Theory (1950-1974)

 "In the realm of physics it is perhaps only the theory of relativity which has made it quite clear that the two essences, space and time, entering into our intuition, have no place in the world constructed by mathematical physics. Colours are thus 'really' not even æther-vibrations, but merely a series of values of mathematical functions in which occur four independent parameters corresponding to the three dimensions of space, and the one of time." (Hermann Weyl, "Space, Time, Matter", 1952)

"The theory of relativity is a fine example of the fundamental character of the modern development of theoretical science. The initial hypotheses become steadily more abstract and remote from experience. On the other hand, it gets nearer to the grand aim of all science, which is to cover the greatest possible number of empirical facts by logical deduction from the smallest possible number of hypotheses or axioms." (Albert Einstein, 1954)

"[...] even in a temporal description of nature given by a relational theory of time. However, a theory, like the special theory of relativity, that denies the existence of an infinitely fast causal chain, deprives the concept of absolute simultaneity of its physical meaning even within a single inertial system. [...]  But since the metrical concept of velocity presupposes that we know the meaning of a transit time and since such a time, in turn, depends on a prior criterion of clock synchronization or simultaneity, we must first formulate the limiting property of electromagnetic chains [the fastest causal chain] without using the concept of simultaneity of noncoincident events." (Adolf Grünbaum, "Logical and philosophical foundations of the special theory of relativity", American Journal of Physics 23, 1955)

"Within the field of modern physics the theory of relativity has played a very important role. It was in this theory that the necessity for a change in the fundamental principles of physics was recognized for the first time." (Werner K Heisenberg, [Gifford Lecture, delivered at the University of St Andrews, 1955/56]) 

"By the widening of the transformation group in general relativity the idea of distinguished inertial coordinate systems could also be eliminated by Einstein as inconsistent with the group-theoretical properties of the theory. Without this general critical attitude, which abandoned naive visualizations in favour of a conceptual analysis of the correspondence between observational data and the mathematical quantities in a theoretical formalism, the establishment of the modern form of quantum theory would not have been possible." (Wolfgang Pauli, 1956)

"I consider the theory of relativity to be an example showing how a fundamental scientific discovery, sometimes even against the resistance of its creator, gives birth to further fruitful developments, following its own autonomous course." (Wolfgang Pauli, 1956)

"Understanding mathematical logic, or the theory of relativity, is not an indispensable attribute of the cultured mind. But if one wishes to learn anything about these subjects, one must learn something. It is necessary to master the rudiments of the language, to practice a technique, to follow step by step a characteristic sequence of reasoning and to see a problem through from beginning to end." (James R Newman, "The World of Mathematics” Vol. I, 1956)

"I believe the coordinate-free approach fosters the cultivation of intuition, a scarce commodity in relativity because the phenomena this theory is intended to describe are as yet rather remote from our daily experience." (Walter Noll, "Euclidean Geometry and Minkowskian Chronometry", The American Mathematical Monthly, 1964)

"Anyone who studies relativity without understanding how to use simple space-time diagrams is as much inhibited as a student of functions of a complex variable who does not understand the Argads diagram." (John L Synge, "Relativity: The Special Theory", 1965) 

"The ‘relativity’ of the new theory - one of the most solidly verified theories in the entire range of physics - is chiefly, therefore, a relativity of simultaneity." (Ernan McMullin, "Simultaneity", 1967)

"In science [...] it is impossible to open up new territory unless one is prepared to leave the safe anchorage of established doctrine and run the risk of a hazardous leap forward. With his relativity theory, Einstein had abandoned the concept of simultaneity, which was part of the solid ground of tra ditional physics, and, in so doing, outraged many leading physicists and philosophers and turned them into bitter opponents. In general, scientific progress calls for no more than the absorption and elaboration of new ideas - and this is a call most scientists are happy to heed." (Werner K Heisenberg, "Physics and Beyond: Encounters and Conversations", 1969) 

"Many cumbersome developments in the standard treatments of mechanics can be simplified and better understood when formulated with modern conceptual tools, as in the well-known case of the use of the 'universal' definition of tensor products of vector spaces to simplify some of the notational excesses of tensor analysis as traditionally used in relativity theory" (Saunders Mac Lane, "Hamiltonian Mechanics and Geometry", The American Mathematical Monthly Vol. 77 (6), 1970)

On Theorizing

"Observation is so wide awake, and facts are being so rapidly added to the sum of human experience, that it appears as if the theorizer would always be in arrears, and were doomed forever to arrive at imperfect conclusion; but the power to perceive a law is equally rare in all ages of the world, and depends but little on the number of facts observed." (Henry D Thoreau, "A Week on the Concord and Merrimack Rivers", 1862)

“It is a capital mistake to theorize before you have all the evidence. It biases the judgment.” (Sir Arthur C Doyle, “A Study in Scarlet”, 1887)

“It is a capital mistake to theorize before one has data. Insensibly one begins to twist facts to suit theories, instead of theories to suit facts.” (Sir Arthur C Doyle, “The Adventures of Sherlock Holmes”, 1892)

"Until a scientific theory yields confident forecasts you know it is unsound and tentative; it is mere theorizing, as evanescent as art talk or the phantoms politicians talk about." (Herbert G Wells, [Annual Report of the Board of Regents of the Smithsonian Institution] 1902)

"Science is neither philosophy, nor religion, nor art; it is the totality of positive knowledge, as closely knit as possible; it is as different from its practical applications on the one hand, as it is from idle theorizing and blind faith on the other. It behooves us to make no extravagant claims for it, and to be as humble as we can." (George Sarton, "The History of Science and the New Humanism", 1928)

"It is not enough to observe, experiment, theorize, calculate and communicate; we must also argue, criticize, debate, expound, summarize, and otherwise transform the information that we have obtained individually into reliable, well established, public knowledge." (John M Ziman, "Information, Communication, Knowledge", Nature Vol. 224 (5217), 1969)

"The verb 'to theorize' is now conjugated as follows: 'I built a model; you formulated a hypothesis; he made a conjecture'." (John Ziman, "Reliable Knowledge", 1978) 

"[…] there is an external world which can in principle be exhaustively described in scientific language. The scientist, as both observer and language-user, can capture the external facts of the world in propositions that are true if they correspond to the facts and false if they do not. Science is ideally a linguistic system in which true propositions are in one-to-one relation to facts, including facts that are not directly observed because they involve hidden entities or properties, or past events or far distant events. These hidden events are described in theories, and theories can be inferred from observation, that is, the hidden explanatory mechanism of the world can be discovered from what is open to observation. Man as scientist is regarded as standing apart from the world and able to experiment and theorize about it objectively and dispassionately." (Mary B Hesse, "Revolutions and Reconstructions in the Philosophy of Science", 1980

"An extremely odd demand is often set forth but never met, even by those who make it; i.e., that empirical data should be presented without any theoretical context, leaving the reader, the student, to his own devices in judging it. This demand seems odd because it is useless simply to look at something. Every act of looking turns into observation, every act of observation into reflection, every act of reflection into the making of associations; thus it is evident that we theorize every time we look carefully at the world." (Johann Wolfgang von Goethe)

"A basic purpose of theorizing is to organize information in a way that will develop its nonobvious implications." (David R Heise)

On Problem Solving XII: Theories

"The insights gained and garnered by the mind in its wanderings among basic concepts are benefits that theory can provide. Theory cannot equip the mind with formulas for solving problems, nor can it mark the narrow path on which the sole solution is supposed to lie by planting a hedge of principles on either side. But it can give the mind insight into the great mass of phenomena and of their relationships, then leave it free to rise into the higher realms of action." (Carl von Clausewitz, "On War", 1832)

"No mathematical idea has ever been published in the way it was discovered. Techniques have been developed and are used, if a problem has been solved, to turn the solution procedure upside down, or if it is a larger complex of statements and theories, to turn definitions into propositions, and propositions into definitions, the hot invention into icy beauty. This then if it has affected teaching matter, is the didactical inversion, which as it happens may be anti-didactical." (Hans Freudenthal, "The Concept and the Role of the Model in Mathematics and Natural and Social Sciences", 1961)

"The final test of a theory is its capacity to solve the problems which originated it." (George Dantzig, "Linear Programming and Extensions", 1963)

"If we deal with our problem not knowing, or pretending not to know the general theory encompassing the concrete case before us, if we tackle the problem 'with bare hands', we have a better chance to understand the scientist's attitude in general, and especially the task of the applied mathematician." (George Pólya, "Mathematical Methods in Science", 1977)

"[...] two related deficiencies have prevented real progress in understanding insight and its role in problem solving. First, we do not yet have a system of classifying problems into those in which insight occurs versus those in which it does not. However, only if we can isolate problems in which insight occurs will we be able to set on a firm base our theories of the mechanisms underlying insight. Second, formulation of such a taxonomic system requires that we agree on a definition of insight." (Robert W Weisberg, "Prolegomena to theories of insight in problem solving: a taxonomy of problems", 1995)

"Mathematics is not a matter of 'anything goes', and every mathematician is guided by explicit or unspoken assumptions as to what counts as legitimate – whether we choose to view these assumptions as the product of birth, experience, indoctrination, tradition, or philosophy. At the same time, mathematicians are primarily problem solvers and theory builders, and answer first and foremost to the internal exigencies of their subject." (Jeremy Avigad, "Methodology and Metaphysics in the Development of Dedekind’s Theory of Ideals", 2006)

"Therefore, although the notion of insight as a distinct process has a long history in the psychological study of problem solving, it might be useful at this point to refrain from using analytic and insight as theoretical terms applied a priori to problems." (Jason M Chein et al, "Working memory and insight in the nine-dot problem", Memory & Cognition 38, 2010)

Previous <<||>> Next

On Probability Theory (2000-)

"Arithmetic and number theory study patterns of number and counting. Geometry studies patterns of shape. Calculus allows us to handle patterns of motion. Logic studies patterns of reasoning. Probability theory deals with patterns of chance. Topology studies patterns of closeness and position." (Keith Devlin, "The Math Gene: How Mathematical Thinking Evolved And Why Numbers Are Like Gossip", 2000)

"The most important aspect of probability theory concerns the behavior of sequences of random variables." (Larry A Wasserman, "All of Statistics: A concise course in statistical inference", 2004)

"In the laws of probability theory, likelihood distributions are fixed properties of a hypothesis. In the art of rationality, to explain is to anticipate. To anticipate is to explain." (Eliezer S. Yudkowsky, "A Technical Explanation of Technical Explanation", 2005)

"Chance is just as real as causation; both are modes of becoming. The way to model a random process is to enrich the mathematical theory of probability with a model of a random mechanism. In the sciences, probabilities are never made up or 'elicited' by observing the choices people make, or the bets they are willing to place.  The reason is that, in science and technology, interpreted probability exactifies objective chance, not gut feeling or intuition. No randomness, no probability." (Mario Bunge, "Chasing Reality: Strife over Realism", 2006)

"At a purely formal level, one could call probability theory the study of measure spaces with total measure one, but that would be like calling number theory the study of strings of digits which terminate." (Terence Tao, "Topics in Random Matrix Theory", 2012)

"The four questions of data analysis are the questions of description, probability, inference, and homogeneity. [...] Descriptive statistics are built on the assumption that we can use a single value to characterize a single property for a single universe. […] Probability theory is focused on what happens to samples drawn from a known universe. If the data happen to come from different sources, then there are multiple universes with different probability models.  [...] Statistical inference assumes that you have a sample that is known to have come from one universe." (Donald J Wheeler," Myths About Data Analysis", International Lean & Six Sigma Conference, 2012)

"Probability theory provides the best answer only when the rules of the game are certain, when all alternatives, consequences, and probabilities are known or can be calculated. [...] In the real game, probability theory is not enough. Good intuitions are needed, which can be more challenging than calculations. One way to reduce uncertainty is to rely on rules of thumb." (Gerd Gigerenzer, "Risk Savvy: How to make good decisions", 2014)

"When statisticians, trained in math and probability theory, try to assess likely outcomes, they demand a plethora of data points. Even then, they recognize that unless it’s a very simple and controlled action such as flipping a coin, unforeseen variables can exert significant influence." (Zachary Karabell, "The Leading Indicators: A short history of the numbers that rule our world", 2014)

"Probability theory is not the only tool for rationality. In situations of uncertainty, as opposed to risk, simple heuristics can lead to more accurate judgments, in addition to being faster and more frugal. Under uncertainty, optimal solutions do not exist (except in hindsight) and, by definition, cannot be calculated. Thus, it is illusory to model the mind as a general optimizer, Bayesian or otherwise. Rather, the goal is to achieve satisficing solutions, such as meeting an aspiration level or coming out ahead of a competitor."  (Gerd Gigerenzer et al, "Simply Rational: Decision Making in the Real World", 2015)

"New information is constantly flowing in, and your brain is constantly integrating it into this statistical distribution that creates your next perception (so in this sense 'reality' is just the product of your brain’s ever-evolving database of consequence). As such, your perception is subject to a statistical phenomenon known in probability theory as kurtosis. Kurtosis in essence means that things tend to become increasingly steep in their distribution [...] that is, skewed in one direction. This applies to ways of seeing everything from current events to ourselves as we lean 'skewedly' toward one interpretation, positive or negative. Things that are highly kurtotic, or skewed, are hard to shift away from. This is another way of saying that seeing differently isn’t just conceptually difficult - it’s statistically difficult." (Beau Lotto, "Deviate: The Science of Seeing Differently", 2017)

On Probability Theory (1975-1999)

"The theory of probability is the only mathematical tool available to help map the unknown and the uncontrollable. It is fortunate that this tool, while tricky, is extraordinarily powerful and convenient." (Benoit Mandelbrot, "The Fractal Geometry of Nature", 1977)

"Every branch of mathematics has its combinatorial aspects […] There is combinatorial arithmetic, combinatorial topology, combinatorial logic, combinatorial set theory-even combinatorial linguistics, as we shall see in the section on word play. Combinatorics is particularly important in probability theory where it is essential to enumerate all possible combinations of things before a probability formula can be found." (Martin Gardner, "Aha! Insight", 1978)

"The ‘eyes of the mind’ must be able to see in the phase space of mechanics, in the space of elementary events of probability theory, in the curved four-dimensional space-time of general relativity, in the complex infinite dimensional projective space of quantum theory. To comprehend what is visible to the ‘actual eyes’, we must understand that it is only the projection of an infinite dimensional world on the retina." (Yuri I Manin, "Mathematics and Physics", 1981)

"Scientific theories must tell us both what is true in nature, and how we are to explain it. I shall argue that these are entirely different functions and should be kept distinct. […] Scientific theories are thought to explain by dint of the descriptions they give of reality. […] The covering-law model supposes that all we need to know are the laws of nature - and a little logic, perhaps a little probability theory - and then we know which factors can explain which others." (Nancy Cartwright, "How the Laws of Physics Lie", 1983)

"Increasingly [...] the application of mathematics to the real world involves discrete mathematics... the nature of the discrete is often most clearly revealed through the continuous models of both calculus and probability. Without continuous mathematics, the study of discrete mathematics soon becomes trivial and very limited. [...] The two topics, discrete and continuous mathematics, are both ill served by being rigidly separated." (Richard W Hamming, "Methods of Mathematics Applied to Calculus, Probability, and Statistics", 1985)

"Independence is the central concept of probability theory and few would believe today that understanding what it meant was ever a problem." (Mark Kac, "Enigmas Of Chance", 1985)

"Probability and statistics are now so obviously necessary tools for understanding many diverse things that we must not ignore them even for the average student." (Richard W Hamming, "Methods of Mathematics Applied to Calculus, Probability, and Statistics", 1985)

"Phenomena having uncertain individual outcomes but a regular pattern of outcomes in many repetitions are called random. 'Random' is not a synonym for 'haphazard' but a description of a kind of order different from the deterministic one that is popularly associated with science and mathematics. Probability is the branch of mathematics that describes randomness." (David S Moore, "Uncertainty", 1990)

"Every field of knowledge has its subject matter and its methods, along with a style for handling them. The field of Probability has a great deal of the Art component in it-not only is the subject matter rather different from that of other fields, but at present the techniques are not well organized into systematic methods. As a result each problem has to be "looked at in the right way" to make it easy to solve. Thus in probability theory there is a great deal of art in setting up the model, in solving the problem, and in applying the results back to the real world actions that will follow." (Richard W Hamming, "The Art of Probability for Scientists and Engineers", 1991)

"Probability is too important to be left to the experts. […] The experts, by their very expert training and practice, often miss the obvious and distort reality seriously. [...] The desire of the experts to publish and gain credit in the eyes of their peers has distorted the development of probability theory from the needs of the average user. The comparatively late rise of the theory of probability shows how hard it is to grasp, and the many paradoxes show clearly that we, as humans, lack a well-grounded intuition in the matter. Neither the intuition of the man in the street, nor the sophisticated results of the experts provides a safe basis for important actions in the world we live in." (Richard W Hamming, "The Art of Probability for Scientists and Engineers", 1991)

"Probability theory has a right and a left hand. On the right is the rigorous foundational work using the tools of measure theory. The left hand 'thinks probabilistically', reduces problems to gambling situations, coin-tossing, motions of a physical particle." (Leo Breiman, "Probability", 1992)

"Probability theory is an ideal tool for formalizing uncertainty in situations where class frequencies are known or where evidence is based on outcomes of a sufficiently long series of independent random experiments. Possibility theory, on the other hand, is ideal for formalizing incomplete information expressed in terms of fuzzy propositions." (George Klir, "Fuzzy sets and fuzzy logic", 1995)

"Probability theory is a serious instrument for forecasting, but the devil, as they say, is in the details - in the quality of information that forms the basis of probability estimates." (Peter L Bernstein, "Against the Gods: The Remarkable Story of Risk", 1996)

"The theory of probability can define the probabilities at the gaming casino or in a lottery - there is no need to spin the roulette wheel or count the lottery tickets to estimate the nature of the outcome - but in real life relevant information is essential. And the bother is that we never have all the information we would like. Nature has established patterns, but only for the most part. Theory, which abstracts from nature, is kinder: we either have the information we need or else we have no need for information." (Peter L Bernstein, "Against the Gods: The Remarkable Story of Risk", 1996)

On Probability Theory (1950-1974)

"Historically, the original purpose of the theory of probability was to describe the exceedingly narrow domain of experience connected with games of chance, and the main effort was directed to the calculation of certain probabilities." (William Feller, "An Introduction To Probability Theory And Its Applications", 1950)

"Infinite product spaces are the natural habitat of probability theory." (William Feller, "An Introduction To Probability Theory And Its Applications", 1950)

"Probability is a mathematical discipline with aims akin to those, for example, of geometry or analytical mechanics. In each field we must carefully distinguish three aspects of the theory: (a) the formal logical content, (b) the intuitive background, (c) the applications. The character, and the charm, of the whole structure cannot be appreciated without considering all three aspects in their proper relation." (William Feller, "An Introduction to Probability Theory and Its Applications", 1950)

"Sampling is the science and art of controlling and measuring the reliability of useful statistical information through the theory of probability." (William E Deming, "Some Theory of Sampling", 1950)

"The classical theory of probability was devoted mainly to a study of the gamble's gain, which is again a random variable; in fact, every random variable can be interpreted as the gain of a real or imaginary gambler in a suitable game." (William Feller, "An Introduction To Probability Theory And Its Applications", 1950)

"The painful experience of many gamblers has taught us the lesson that no system of betting is successful in improving the gambler's chances. If the theory of probability is true to life, this experience must correspond to a provable statement." (William Feller, "An Introduction To Probability Theory And Its Applications", 1950)

"In a sense, of course, probability theory in the form of the simple laws of chance is the key to the analysis of warfare; […] My own experience of actual operational research work, has however, shown that its is generally possible to avoid using anything more sophisticated. […] In fact the wise operational research worker attempts to concentrate his efforts in finding results which are so obvious as not to need elaborate statistical methods to demonstrate their truth. In this sense advanced probability theory is something one has to know about in order to avoid having to use it." (Patrick M S Blackett, "Operations Research", Physics Today, 1951)

"The study of inductive inference belongs to the theory of probability, since observational facts can make a theory only probable but will never make it absolutely certain." (Hans Reichenbach, "The Rise of Scientific Philosophy", 1951)

"To say that observations of the past are certain, whereas predictions are merely probable, is not the ultimate answer to the question of induction; it is only a sort of intermediate answer, which is incomplete unless a theory of probability is developed that explains what we should mean by ‘probable’ and on what ground we can assert probabilities." (Hans Reichenbach, "The Rise of Scientific Philosophy", 1951)

"The epistemological value of probability theory is based on the fact that chance phenomena, considered collectively and on a grand scale, create non-random regularity." (Andrey N Kolmogorov, "Limit Distributions for Sums of Independent Random Variables", 1954)

"On the other hand, the 'subjective' school of thought, regards probabilities as expressions of human ignorance; the probability of an event is merely a formal expression of our expectation that the event will or did occur, based on whatever information is available. To the subjectivist, the purpose of probability theory is to help us in forming plausible conclusions in cases where there is not enough information available to lead to certain conclusions; thus detailed verification is not expected. The test of a good subjective probability distribution is does it correctly represent our state of knowledge as to the value of x?" (Edwin T Jaynes, "Information Theory and Statistical Mechanics" I, 1956)

"Probability is a mathematical discipline with aims akin to those, for example, of geometry or analytical mechanics. In each field we must carefully distinguish three aspects of the theory: (a) the formal logical content, (b) the intuitive background, (c) the applications. The character, and the charm, of the whole structure cannot be appreciated without considering all three aspects in their proper relation." (William Feller, "An Introduction to Probability Theory and Its Applications", 1957)

"The theory of probability can never lead to a definite statement concerning a single event." (Richard von Mises, "Probability, Statistics, and Truth" 2nd Ed., 1957)

"To the author the main charm of probability theory lies in the enormous variability of its applications. Few mathematical disciplines have contributed to as wide a spectrum of subjects, a spectrum ranging from number theory to physics, and even fewer have penetrated so decisively the whole of our scientific thinking." (Mark Kac, "Lectures in Applied Mathematics" Vol. 1, 1959)

"The mathematician, the statistician, and the philosopher do different things with a theory of probability. The mathematician develops its formal consequences, the statistician applies the work of the mathematician and the philosopher describes in general terms what this application consists in. The mathematician develops symbolic tools without worrying overmuch what the tools are for; the statistician uses them; the philosopher talks about them. Each does his job better if he knows something about the work of the other two." (Irvin J Good, "Kinds of Probability", Science Vol. 129, 1959)

"Incomplete knowledge must be considered as perfectly normal in probability theory; we might even say that, if we knew all the circumstances of a phenomenon, there would be no place for probability, and we would know the outcome with certainty." (Félix E Borel, Probability and Certainty", 1963)

"The probability concept used in probability theory has exactly the same structure as have the fundamental concepts in any field in which mathematical analysis is applied to describe and represent reality." (Richard von Mises, "Mathematical Theory of Probability and Statistics", 1964)

"After all, without the experiment - either a real one or a mathematical model - there would be no reason for a theory of probability." (Thornton C Fry, "Probability and Its Engineering Uses", 1965)

"This faulty intuition as well as many modern applications of probability theory are under the strong influence of traditional misconceptions concerning the meaning of the law of large numbers and of a popular mystique concerning a so-called law of averages." (William Feller, "An Introduction to Probability Theory and Its Applications", 1968)

"Probability theory, for us, is not so much a part of mathematics as a part of logic, inductive logic, really. It provides a consistent framework for reasoning about statements whose correctness or incorrectness cannot be deduced from the hypothesis. The information available is sufficient only to make the inferences 'plausible' to a greater or lesser extent." (Ralph Baierlein, "Atoms and Information Theory: An Introduction to Statistical Mechanics", 1971)

"Since small differences in probability cannot be appreciated by the human mind, there seems little point in being excessively precise about uncertainty." (George E P Box & G C Tiao, "Bayesian inference in statistical analysis", 1973)

"The field of probability and statistics is then transformed into a Tower of Babel, in which only the most naive amateur claims to understand what he says and hears, and this because, in a language devoid of convention, the fundamental distinctions between what is certain and what is not, and between what is impossible and what is not, are abolished. Certainty and impossibility then become confused with high or low degrees of a subjective probability, which is itself denied precisely by this falsification of the language. On the contrary, the preservation of a clear, terse distinction between certainty and uncertainty, impossibility and possibility, is the unique and essential precondition for making meaningful statements (which could be either right or wrong), whereas the alternative transforms every sentence into a nonsense." (Bruno de Finetti, "Theory of Probability", 1974)

On Probability Theory (-1949)

"I am convinced that it is impossible to expound the methods of induction in a sound manner, without resting them on the theory of probability. Perfect knowledge alone can give certainty, and in nature perfect knowledge would be infinite knowledge, which is clearly beyond our capacities. We have, therefore, to content ourselves with partial knowledge, - knowledge mingled with ignorance, producing doubt." (William S Jevons, "The Principles of Science: A Treatise on Logic and Scientific Method", 1887)

"There is no more remarkable feature in the mathematical theory of probability than the manner in which it has been found to harmonize with, and justify, the conclusions to which mankind have been led, not by reasoning, but by instinct and experience, both of the individual and of the race. At the same time it has corrected, extended, and invested them with a definiteness and precision of which these crude, though sound, appreciations of common sense were till then devoid." (Morgan W Crofton, "Probability", Encyclopaedia Britannica 9th Ed,, 1885)

"A collective appropriate for the application of the theory of probability must fulfil two conditions. First, the relative frequencies of the attributes must possess limiting values. Second, these limiting values must remain the same in all partial sequences which may be selected from the original one in an arbitrary way. Of course, only such partial sequences can be taken into consideration as can be extended indefinitely, in the same way as the original sequence itself." (Richard von Mises, "Probability, Statistics and Truth", 1928)

"A great number of popular and more or less serious objections to the theory of probability disappear at once when we recognize that the exclusive purpose of this theory is to determine, from the given probabilities in a number of initial collectives, the probabilities in a new collective derived from the initial ones." (Richard von Mises, "Probability, Statistics and Truth", 1928)

"The rational concept of probability, which is the only basis of probability calculus, applies only to problems in which either the same event repeats itself again and again, or a great number of uniform elements are involved at the same time. Using the language of physics, we may say that in order to apply the theory of probability we must have a practically unlimited sequence of uniform observations." (Richard von Mises, "Probability, Statistics and Truth", 1928)

"The result of each calculation appertaining to the field of probability is always, as far as our theory goes, nothing else but a probability, or, using our general definition, the relative frequency of a certain event in a sufficiently long (theoretically, infinitely long) sequence of observations. The theory of probability can never lead to a definite statement concerning a single event. The only question that it can answer is: what is to be expected in the course of a very long sequence of observations? It is important to note that this statement remains valid also if the calculated probability has one of the two extreme values 1 or 0." (Richard von Mises, "Probability, Statistics and Truth", 1928)

"The theory of probability as a mathematical discipline can and should be developed from axioms in exactly the same way as geometry and algebra." (Andrey N Kolmogorov, "Foundations of the Theory of Probability", 1933)

"The most important application of the theory of probability is to what we may call 'chance-like' or 'random' events, or occurrences. These seem to be characterized by a peculiar kind of incalculability which makes one disposed to believe - after many unsuccessful attempts - that all known rational methods of prediction must fail in their case. We have, as it were, the feeling that not a scientist but only a prophet could predict them. And yet, it is just this incalculability that makes us conclude that the calculus of probability can be applied to these events." (Karl R Popper, "The Logic of Scientific Discovery", 1934)

"Statistics is a scientific discipline concerned with collection, analysis, and interpretation of data obtained from observation or experiment. The subject has a coherent structure based on the theory of Probability and includes many different procedures which contribute to research and development throughout the whole of Science and Technology." (Egon Pearson, 1936)

On Construction III: Theories

"Analysis is a method where one assumes that which is sought, and from this, through a series of implications, arrives at something which is agreed upon on the basis of synthesis; because in analysis, one assumes that which is sought to be known, proved, or constructed, and examines what this is a consequence of and from what this latter follows, so that by backtracking we end up with something that is already known or is part of the starting points of the theory; we call such a method analysis; it is, in a sense, a solution in reversed direction. In synthesis we work in the opposite direction: we assume the last result of the analysis to be true. Then we put the causes from analysis in their natural order, as consequences, and by putting these together we obtain the proof or the construction of that which is sought. We call this synthesis." (Pappus of Alexandria, cca. 4th century BC)

"[...] the task of the theory consists in constructing a picture of the external world that exists purely internally and must be our guiding star in all thought and experiment; that is in completing, as it were, the thinking process and carrying out globally what on a small scale occurs within us whenever we form an idea." (Ludwig E Boltzmann, "On the Significance of Theories", 1890)

"But surely it is self-evident that every theory is merely a framework or scheme of concepts together with their necessary relations to one another, and that the basic elements can be constructed as one pleases." (Gottlob Frege, "On the Foundations of Geometry and Formal Theories of Arithmetic" , cca. 1903-1909)

"We shall call this universal organizational science the 'Tektology'. The literal translation of this word from the Greek is 'the theory of construction'. 'Construction' is the most generaI and suitable synonym for the modern concept of 'organization'. [...] The aim of tektology is to systematize organizational experience; this science is clearly empirical and should draw its conclusions by way of induction." (Alexander Bogdanov, "Tektology: The Universal Organizational Science" Vol. I, 1913)

"[…] the process of scientific discovery may be regarded as a form of art. This is best seen in the theoretical aspects of Physical Science. The mathematical theorist builds up on certain assumptions and according to well understood logical rules, step by step, a stately edifice, while his imaginative power brings out clearly the hidden relations between its parts. A well-constructed theory is in some respects undoubtedly an artistic production." (Ernest Rutherford, 1932)

"A scientist, whether theorist or experimenter, puts forward statements, or systems of statements, and tests them step by step. In the field of the empirical sciences, more particularly, he constructs hypotheses, or systems of theories, and tests them against experience by observation and experiment." (Karl Popper, "The Logic of Scientific Discovery", 1934)

"A theoretical science unaware that those of its constructs considered relevant and momentous are destined eventually to be framed in concepts and words that have a grip on the educated community and become part and parcel of the general world picture - a theoretical science [...]" (Erwin Schrödinger, "Are There Quantum Jumps?", The British Journal for the Philosophy of Science Vol. 3, 1952)

"A second possible approach to general systems theory is through the arrangement of theoretical systems and constructs in a hierarchy of complexity, roughly corresponding to the complexity of the ‘individuals’ of the various empirical fields […] leading towards a ‘system of systems’." (Kenneth E Boulding, "General Systems Theory - The Skeleton of Science", 1956)

"General Systems Theory is a name which has come into use to describe a level of theoretical model-building which lies somewhere between the highly generalized constructions of pure mathematics and the specific theories of the specialized disciplines. Mathematics attempts to organize highly general relationships into a coherent system, a system however which does not have any necessary connections with the 'real' world around us. It studies all thinkable relationships abstracted from any concrete situation or body of empirical knowledge." (Kenneth E Boulding, "General Systems Theory - The Skeleton of Science", Management Science Vol. 2 (3), 1956)

"The usefulness of the models in constructing a testable theory of the process is severely limited by the quickly increasing number of parameters which must be estimated in order to compare the predictions of the models with empirical results" (Anatol Rapoport, "Prisoner's Dilemma: A study in conflict and cooperation", 1965)

"Theories rarely arise as patient inferences forced by accumulated facts. Theories are mental constructs potentiated by complex external prods (including, in idealized cases, a commanding push from empirical reality)." (Stephen J Gould, "Leonardo's Mountain of Clams and the Diet of Worms", 1998)

Theory of Everything I

"Physicists dream of a unified description of Nature. Symmetry, in its power to tie together apparently unrelated aspects of physics, is linked closely to the notion of unity." (Anthony Zee, "Fearful Symmetry: The Search for Beauty in Modern Physics", 1986)

"The theory of everything may come in its time, but not until we are certain that Nature has exhausted her bag of performable tricks." (Sheldon L Glashow, "Desperately Seeking Superstrings?", Physics Today, 1986)

"A more interesting problem is the extent to which the brain is qualitatively adapted to understand the Universe. Why should its categories of thought and understanding be able to cope with the scope and nature of the real world? Why should be Theory of Everything be written in a 'language' that our minds can decode? Why has the process of natural selection so over-endowed us with mental faculties that we can understand the whole fabric of the Universe far beyond anything required for our past and present survival?" (John D Barrow, "New Theories of Everything", 1991)

"On this view, we recognize science to be the search for algorithmic compressions. We list sequences of observed data. We try to formulate algorithms that compactly represent the information content of those sequences. Then we test the correctness of our hypothetical abbreviations by using them to predict the next terms in the string. These predictions can then be compared with the future direction of the data sequence. Without the development of algorithmic compressions of data all science would be replaced by mindless stamp collecting - the indiscriminate accumulation of every available fact. Science is predicated upon the belief that the Universe is algorithmically compressible and the modern search for a Theory of Everything is the ultimate expression of that belief, a belief that there is an abbreviated representation of the logic behind the Universe's properties that can be written down in finite form by human beings." (John D Barrow, New Theories of Everything", 1991)

"The inflationary period of expansion does not smooth out irregularity by entropy-producing processes like those explored by the cosmologies of the seventies. Rather it sweeps the irregularity out beyond the Horizon of our visible Universe, where we cannot see it. The entire universe of stars and galaxies on view to us. […] on this hypothesis, is but the reflection of a minute, perhaps infinitesimal, portion of the universe's initial conditions, whose ultimate extent and structure must remain forever unknowable to us. A theory of everything does not help here. The information contained in the observable part of the universe derives from the evolution of a tiny part of the initial conditions for the entire universe. The sum total of all the observations we could possibly make can only tell us about a minuscule portion of the whole." (John D Barrow, "Theories of Everything: The Quest for Ultimate Explanation", 1991)

"The scope of Theories of Everything is infinite but bounded; they are necessary parts of a full understanding of things but they are far from sufficient to reveal everything about a Universe like ours. In the pages of this book, we have seen something of what a Theory of Everything might hope to teach us about the unity of the Universe and the way in which it may contain elements that transcend our present compartmentalized view of Nature's ingredients. But we have also learnt that there is more to Everything than meets the eye. Unlike many others that we can imagine, our world contains prospective elements. Theories of Everything can make no impression upon predicting these prospective attributes of reality; yet, strangely, many of these qualities will themselves be employed in the human selection and approval of an aesthetically acceptable Theory of Everything. There is no formula that can deliver all truth, all harmony, all simplicity. No Theory of Everything can ever provide total insight. For, to see through everything, would leave us seeing nothing at all." (John D Barrow, "New Theories of Everything", 1991)

"The problems associated with the initial singularity of the universe bring us to what is called the theory of everything. It is an all-encompassing theory that would completely explain me origin of the universe and everything in it. It would bring together general relativity and quantum mechanics, and explain everything there is to know about the elementary particles of the universe, and the four basic forces of nature (gravitational, electromagnetic, weak, and strong nuclear forces). Furthermore, it would explain the basic laws of nature and the fundamental constants of nature such as the speed of light and Planck's constant." (Barry R Parker, "Chaos in the Cosmos: The stunning complexity of the universe", 1996)

"I don't have the hubris to imagine a theory of everything. I think that we scientists are seeking an understanding of the natural world. We come in various types - chemists and physicists and biologists and such - and we all have the same goal. We are making progress. The theories we have today of life and chemistry and physics are much better than they were ten years ago. And ten years from now they will be better still." (Sheldon Lee Glashow, [interview] 2003)

Communication Theory II

"Communication theory deals with certain important but abstract aspects of communication. Communication theory proceeds from clear and definite assumptions to theorems concerning information sources and communication channels. In this it is essentially mathematical, and in order to understand it we must understand the idea of a theorem as a statement which must be proved, that is, which must be shown to be the necessary consequence of a set of initial assumptions. This is an idea which is the very heart of mathematics as mathematicians understand it." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals & Noise" 2nd Ed., 1980)

"Communication theory tells us how many bits of information can be sent per second over perfect and imperfect communication channels in terms of rather abstract descriptions of the properties of these channels. Communication theory tells us how to measure the rate at which a message source, such as a speaker or a writer, generates information. Communication theory tells us how to represent, or encode, messages from a particular message source efficiently for transmission over a particular sort of channel, such as an electrical circuit, and it tells us when we can avoid errors in transmission." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals & Noise" 2nd Ed., 1980)

"In communication theory we consider a message source, such as a writer or a speaker, which may produce on a given occasion any one of many possible messages. The amount of information conveyed by the message increases as the amount of uncertainty as to what message actually will be produced becomes greater. A message which is one out of ten possible messages conveys a smaller amount of information than a message which is one out of a million possible messages. The entropy of communication theory is a measure of this uncertainty and the uncertainty, or entropy, is taken as the measure of the amount of information conveyed by a message from a source. The more we know about what message the source will produce, the less uncertainty, the less the entropy, and the less the information." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals & Noise" 2nd Ed., 1980)

"The amount of information conveyed by the message increases as the amount of uncertainty as to what message actually will be produced becomes greater. A message which is one out of ten possible messages conveys a smaller amount of information than a message which is one out of a million possible messages. The entropy of communication theory is a measure of this uncertainty and the uncertainty, or entropy, is taken as the measure of the amount of information conveyed by a message from a source. The more we know about what message the source will produce, the less uncertainty, the less the entropy, and the less the information." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals and Noise", 1980)

"Thus, information is sometimes associated with the idea of knowledge through its popular use rather than with uncertainty and the resolution of uncertainty, as it is in communication theory." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals & Noise" 2nd Ed., 1980)

"Cybernetics is concerned with scientific investigation of systemic processes of a highly varied nature, including such phenomena as regulation, information processing, information storage, adaptation, self-organization, self-reproduction, and strategic behavior. Within the general cybernetic approach, the following theoretical fields have developed: systems theory (system), communication theory, game theory, and decision theory." (Fritz B Simon et al, "Language of Family Therapy: A Systemic Vocabulary and Source Book", 1985)

"General evolution theory, based on the integration of the relevant tenets of general system theory, cybernetics, information and communication theory, chaos theory, dynamical systems theory, and nonequilibrium thermodynamics, can convey a sound understanding of the laws and dynamics that govern the evolution of complex systems in the various realms of investigation [...]. The basic notions of this new discipline can be developed to give an adequate account of the dynamical evolution of human societies as well. Such an account could furnish the basis of a system of knowledge better able to orient human beings and societies in their rapidly changing milieu." (Ervin László et al, "The Evolution of Cognitive Maps: New Paradigms for the Twenty-first Century", 1993)

"Communication theory is enormously rich in the range of ideas that fall within its nominal scope, and new theoretical work on communication has recently been flourishing. Nevertheless, despite the ancient roots and growing profusion of theories about communication, I argue that communication theory as an identifiable field of study does not yet exist." (Robert T Craig "Communication Theory as a Field", 1999)

The very essence of mass communication theory is a simple but all-embracing expression of technological determinism, since the essential features depend on what certain technologies have made possible, certain technologies have made possible, especially the following: communication at a distance, the multiplication and simultaneous distribution of diverse ‘messages’, the enormous capacity and speed of carriers, and the limitations on response. There is no escaping the implication that public communication as practised in modern societies is profoundly shaped by these general features." (Denis McQuail, "McQuail's Reader in Mass Communication Theory", 2002)

"Without an understanding of causality there can be no theory of communication. What passes as information theory today is not communication at all, but merely transportation." (Marshall McLuhan, "The Book of Probes : Marshall McLuhan", 2011) 

"Cybernetics is an interdisciplinary science. It originated ‘at the junction’ of mathematics, logic, semiotics, physiology, biology and sociology. Among its inherent features, we mention analysis and revelation of general principles and approaches in scientific cognition. Control theory, communication theory, operations research and others represent most weighty theories within cybernetics 1.0." (Dmitry A Novikov, "Cybernetics 2.0", 2016)

Communication Theory I

"We have decided to call the entire field of control and communication theory, whether in the machine or in the animal, by the name Cybernetics, which we form from the Greek [...] for steersman. In choosing this term, we wish to recognize that the first significant paper on feedback mechanisms is an article on governors, which was published by Clerk Maxwell in 1868, and that governor is derived from a Latin corruption [...] We also wish to refer to the fact that the steering engines of a ship are indeed one of the earliest and best-developed forms of feedback mechanisms." (Norbert Wiener, "Cybernetics", 1948)

"Incomplete knowledge of the future, and also of the past of the transmitter from which the future might be constructed, is at the very basis of the concept of information. On the other hand, complete ignorance also precludes communication; a common language is required, that is to say an agreement between the transmitter and the receiver regarding the elements used in the communication process [... The information of a message can] be defined as the 'minimum number of binary decisions which enable the receiver to construct the message, on the basis of the data already available to him.' These data comprise both the convention regarding the symbols and the language used, and the knowledge available at the moment when the message started." (Dennis Gabor, "Optical transmission" [in: "Information Theory: Papers Read at a Symposium on Information Theory"], 1952) 

"The theory of communication is partly concerned with the measurement of information content of signals, as their essential property in the establishment of communication links. But the information content of signals is not to be regarded as a commodity; it is more a property or potential of the signals, and as a concept it is closely related to the idea of selection, or discrimination. This mathematical theory first arose in telegraphy and telephony, being developed for the purpose of measuring the information content of telecommunication signals. It concerned only the signals themselves as transmitted along wires, or broadcast through the aether, and is quite abstracted from all questions of 'meaning'. Nor does it concern the importance, the value, or truth to any particular person. As a theory, it lies at the syntactic level of sign theory and is abstracted from the semantic and pragmatic levels. We shall argue [...] that, though the theory does not directly involve biological elements, it is nevertheless quite basic to the study of human communication - basic but insufficient." (Colin Cherry, "On Human Communication", 1957)

"A more viable model, one much more faithful to the kind of system that society is more and more recognized to be, is in process of developing out of, or is in keeping with, the modern systems perspective (which we use loosely here to refer to general systems research, cybernetics, information and communication theory, and related fields). Society, or the sociocultural system, is not, then, principally an equilibrium system or a homeostatic system, but what we shall simply refer to as a complex adaptive system." (Walter F Buckley, "Society as a complex adaptive system", 1968)

"The general notion in communication theory is that of information. In many cases, the flow of information corresponds to a flow of energy, e. g. if light waves emitted by some objects reach the eye or a photoelectric cell, elicit some reaction of the organism or some machinery, and thus convey information." (Ludwig von Bertalanffy, "General System Theory", 1968) 

"The 'flow of information' through human communication channels is enormous. So far no theory exists, to our knowledge, which attributes any sort of unambiguous measure to this 'flow'." (Anatol Rapoport, "Modern Systems Research for the Behavioral Scientist", 1969)

"The term hypothesis testing arises because the choice as to which process is observed is based on hypothesized models. Thus hypothesis testing could also be called model testing. Hypothesis testing is sometimes called decision theory. The detection theory of communication theory is a special case." (Fred C Scweppe, "Uncertain dynamic systems", 1973)

John R Pierce - Collected Quotes

"A valid scientific theory seldom if ever offers the solution to the pressing problems which we repeatedly state. It seldom supplies a sensible answer to our multitudinous questions. Rather than rationalizing our ideas, it discards them entirely, or, rather, it leaves them as they were. It tells us in a fresh and new way what aspects of our experience can profitably be related and simply understood." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals & Noise" 2nd Ed., 1980)

"Communication theory deals with certain important but abstract aspects of communication. Communication theory proceeds from clear and definite assumptions to theorems concerning information sources and communication channels. In this it is essentially mathematical, and in order to understand it we must understand the idea of a theorem as a statement which must be proved, that is, which must be shown to be the necessary consequence of a set of initial assumptions. This is an idea which is the very heart of mathematics as mathematicians understand it." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals & Noise" 2nd Ed., 1980)

"Communication theory tells us how many bits of information can be sent per second over perfect and imperfect communication channels in terms of rather abstract descriptions of the properties of these channels. Communication theory tells us how to measure the rate at which a message source, such as a speaker or a writer, generates information. Communication theory tells us how to represent, or encode, messages from a particular message source efficiently for transmission over a particular sort of channel, such as an electrical circuit, and it tells us when we can avoid errors in transmission." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals & Noise" 2nd Ed., 1980)

"However, it turns out that a one-to-one mapping of the points in a square into the points on a line cannot be continuous. As we move smoothly along a curve through the square, the points on the line which represent the successive points on the square necessarily jump around erratically, not only for the mapping described above but for any one-to-one mapping whatever. Any one-to-one mapping of the square onto the line is discontinuous." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals & Noise" 2nd Ed., 1980)

"In communication theory we consider a message source, such as a writer or a speaker, which may produce on a given occasion any one of many possible messages. The amount of information conveyed by the message increases as the amount of uncertainty as to what message actually will be produced becomes greater. A message which is one out of ten possible messages conveys a smaller amount of information than a message which is one out of a million possible messages. The entropy of communication theory is a measure of this uncertainty and the uncertainty, or entropy, is taken as the measure of the amount of information conveyed by a message from a source. The more we know about what message the source will produce, the less uncertainty, the less the entropy, and the less the information." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals & Noise" 2nd Ed., 1980)

"Mathematics is a way of finding out, step by step, facts which are inherent in the statement of the problem but which are not immediately obvious. Usually, in applying mathematics one must first hit on the facts and then verify them by proof. Here we come upon a knotty problem, for the proofs which satisfied mathematicians of an earlier day do not satisfy modem mathematicians." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals & Noise" 2nd Ed., 1980)

"Mathematicians start out with certain assumptions and definitions, and then by means of mathematical arguments or proofs they are able to show that certain statements or theorems are true." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals & Noise" 2nd Ed., 1980)

"One of these is that many of the most general and powerful discoveries of science have arisen, not through the study of phenomena as they occur in nature, but, rather, through the study of phenomena in man-made devices, in products of technology, if you will. This is because the phenomena in man’s machines are simplified and ordered in comparison with those occurring naturally, and it is these simplified phenomena that man understands most easily." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals & Noise" 2nd Ed., 1980)

"Ordinarily, while mathematicians may suspect or conjecture the truth of certain statements, they have to prove theorems in order to be certain." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals & Noise" 2nd Ed., 1980)

"The ideas and assumptions of a theory determine the generalityof the theory, that is, to how wide a range of phenomena the theory applies." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals & Noise" 2nd Ed., 1980)

"The fact that network theory evolved from the study of idealized electrical systems rather than from the study of idealized mechanical systems is a matter of history, not of necessity." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals & Noise" 2nd Ed., 1980)

"Theories are strongly physical when they describe very completely some range of physical phenomena, which in practice is always limited. Theories become more mathematical or abstract when they deal with an idealized class of phenomena or with only certain aspects of phenomena." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals & Noise" 2nd Ed., 1980)

"Thus, in physics, entropy is associated with the possibility of converting thermal energy into mechanical energy. If the entropy does not change during a process, the process is reversible. If the entropy increases, the available energy decreases. Statistical mechanics interprets an increase of entropy as a decrease in order or, if we wish, as a decrease in our knowledge." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals & Noise" 2nd Ed., 1980)

"Thus, information is sometimes associated with the idea of knowledge through its popular use rather than with uncertainty and the resolution of uncertainty, as it is in communication theory." (John R Pierce, "An Introduction to Information Theory: Symbols, Signals & Noise" 2nd Ed., 1980)

Scientific Experience II: Theory

"The world can doubtless never be well known by theory: practice is absolutely necessary; but surely it is of great use to a young man, before he sets out for that country, full of mazes, windings, and turnings, to have at least a general map of it, made by some experienced traveler." (Philip Stanhope, "Letters Written by the Earl of Chesterfield to His Son", 1827)

"Theories are always very thin and unsubstantial; experience only is tangible." (Hosea Ballou, "Universalist Expositor", 1831)

"Observation is so wide awake, and facts are being so rapidly added to the sum of human experience, that it appears as if the theorizer would always be in arrears, and were doomed forever to arrive at imperfect conclusion; but the power to perceive a law is equally rare in all ages of the world, and depends but little on the number of facts observed." (Henry D Thoreau, "A Week on the Concord and Merrimack Rivers", 1862)

"Some think to avoid the influence of metaphysical errors, by paying no attention to metaphysics; but experience shows that these men beyond all others are held in an iron vice of metaphysical theory, because by theories that they have never called in question." (Charles S Peirce, 1867)

"It [a theory] ought to furnish a compass which, if followed, will lead the observer further and further into previously unexplored regions. Whether these regions will be barren or fertile experience alone will decide; but, at any rate, one who is guided in this way will travel onward in a definite direction, and will not wander aimlessly to and fro." (Sir Joseph J Thomson, "The Corpuscular Theory of Matter", 1907)

"Often a liberal antidote of experience supplies a sovereign cure for a paralyzing abstraction built upon a theory." (Benjamin N Cardozo, "Paradoxes of Legal Science", 1928)

"It can scarcely be denied that the supreme goal of all theory is to make the irreducible basic elements as simple and as few as possible without having to surrender the adequate representation of a single datum of experience." (Albert Einstein, [lecture] 1933)

"A scientist, whether theorist or experimenter, puts forward statements, or systems of statements, and tests them step by step. In the field of the empirical sciences, more particularly, he constructs hypotheses, or systems of theories, and tests them against experience by observation and experiment." (Karl Popper, "The Logic of Scientific Discovery", 1934)

"A discovery in science, or a new theory, even when it appears most unitary and most all-embracing, deals with some immediate element of novelty or paradox within the framework of far vaster, unanalysed, unarticulated reserves of knowledge, experience, faith, and presupposition. Our progress is narrow; it takes a vast world unchallenged and for granted. This is one reason why, however great the novelty or scope of new discovery, we neither can, nor need, rebuild the house of the mind very rapidly. This is one reason why science, for all its revolutions, is conservative. This is why we will have to accept the fact that no one of us really will ever know very much. This is why we shall have to find comfort in the fact that, taken together, we know more and more." (J. Robert Oppenheimer, Science and the Common Understanding, 1954)

"The advantages of models are, on one hand, that they force us to present a 'complete' theory by which I mean a theory taking into account all relevant phenomena and relations and, on the other hand, the confrontation with observation, that is, reality." (Jan Tinbergen, "The Use of Models: Experience," 1969)

"A hypothesis is empirical or scientific only if it can be tested by experience. […] A hypothesis or theory which cannot be, at least in principle, falsified by empirical observations and experiments does not belong to the realm of science." (Francisco J Ayala, "Biological Evolution: Natural Selection or Random Walk", American Scientist, 1974)

"Experience without theory teaches nothing." (William E Deming, "Out of the Crisis", 1986)

Julien C Sprott - Collected Quotes

"A system of equations is deemed most elegant if it contains no un- necessary terms or parameters and if the parameters that remain have a minimum of digits. [...] Just as one can find the most elegant set of parameters for a given system, it is possible to find the most elegant set of initial conditions within the basin of attraction or chaotic sea. However, it is usually more useful to have initial conditions that are close to the attractor to reduce the transients that would otherwise occur."  (Julien C Sprott, "Elegant Chaos: Algebraically Simple Chaotic Flows", 2010)

"Another property of bounded systems is that, unless the trajectory attracts to an equilibrium point where it stalls and remains forever, the points must continue moving forever with the flow. However, if we consider two initial conditions separated by a small distance along the direction of the flow, they will maintain their average separation forever since they are subject to the exact same flow but only delayed slightly in time. This fact implies that one of the Lyapunov exponents for a bounded continuous flow must be zero unless the flow attracts to a stable equilibrium." (Julien C Sprott, "Elegant Chaos: Algebraically Simple Chaotic Flows", 2010)

"In a chaotic system, there must be stretching to cause the exponential separation of initial conditions but also folding to keep the trajectories from moving off to infinity. The folding requires that the equations of motion contain at least one nonlinearity, leading to the important principle that chaos is a property unique to nonlinear dynamical systems. If a system of equations has only linear terms, it cannot exhibit chaos no matter how complicated or high-dimensional it may be." (Julien C Sprott, "Elegant Chaos: Algebraically Simple Chaotic Flows", 2010)

"In fact, contrary to intuition, some of the most complicated dynamics arise from the simplest equations, while complicated equations often produce very simple and uninteresting dynamics. It is nearly impossible to look at a nonlinear equation and predict whether the solution will be chaotic or otherwise complicated. Small variations of a parameter can change a chaotic system into a periodic one, and vice versa." (Julien C Sprott, "Elegant Chaos: Algebraically Simple Chaotic Flows", 2010)

"In fact, there are as many Lyapunov exponents as there are state space variables, and what was calculated is only the largest (or least negative) of them. Fortunately, this is the only one that is required to identify chaos, since if it is positive, the system exhibits sensitive dependence on initial conditions independent of the values of the others, and if it is zero or negative, none of the others can be positive either." (Julien C Sprott, "Elegant Chaos: Algebraically Simple Chaotic Flows", 2010)

"Systems with dimension greater than four begin to lose their elegance unless they possess some kind of symmetry that reduces the number of parameters. One such symmetry has the variables arranged in a ring of many identical elements, each connected to its neighbors in an identical fashion. The symmetry of the equations is often broken in the solutions, giving rise to spatiotemporal chaotic patterns that are elegant in their own right." (Julien C Sprott, "Elegant Chaos: Algebraically Simple Chaotic Flows", 2010)

"The main defining feature of chaos is the sensitive dependence on initial conditions. Two nearby initial conditions on the attractor or in the chaotic sea separate by a distance that grows exponentially in time when averaged along the trajectory, leading to long-term unpredictability. The Lyapunov exponent is the average rate of growth of this distance, with a positive value signifying sensitive dependence (chaos), a zero value signifying periodicity (or quasiperiodicity), and a negative value signifying a stable equilibrium." (Julien C Sprott, "Elegant Chaos: Algebraically Simple Chaotic Flows", 2010)

"The possible existence of multiple attractors means that it is necessary to search different initial conditions as well as different parameters when determining whether a given dynamical system is capable of exhibiting chaos." (Julien C Sprott, "Elegant Chaos: Algebraically Simple Chaotic Flows", 2010)

"Transient chaos can be viewed as a situation in which an attractor touches its basin of attraction but only at places that are rarely visited by the trajectory. The trajectory is initially drawn to the attractor and wanders around on it for a long time before eventually coming to a place outside the basin of attraction, whereupon it escapes. Think of a fly buzzing around in a box for a long time before discovering a small hole in the wall that leads to the outside world. Of course the hole could also be a small patch of flypaper that would bring the °y to a permanent halt, just as a stable equilibrium might for a transiently chaotic trajectory." (Julien C Sprott, "Elegant Chaos: Algebraically Simple Chaotic Flows", 2010)

Decision Theory I

"Years ago a statistician might have claimed that statistics deals with the processing of data [...] today’s statistician will be more likely to say that statistics is concerned with decision making in the face of uncertainty." (Herman Chernoff & Lincoln E Moses, "Elementary Decision Theory", 1959)

"Another approach to management theory, undertaken by a growing and scholarly group, might be referred to as the decision theory school. This group concentrates on rational approach to decision-the selection from among possible alternatives of a course of action or of an idea. The approach of this school may be to deal with the decision itself, or to the persons or organizational group making the decision, or to an analysis of the decision process. Some limit themselves fairly much to the economic rationale of the decision, while others regard anything which happens in an enterprise the subject of their analysis, and still others expand decision theory to cover the psychological and sociological aspect and environment of decisions and decision-makers." (Harold Koontz, "The Management Theory Jungle," 1961)

"The term hypothesis testing arises because the choice as to which process is observed is based on hypothesized models. Thus hypothesis testing could also be called model testing. Hypothesis testing is sometimes called decision theory. The detection theory of communication theory is a special case." (Fred C Scweppe, "Uncertain dynamic systems", 1973)

"In decision theory, mathematical analysis shows that once the sampling distribution, loss function, and sample are specified, the only remaining basis for a choice among different admissible decisions lies in the prior probabilities. Therefore, the logical foundations of decision theory cannot be put in fully satisfactory form until the old problem of arbitrariness (sometimes called 'subjectiveness') in assigning prior probabilities is resolved." (Edwin T Jaynes, "Prior Probabilities", 1978)

"Decision theory, as it has grown up in recent years, is a formalization of the problems involved in making optimal choices. In a certain sense - a very abstract sense, to be sure - it incorporates among others operations research, theoretical economics, and wide areas of statistics, among others." (Kenneth Arrow, "The Economics of Information", 1984) 

"Cybernetics is concerned with scientific investigation of systemic processes of a highly varied nature, including such phenomena as regulation, information processing, information storage, adaptation, self-organization, self-reproduction, and strategic behavior. Within the general cybernetic approach, the following theoretical fields have developed: systems theory (system), communication theory, game theory, and decision theory." (Fritz B Simon et al, "Language of Family Therapy: A Systemic Vocabulary and Source Book", 1985)

"A field of study that includes a methodology for constructing computer simulation models to achieve better under-standing of social and corporate systems. It draws on organizational studies, behavioral decision theory, and engineering to provide a theoretical and empirical base for structuring the relationships in complex systems." (Virginia Anderson & Lauren Johnson, "Systems Thinking Basics: From Concepts to Casual Loops", 1997) 

"A decision theory that rests on the assumptions that human cognitive capabilities are limited and that these limitations are adaptive with respect to the decision environments humans frequently encounter. Decision are thought to be made usually without elaborate calculations, but instead by using fast and frugal heuristics. These heuristics certainly have the advantage of speed and simplicity, but if they are well matched to a decision environment, they can even outperform maximizing calculations with respect to accuracy. The reason for this is that many decision environments are characterized by incomplete information and noise. The information we do have is usually structured in a specific way that clever heuristics can exploit." (E Ebenhoh, "Agent-Based Modelnig with Boundedly Rational Agents", 2007)

Jacques Monod - Collected Quotes

"There are living systems; there is no living 'matter'. No substance, no single molecule, extracted and isolated from a living being possess, of its own, the aforementioned paradoxical properties. They are present in living systems only; that is to say, nowhere below the level of the cell." (Jacques Monod, "From Biology to Ethics", 1969)

"A totally blind process can by definition lead to anything; it can even lead to vision itself." (Jacques Monod, "Chance and Necessity: An Essay on the Natural Philosophy of Modern Biology", 1970)

"Among all the occurrences possible in the universe the a priori probability of any particular one of them verges upon zero. Yet the universe exists; particular events must take place in it, the probability of which (before the event) was infinitesimal. At the present time we have no legitimate grounds for either asserting or denying that life got off to but a single start on earth, and that, as a consequence, before it appeared its chances of occurring were next to nil. [...] Destiny is written concurrently with the event, not prior to it." (Jacques Monod, "Chance and Necessity: An Essay on the Natural Philosophy of Modern Biology", 1970)

"Even today a good many distinguished minds seem unable to accept or even to understand that from a source of noise natural selection alone and unaided could have drawn all the music of the biosphere. In effect natural selection operates upon the products of chance and can feed nowhere else; but it operates in a domain of very demanding conditions, and from this domain chance is barred. It is not to chance but to these conditions that evolution owes its generally progressive course, its successive conquests, and the impression it gives of a smooth and steady unfolding." (Jacques Monod, "Chance and Necessity: An Essay on the Natural Philosophy of Modern Biology", 1970)

"Every living being is also a fossil. Within it, all the way down to the microscopic structure of its proteins, it bears the traces if not the stigmata of its ancestry." (Jacques Monod, "Chance and Necessity: An Essay on the Natural Philosophy of Modern Biology", 1970)

"Evolution in the biosphere is therefore a necessarily irreversible process defining a direction in time; a direction which is the same as that enjoined by the law of increasing entropy, that is to say, the second law of thermodynamics. This is far more than a mere comparison: the second law is founded upon considerations identical to those which establish the irreversibility of evolution. Indeed, it is legitimate to view the irreversibility of evolution as an expression of the second law in the biosphere." (Jacques Monod, "Chance and Necessity: An Essay on the Natural Philosophy of Modern Biology", 1970)

"A curious aspect of the theory of evolution is that everybody thinks he understands it." (Jacques Monod, "On the Molecular Theory of Evolution", 1974)

"One of the great problems of philosophy, is the relationship between the realm of knowledge and the realm of values. Knowledge is what is; values are what ought to be. I would say that all traditional philosophies up to and including Marxism have tried to derive the “ought” from the “is.” My point of view is that this is impossible, this is a farce." (Jacques Monod)

"The scientific attitude implies the postulate of objectivity - that is to say, the fundamental postulate that there is no plan; that there is no intention in the universe." (Jacques Monod)