On Randomness VIII (Events II)

"Our lives today are not conducted in linear terms. They are much more quantified; a stream of random events is taking place." (James G Ballard, [Conversation with George MacBeth on Third Programme - BBC], 1967)

"Events may appear to us to be random, but this could be attributed to human ignorance about the details of the processes involved." (Brain S Everitt, "Chance Rules", 1999)

"That randomness gives rise to innovation and diversity in nature is echoed by the notion that chance is also the source of invention in the arts and everyday affairs in which naturally occurring processes are balanced between tight organization, where redundancy is paramount, and volatility, in which little order is possible. One can argue that there is a difference in kind between the unconscious, and sometimes conscious, choices made by a writer or artist in creating a string of words or musical notes and the accidental succession of events taking place in the natural world. However, it is the perception of ambiguity in a string that matters, and not the process that generated it, whether it be man-made or from nature at large." (Edward Beltrami, "What is Random?: Chaos and Order in Mathematics and Life", 1999)

"The subject of probability begins by assuming that some mechanism of uncertainty is at work giving rise to what is called randomness, but it is not necessary to distinguish between chance that occurs because of some hidden order that may exist and chance that is the result of blind lawlessness. This mechanism, figuratively speaking, churns out a succession of events, each individually unpredictable, or it conspires to produce an unforeseeable outcome each time a large ensemble of possibilities is sampled."  (Edward Beltrami, "What is Random?: Chaos and Order in Mathematics and Life", 1999)

"Random events often come like the raisins in a box of cereal - in groups, streaks, and clusters. And although Fortune is fair in potentialities, she is not fair in outcomes." (Leonard Mlodinow, "The Drunkard’s Walk: How Randomness Rules Our Lives", 2008)

"The outline of our lives, like the candles flame, is continuously coaxed in new directions by a variety of random events that, along with our responses to them, determine our fate." (Leonard Mlodinow, "The Drunkard’s Walk: How Randomness Rules Our Lives", 2008)

"Why is the human need to be in control relevant to a discussion of random patterns? Because if events are random, we are not in control, and if we are in control of events, they are not random. There is therefore a fundamental clash between our need to feel we are in control and our ability to recognize randomness. That clash is one of the principal reasons we misinterpret random events."  (Leonard Mlodinow, "The Drunkard’s Walk: How Randomness Rules Our Lives", 2008)

"Quantum physicists today are reconciled to randomness at the individual event level, but to expect causality to underlie statistical quantum phenomena is reasonable. Suppose a person shakes an ink pen such that ink spots are formed on a white wall, in what appears for all intents and purposes, randomly. Let us further suppose the random ink spots accumulate to form precise pictures of different known persons' faces every time. We will not regard the overall result to be a happenchance; we are apt to suspect there must be a 'method' to the person who is shaking the ink pen." (Ravi Gomatam) [response to Nobel Laureate Steven Weinberg's article "Einstein's Mistakes", Physics Today Vol. 59 (4), 2005]

"We are hardwired to make sense of the world around us - to notice patterns and invent theories to explain these patterns. We underestimate how easily pat - terns can be created by inexplicable random events - by good luck and bad luck." (Gary Smith, "Standard Deviations", 2014)

On Randomness XI (Statistics)

"The postulate of randomness thus resolves itself into the question, 'of what population is this a random sample?' which must frequently be asked by every practical statistician." (Ronald Fisher, "On the Mathematical Foundation of Theoretical Statistics", Philosophical Transactions of the Royal Society of London Vol. A222, 1922)

"The definition of random in terms of a physical operation is notoriously without effect on the mathematical operations of statistical theory because so far as these mathematical operations are concerned random is purely and simply an undefined term." (Walter A Shewhart & W. Edwards "Deming, Statistical Method from the Viewpoint of Quality Control", 1939)

"The purely random sample is the only kind that can be examined with entire confidence by means of statistical theory, but there is one thing wrong with it. It is so difficult and expensive to obtain for many uses that sheer cost eliminates it." (Harold Hotelling, "How to Lie with Statistics", 1954)

"The point is that every experiment involves an error, the magnitude of which is not known beforehand and it varies from one experiment to another. For this reason, no matter what finite number of experiments have been carried out, the arithmetic mean of the values obtained will contain an error. Of course, if the experiments are conducted under identical conditions and the errors are random errors, then the error of the mean will diminish as the number of experiments is increased, but it cannot be reduced to zero for a finite number of experiments. […] The choice of entities for an experiment must be perfectly random, so that even an apparently inessential cause could not lead to erroneous conclusions." (Yakov Khurgin, "Did You Say Mathematics?", 1974)

"Statistics has been likened to a telescope. The latter enables one to see further and to make clear objects which were diminished or obscured by distance. The former enables one to discern structure and relationships which were distorted by other factors or obscured by random variation." (David J Hand, "The Role of Statistics in Psychiatry", Psychological Medicine Vol. 15, 1985)

"We will use the convenient expression 'chosen at random' to mean that the probabilities of the events in the sample space are all the same unless some modifying words are near to the words 'at random'. Usually we will compute the probability of the outcome based on the uniform probability model since that is very common in modeling simple situations. However, a uniform distribution does not imply that it comes from a random source; […]" (Richard W Hamming, "The Art of Probability for Scientists and Engineers", 1991)

"If you perceive the world as some place where things happen at random - random events over which you have sometimes very little control, sometimes fairly good control, but still random events - well, one has to be able to have some idea of how these things behave. […] People who are not used to statistics tend to see things in data - there are random fluctuations which can sometimes delude them - so you have to understand what can happen randomly and try to control whatever can be controlled. You have to expect that you are not going to get a clean-cut answer. So how do you interpret what you get? You do it by statistics." (Lucien LeCam, [interview] 1988)

"When looking at the end result of any statistical analysis, one must be very cautious not to over interpret the data. Care must be taken to know the size of the sample, and to be certain the method for gathering information is consistent with other samples gathered. […] No one should ever base conclusions without knowing the size of the sample and how random a sample it was. But all too often such data is not mentioned when the statistics are given - perhaps it is overlooked or even intentionally omitted." (Theoni Pappas, "More Joy of Mathematics: Exploring mathematical insights & concepts", 1994)

"We use mathematics and statistics to describe the diverse realms of randomness. From these descriptions, we attempt to glean insights into the workings of chance and to search for hidden causes. With such tools in hand, we seek patterns and relationships and propose predictions that help us make sense of the world." (Ivars Peterson, "The Jungles of Randomness: A Mathematical Safari", 1998)

"[In statistics] you have the fact that the concepts are not very clean. The idea of probability, of randomness, is not a clean mathematical idea. You cannot produce random numbers mathematically. They can only be produced by things like tossing dice or spinning a roulette wheel. With a formula, any formula, the number you get would be predictable and therefore not random. So as a statistician you have to rely on some conception of a world where things happen in some way at random, a conception which mathematicians don’t have." (Lucien LeCam, [interview] 1988)

"[...] in the statistical world, what we see and measure around us can be considered as the sum of a systematic mathematical idealized form plus some random contribution that cannot yet be explained. This is the classic idea of the signal and the noise." (David Spiegelhalter, "The Art of Statistics: Learning from Data", 2019)

"Too little attention is given to the need for statistical control, or to put it more pertinently, since statistical control (randomness) is so rarely found, too little attention is given to the interpretation of data that arise from conditions not in statistical control." (William E Deming)

Catastrophe Theory II

"What I am offering, is not a scientific theory, but a method; the first step in the construction of a model is to describe the dynamical models compatible with an empirically given morphology, and this is also the first step in understanding the phenomena under consideration. [...] We may hope that theoreticians will develop a quantitative model [for specific processes described by catastrophe theory ...] But this is only a hope." (René Thom, "Structural Stability and Morphogenesis", 1972)

"The catastrophe model is at the same time much less and much more than a scientific theory; one should consider it as a language, a method, which permits classification and systematization of given empirical data [...] In fact, any phenomenon at all can be explained by a suitable model from catastrophe theory." (René F Thom, 1973)

"First, nature's line patterns are not all of the same sort; the triple junctions generic in mud cracks cannot occur with caustics. Second, the geometrical optics of cylindrically symmetric artifacts such as telescopes, where departures from the ideal point focus are treated as 'aberrations', is very different from the geometrical optics of nature, where the generic forms of caustic surfaces are governed by the mathematics of catastrophe theory." Michael V Berry & John F Nye, "Fine Structure in Caustic Junctions", Nature Vol. 267 (3606), 1977)

"the claims made for the theory are greatly exaggerated and its accomplishments, at least in the biological and social sciences, are insignificant. [...] Catastrophe theory is one of many attempts that have been made to deduce the world by thought alone [...] an appealing dream for mathematicians, but a dream that cannot come true."  (Héctor J Sussmann & Raphael S Zahler, Nature, 1977)

"A catastrophe, in the very broad sense [René] Thom gives to the word, is any discontinuous transition that occurs when a system can have more than one stable state, or can follow more than one stable pathway of change. The catastrophe is the 'jump' from one state or pathway to another." (Alexander Woodcock & Monte Davis, "Catastrophe Theory", 1978)

"It is not enough to know the critical stress, that is, the quantitative breaking point of a complex design; one should also know as much as possible of the qualitative geometry of its failure modes, because what will happen beyond the critical stress level can be very different from one case to the next, depending on just which path the buckling takes. And here catastrophe theory, joined with bifurcation theory, can be very helpful by indicating how new failure modes appear." (Alexander Woodcock & Monte Davis, "Catastrophe Theory", 1978)

"The unfoldings are called catastrophes because each of them has regions where a dynamic system can jump suddenly from one state to another, although the factors controlling the process change continuously. Each of the seven catastrophes represents a pattern of behavior determined only by the number of control factors, not by their nature or by the interior mechanisms that connect them to the system's behavior. Therefore, the elementary catastrophes can be models for a wide variety of processes, even those in which we know little about the quantitative laws involved." (Alexander Woodcock & Monte Davis, "Catastrophe Theory", 1978)

"Two assumptions are needed to apply catastrophe theory as it now stands: first, that the system described be governed by a potential, and second, that its behavior depend on a limited number of control factors. Without these assumptions, the classification of the elementary catastrophes is impossible." (Alexander Woodcock & Monte Davis, "Catastrophe Theory", 1978)

"It is more a philosophy than mathematics, and even as a philosophy it doesn't explain the real world [...] as mathematics, it brings together two of the most basic ideas in modern math: the study of dynamic systems and the study of the singularities of maps. Together, they cover a very wide area - but catastrophe theory brings them together in an arbitrary and constrained way." (Steven Smale)

"While it must be granted that a number of immoderate claims in the form of 'catastrophe theory can do everything' have been made in the literature, on the basis of too little experience, it doesn't seem that the proper response is an equally immoderate claim that 'catastrophe theory can do nothing' on the basis of that same body of experience." (Robert Rosen)

On Economics I (Models I)

"Economics is a science of thinking in terms of models joined to the art of choosing models which are relevant to the contemporary world. It is compelled to be this, because, unlike the typical natural science, the material to which it is applied is, in too many respects, not homogeneous through time. The object of a model is to segregate the semi-permanent or relatively constant factors from those which are transitory or fluctuating so as to develop a logical way of thinking about the latter, and of understanding the time sequences to which they give rise in particular cases." (John M Keynes, [letter to Roy Harrod] 1938)

"The striking parallel between the economic models that are currently under discussion and some engineering systems suggests the hope that in some way the rapid progress in the development of the theory and practice of automatic control in the world of engineering may contribute to the solution of the economic problems." (Arnold Tustin "The Mechanism of Economic Systems", 1953) 

"The construction of an economic model, or of any model or theory for that matter (or the writing of a novel, a short story, or a play) consists of snatching from the enormous and complex mass of facts called reality, a few simple, easily-managed key points which, when put together in some cunning way, become for certain purposes a substitute for reality itself." (Evsey Domar, "Essays in the Theory of Economic Growth", 1957)

"One of the most important skills of the economist, therefore, is that of simplification of the model." (Kenneth Boulding, "The Skills of the Economist", Journal of Political Economy 67 (1), 1959)

"In many parts of the economy, stabilizing forces appear not to operate. Instead, positive feedback magnifies the effects of small economic shifts; the economic models that describe such effects differ vastly from the conventional ones. Diminishing returns imply a single equilibrium point for the economy, but positive feedback - increasing returns - makes for many possible equilibrium points. There is no guarantee that the particular economic outcome selected from among the many alternatives will be the 'best' one." (W Brian Arthur, "Increasing Returns and Path Dependence in the Economy", 1994)

"What is a mathematical model? One basic answer is that it is the formulation in mathematical terms of the assumptions and their consequences believed to underlie a particular ‘real world’ problem. The aim of mathematical modeling is the practical application of mathematics to help unravel the underlying mechanisms involved in, for example, economic, physical, biological, or other systems and processes." (John A Adam, "Mathematics in Nature", 2003)

"The long term solution to the financial crisis is to move beyond the ‘growth at all costs’ economic model to a model that recognizes the real costs and benefits of growth." (Robert Costanza, "Toward a New Sustainable Economy", 2008)

"Real economic efficiency implies including all resources that affect sustainable human well-being in the allocation system, not just marketed goods and services. Our current market allocation system excludes most non-marketed natural and social capital assets and services that are critical contributors to human well-being. The current economic model ignores this and therefore does not achieve real economic efficiency. A new, sustainable ecological economic model would measure and include the contributions of natural and social capital and could better approximate real economic efficiency." (Robert Costanza, "Toward a New Sustainable Economy", 2008)

"Economists also use models to learn about the world, but instead of being made of plastic, they are most often composed of diagrams and equations. Like a biology teacher’s plastic model, economic models omit many details to allow us to see what is truly important. Just as the biology teacher’s model does not include all the body’s muscles and capillaries, an economist’s model does not include every feature of the economy." (N Gregory Mankiw, "Principle of Economics" 6th ed., 2012)

"Many of the stories economists tell take the form of models - for whatever else they are, economic models are stories about how the world works." (Paul Krugman & Robin Wells, "Economics" 3rd Ed., 2013)

On Randomness VII (Events I)

"The very events which in their own nature appear most capricious and uncertain, and which in any individual case no attainable degree of knowledge would enable us to foresee, occur, when considerable numbers are taken into account, with a degree of regularity approaching to mathematical." (John S Mills, "A System of Logic", 1862)

"To every event defined for the original random walk there corresponds an event of equal probability in the dual random walk, and in this way almost every probability relation has its dual." (William Feller, "An Introduction To Probability Theory And Its Applications", 1950)

"Perhaps randomness is not merely an adequate description for complex causes that we cannot specify. Perhaps the world really works this way, and many events are uncaused in any conventional sense of the word." (Stephen J Gould, "Hen's Teeth and Horse's Toes", 1983).

"If you perceive the world as some place where things happen at random - random events over which you have sometimes very little control, sometimes fairly good control, but still random events - well, one has to be able to have some idea of how these things behave. […] People who are not used to statistics tend to see things in data - there are random fluctuations which can sometimes delude them - so you have to understand what can happen randomly and try to control whatever can be controlled. You have to expect that you are not going to get a clean-cut answer. So how do you interpret what you get? You do it by statistics." (Lucien LeCam, [interview] 1988)

"Randomness is the very stuff of life, looming large in our everyday experience. […] The fascination of randomness is that it is pervasive, providing the surprising coincidences, bizarre luck, and unexpected twists that color our perception of everyday events." (Edward Beltrami, "What is Random?: Chaos and Order in Mathematics and Life", 1999)

"The subject of probability begins by assuming that some mechanism of uncertainty is at work giving rise to what is called randomness, but it is not necessary to distinguish between chance that occurs because of some hidden order that may exist and chance that is the result of blind lawlessness. This mechanism, figuratively speaking, churns out a succession of events, each individually unpredictable, or it conspires to produce an unforeseeable outcome each time a large ensemble of possibilities is sampled."  (Edward Beltrami, "Chaos and Order in Mathematics and Life", 1999)

"Randomness is a difficult notion for people to accept. When events come in clusters and streaks, people look for explanations and patterns. They refuse to believe that such patterns - which frequently occur in random data - could equally well be derived from tossing a coin. So it is in the stock market as well." (Didier Sornette, "Why Stock Markets Crash: Critical events in complex financial systems", 2003)

"[…] we would like to observe that the butterfly effect lies at the root of many events which we call random. The final result of throwing a dice depends on the position of the hand throwing it, on the air resistance, on the base that the die falls on, and on many other factors. The result appears random because we are not able to take into account all of these factors with sufficient accuracy. Even the tiniest bump on the table and the most imperceptible move of the wrist affect the position in which the die finally lands. It would be reasonable to assume that chaos lies at the root of all random phenomena." (Iwo Białynicki-Birula & Iwona Białynicka-Birula, "Modeling Reality: How Computers Mirror Life", 2004)

"A Black Swan is a highly improbable event with three principal characteristics: It is unpredictable; it carries a massive impact; and, after the fact, we concoct an explanation that makes it appear less random, and more predictable, than it was. […] The Black Swan idea is based on the structure of randomness in empirical reality. [...] the Black Swan is what we leave out of simplification." (Nassim N Taleb, "The Black Swan", 2007)

"Regression toward the mean. That is, in any series of random events an extraordinary event is most likely to be followed, due purely to chance, by a more ordinary one." (Leonard Mlodinow, "The Drunkard’s Walk: How Randomness Rules Our Lives", 2008)

On Engineering VII (Systems Engineering II)

"The term 'systems engineering' is a term with an air of romance and of mystery. The romance and the mystery come from its use in the field of guided missiles, rockets, artificial satellites, and space flight. Much of the work being done in these areas is classified and hence much of it is not known to the general public or to this writer. […] From a business point of view, systems engineering is the creation of a deliberate combination of human services, material services, and machine service to accomplish an information processing job. But this is also very nearly a definition of business system analysis. The difference, from a business point of view, therefore, between business system analysis and systems engineering is only one of degree. In general, systems engineering is more total and more goal-oriented in its approach [...]." ("Computers and People" Vol. 5, 1956)

"By some definitions 'systems engineering' is suggested to be a new discovery. Actually it is a common engineering approach which has taken on a new and important meaning because of the greater complexity and scope of problems to be solved in industry, business, and the military. Newly discovered scientific phenomena, new machines and equipment, greater speed of communications, increased production capacity, the demand for control over ever-extending areas under constantly changing conditions, and the resultant complex interactions, all have created a tremendously accelerating need for improved systems engineering. Systems engineering can be complex, but is simply defined as 'logical engineering within physical, economic and technical limits'  - bridging the gap from fundamental laws to a practical operating system." (Instrumentation Technology, 1957)

"Systems engineering embraces every scientific and technical concept known, including economics, management, operations, maintenance, etc. It is the job of integrating an entire problem or problem to arrive at one overall answer, and the breaking down of this answer into defined units which are selected to function compatibly to achieve the specified objectives. [...] Instrument and control engineering is but one aspect of systems engineering - a vitally important and highly publicized aspect, because the ability to create automatic controls within overall systems has made it possible to achieve objectives never before attainable, While automatic controls are vital to systems which are to be controlled, every aspect of a system is essential. Systems engineering is unbiased, it demands only what is logically required. Control engineers have been the leaders in pulling together a systems approach in the various technologies." (Instrumentation Technology, 1957) 

"Systems engineering is more likely to be closely associated with top management of an enterprise than the engineering of the components of the system. If an engineering task is large and complex enough, the arrangement-making problem is especially difficult. Commonly, in a large job, the first and foremost problem for the systems engineers is to relate the objectives to the technical art. [...] Systems engineering is a highly technical pursuit and if a nontechnical man attempts to direct the systems engineering as such, it must end up in a waste of technical talent below." (Aeronautical Engineering Review Vol. 16, 1957) 

"Systems engineering is the name given to engineering activity which considers the overall behavior of a system, or more generally which considers all factors bearing on a problem, and the systems approach to control engineering problems is correspondingly that approach which examines the total dynamic behavior of an integrated system. It is concerned more with quality of performance than with sizes, capacities, or efficiencies, although in the most general sense systems engineering is concerned with overall, comprehensive appraisal." (Ernest F Johnson, "Automatic process control", 1958)

"There are two types of systems engineering - basis and applied. [...] Systems engineering is, obviously, the engineering of a system. It usually, but not always, includes dynamic analysis, mathematical models, simulation, linear programming, data logging, computing, optimating, etc., etc. It connotes an optimum method, realized by modern engineering techniques. Basic systems engineering includes not only the control system but also all equipment within the system, including all host equipment for the control system. Applications engineering is - and always has been - all the engineering required to apply the hardware of a hardware manufacturer to the needs of the customer. Such applications engineering may include, and always has included where needed, dynamic analysis, mathematical models, simulation, linear programming, data logging, computing, and any technique needed to meet the end purpose - the fitting of an existing line of production hardware to a customer's needs. This is applied systems engineering." (Instruments and Control Systems Vol. 31, 1958)

"Systems Engineering Methods is directed towards the development of a broad systems engineering approach to help such people improve their decision-making capability. Although the emphasis is on engineering, the systems approach can also has validity for many other areas in which emphasis may be social, economic, or political." (Harold Chestnut, "Systems Engineering Methods", 1965) 

"Systems Engineering is the science of designing complex systems in their totality to ensure that the component sub-systems making up the system are designed, fitted together, checked and operated in the most efficient way." (Gwilym Jenkins, "The Systems Approach", 1969) 

"System engineering is a robust approach to the design, creation, and operation of systems. In simple terms, the approach consists of identification and quantification of system goals, creation of alternative system design concepts, performance of design trades, selection and implementation of the best design, verification that the design is properly built and integrated, and post-implementation assessment of how well the system meets (or met) the goals." (NASA, "NASA Systems Engineering Handbook", 1995) 

"Systems engineering should be, first and foremost, a state of mind and an attitude taken when dealing with complexity." (Dominique Luzeaux et al, "Complex Systems and Systems of Systems Engineering", 2013) 

On Symbols (1960-1969)

"By a symbol I do not mean an allegory or a sign, but an image that describes in the best possible way the dimly discerned nature of the spirit. A symbol does not define or explain; it points beyond itself to a meaning that is darkly divined yet still beyond our grasp, and cannot be adequately expressed in the familiar words of our language." (Carl G Jung, "The Structure And Dynamics Of The Psyche", 1960)

"Language, in its origin and essence, is simply a system of signs or symbols that denote real occurrences or their echo in the human soul." (Carl G Jung, "The Structure And Dynamics Of The Psyche", 1960)

"Cybernetics is concerned primarily with the construction of theories and models in science, without making a hard and fast distinction between the physical and the biological sciences. The theories and models occur both in symbols and in hardware, and by 'hardware’ we shall mean a machine or computer built in terms of physical or chemical, or indeed any handleable parts." (Frank H George, "The Brain As A Computer", 1962)

"Science is the reduction of the bewildering diversity of unique events to manageable uniformity within one of a number of symbol systems, and technology is the art of using these symbol systems so as to control and organize unique events. Scientific observation is always a viewing of things through the refracting medium of a symbol system, and technological praxis is always handling of things in ways that some symbol system has dictated. Education in science and technology is essentially education on the symbol level." (Aldous L Huxley, "Essay", Daedalus, 1962)

"For Science in its totality, the ultimate goal is the creation of a monistic system in which - on the symbolic level and in terms of the inferred components of invisibility and intangibly fine structure - the world’s enormous multiplicity is reduced to something like unity, and the endless successions of unique events of a great many different kinds get tidied and simplified into a single rational order. Whether this goal will ever be reached remains to be seen. Meanwhile we have the various sciences, each with its own system coordinating concepts, its own criterion of explanation." (Aldous Huxley, "Literature and Science", 1963)

"It is always extremely difficult to express thoughts. Words and phrases are so many fretters by which our spirit is bound. Words are mere symbols of reality, and the written word is not more than a one-dimensional fl ow across the two-dimensional page of a three-dimensional book." (Charles-Noël Martin, "The Role of Perception in Science", 1963)

"The aim of science is to apprehend this purely intelligible world as a thing in itself, an object which is what it is independently of all thinking, and thus antithetical to the sensible world. [...] The world of thought is the universal, the timeless and spaceless, the absolutely necessary, whereas the world of sense is the contingent, the changing and moving appearance which somehow indicates or symbolizes it." (Robin G Collingwood, "Essays in the Philosophy of Art", 1964)

"This language controls by reducing the linguistic forms and symbols of reflection, abstraction, development, contradiction; by substituting images for concepts. It denies or absorbs the transcendent vocabulary; it does not search for but establishes and imposes truth and falsehood." (Herbert Marcuse, "One-Dimensional Man", 1964)

"Thus a word or an image is symbolic when it implies something more than its obvious and immediate meaning. It has a wider ‘unconscious’ aspect that is never precisely defined or fully explained. […] As the mind explores the symbols it is led to ideas that lie beyond the grasp of reason." (Carl G Jung, "Man and His Symbols", 1964)

"[…] it took men about five thousand years, counting from the beginning of number symbols, to think of a symbol for nothing." (Isaac Asimov, "Of Time and Space and Other Things" , 1965)

"Specific procedures of universe-maintenance become necessary when the symbolic universe has become a problem. As long as this is not the case, the symbolic universe is self-maintaining, that is, self-legitimating by the sheer facticity of its objective existence in the society in question." (Peter L Berger, "The Social Construction of Reality", 1966) 

"There is nothing that can be said by mathematical symbols and relations which cannot also be said by words. The converse, however, is false. Much that can be and is said by words cannot successfully be put into equations, because it is nonsense." (Clifford A Truesdell, "Six Lectures on Modern Natural Philosophy", 1966)

"The symbol is the tool which gives man his power, and it is the same tool whether the symbols are images or words, mathematical signs or mesons." (Jacob Bronowski, "The Reach of Imagination", 1967)

"Symbolic interactionism rests [...] on three simple premises. The first premise is that human beings act toward things on the basis of the meanings that the things have for them. [...] The second premise is that the meaning of such things is derived from, or arises out of, the social interaction that one has with one's fellows. The third premise is that these meanings are handled in, and modified through, an interpretative process used by the person in dealing with the things he encounters." (Herbert Blumer, "Symbolic Interactionism", 1969)

Chaos Theory I

"The chaos theory will require scientists in all fields to, develop sophisticated mathematical skills, so that they will be able to better recognize the meanings of results. Mathematics has expanded the field of fractals to help describe and explain the shapeless, asymmetrical find randomness of the natural environment." (Theoni Pappas, "More Joy of Mathematics: Exploring mathematical insights & concepts", 1991)

"The term chaos is also used in a general sense to describe the body of chaos theory, the complete sequence of behaviours generated by feed-back rules, the properties of those rules and that behaviour." (Ralph D Stacey, "The Chaos Frontier: Creative Strategic Control for Business", 1991)

"Chaos theory reconciles our intuitive sense of free will with the deterministic laws of nature. However, it has an even deeper philosophical ramification. Not only do we have freedom to control our actions, but also the sensitivity to initial conditions implies that even our smallest act can drastically alter the course of history, for better or for worse. Like the butterfly flapping its wings, the results of our behavior are amplified with each day that passes, eventually producing a completely different world than would have existed in our absence!" (Julien C Sprott, "Strange Attractors: Creating Patterns in Chaos", 2000)

"Chaos theory, for example, uses the metaphor of the ‘butterfly effect’. At critical times in the formation of Earth’s weather, even the fluttering of the wings of a butterfly sends ripples that can tip the balance of forces and set off a powerful storm. Even the smallest inanimate objects sent back into the past will inevitably change the past in unpredictable ways, resulting in a time paradox." (Michio Kaku, "Parallel Worlds", 2004)

"This phenomenon, common to chaos theory, is also known as sensitive dependence on initial conditions. Just a small change in the initial conditions can drastically change the long-term behavior of a system. Such a small amount of difference in a measurement might be considered experimental noise, background noise, or an inaccuracy of the equipment." (Greg Rae, "Chaos Theory: A Brief Introduction", 2006)

"Yet, with the discovery of the butterfly effect in chaos theory, it is now understood that there is some emergent order over time even in weather occurrence, so that weather prediction is not next to being impossible as was once thought, although the science of meteorology is far from the state of perfection." (Peter Baofu, "The Future of Complexity: Conceiving a Better Way to Understand Order and Chaos", 2007)

"[chaos theory] presents a universe that is at once deterministic and obeys the fundamental physical laws, but is capable of disorder, complexity, and unpredictability. It shows that predictability is a rare phenomenon operating only within the constraints that science has filtered out from the rich diversity of our complex world." (Ziauddin Sardar & Iwona Abrams, "Introducing Chaos: A Graphic Guide", 2008)

"Complexity theory can be defined broadly as the study of how order, structure, pattern, and novelty arise from extremely complicated, apparently chaotic systems and conversely, how complex behavior and structure emerges from simple underlying rules. As such, it includes those other areas of study that are collectively known as chaos theory, and nonlinear dynamical theory." (Terry Cooke-Davies et al, "Exploring the Complexity of Projects", 2009)

"An ending is an artificial device; we like endings, they are satisfying, convenient, and a point has been made. But time does does not end, and stories march in step with time. Equally, chaos theory does not assume an ending; the ripple effect goes on, and on." (Penelope Lively, "How It All Began", 2011)

"The things that really change the world, according to Chaos theory, are the tiny things. A butterfly flaps its wings in the Amazonian jungle, and subsequently a storm ravages half of Europe." (Neil Gaiman, "Good Omens", 2011)

Kevin Kelly - Collected Quotes

"A network nurtures small failures in order that large failures don't happen as often." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"An event is not triggered by a chain of being, but by a field of causes spreading horizontally, like creeping tide." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"And in computer life, where the term 'species' does not yet have meaning, we see no cascading emergence of entirely new kinds of variety beyond an initial burst. In the wild, in breeding, and in artificial life, we see the emergence of variation. But by the absence of greater change, we also clearly see that the limits of variation appear to be narrowly bounded, and often bounded within species." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"Artificial complex systems will be deliberately infused with organic principles simply to keep them going." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"At the other far extreme, we find many systems ordered as a patchwork of parallel operations, very much as in the neural network of a brain or in a colony of ants. Action in these systems proceeds in a messy cascade of interdependent events. Instead of the discrete ticks of cause and effect that run a clock, a thousand clock springs try to simultaneously run a parallel system. Since there is no chain of command, the particular action of any single spring diffuses into the whole, making it easier for the sum of the whole to overwhelm the parts of the whole. What emerges from the collective is not a series of critical individual actions but a multitude of simultaneous actions whose collective pattern is far more important. This is the swarm model." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"Complexity must be grown from simple systems that already work." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"Dumb parts, properly constituted into a swarm, yield smart results." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"Evolution is a technological, mathematical, informational, and biological process rolled into one. It could almost be said to be a law of physics, a principle that reigns over all created multitudes, whether they have genes or not." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"I take the view that life is a nonspiritual, almost mathematical property that can emerge from networklike arrangements of matter. It is sort of like the laws of probability; if you get enough components together, the system will behave like this, because the law of averages dictates so. Life results when anything is organized according to laws only now being uncovered; it follows rules as strict as those that light obeys." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"If machines knew as much about each other as we know about each other (even in our privacy), the ecology of machines would be indomitable." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"If the system settles into harmony and equilibrium it will eventually stagnate and die."(Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995) 

"Inconsistency is an inevitable trait of any self-sustaining system built up out of consistent parts."  (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"It has long been appreciated by science that large numbers behave differently than small numbers. Mobs breed a requisite measure of complexity for emergent entities. The total number of possible interactions between two or more members accumulates exponentially as the number of members increases. At a high level of connectivity, and a high number of members, the dynamics of mobs takes hold. " (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"It is the great irony of life that a mindless act repeated in sequence can only lead to greater depths of absurdity, while a mindless act performed in parallel by a swarm of individuals can, under the proper conditions, lead to all that we find interesting." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995) 

"Knowledge, truth, and information flow in networks and swarm systems. I have always been interested in the texture of scientific knowledge because it appears to be lumpy and uneven. Much of what we collectively know derives from a few small areas, yet between them lie vast deserts of ignorance. I can interpret that observation now as the effect of positive feedback and attractors. A little bit of knowledge illuminates much around it, and that new illumination feeds on itself, so one corner explodes. The reverse also holds true: ignorance breeds ignorance. Areas where nothing is known, everyone avoids, so nothing is discovered. The result is an uneven landscape of empty know-nothing interrupted by hills of self-organized knowledge." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995) 

"Memory is a reenactment of perception, indistinguishable from the original act of knowing."  (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"The central act of the coming era is to connect everything to everything." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"The hardest lesson for humans to learn: that organic complexity will entail organic time." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"The only organization capable of unprejudiced growth, or unguided learning, is a network. All other topologies limit what can happen." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"The slightly chaotic character of mind goes even deeper, to a degree our egos may find uncomfortable. It is very likely that intelligence, at bottom, is a probabilistic or statistical phenomenon - on par with the law of averages. The distributed mass of ricocheting impulses which form the foundation of intelligence forbid deterministic results for a given starting point. Instead of repeatable results, outcomes are merely probabilistic. Arriving at a particular thought, then, entails a bit of luck." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"The work of managing a natural environment is inescapably a work of local knowledge." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995) 

"The world of our own making has become so complicated that we must turn to the world of the born to understand how to manage it." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"There are a variety of swarm topologies, but the only organization that holds a genuine plurality of shapes is the grand mesh. In fact, a plurality of truly divergent components can only remain coherent in a network. No other arrangement-chain, pyramid, tree, circle, hub-can contain true diversity working as a whole. This is why the network is nearly synonymous with democracy or the market." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"To err is human; to manage error is system." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"When everything is connected to everything in a distributed network, everything happens at once. When everything happens at once, wide and fast moving problems simply route around any central authority. Therefore overall governance must arise from the most humble interdependent acts done locally in parallel, and not from a central command.A mob can steer itself, and in the territory of rapid, massive, and heterogeneous change, only a mob can steer. To get something from nothing, control must rest at the bottom within simplicity. " (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"Without some element of governance from the top, bottom-up control will freeze when options are many. Without some element of leadership, the many at the bottom will be paralysed with choices." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"A standalone object, no matter how well designed, has limited potential for new weirdness. A connected object, one that is a node in a network that interacts in some way with other nodes, can give birth to a hundred unique relationships that it never could do while unconnected. Out of this tangle of possible links come myriad new niches for innovations and interactions." (Kevin Kelly, "New Rules for the New Economy: 10 radical strategies for a connected world", 1998)

"Any network has two ingredients: nodes and connections. In the grand network we are now assembling, the size of the nodes is collapsing while the quantity and quality of the connections are exploding." (Kevin Kelly, "New Rules for the New Economy: 10 radical strategies for a connected world", 1998)

"At present, there is far more to be gained by pushing the boundaries of what can be done by the bottom than by focusing on what can be done at the top. When it comes to control, there is plenty of room at the bottom. What we are discovering is that peer-based networks with millions of parts, minimal oversight, and maximum connection among them can do far more than anyone ever expected. We don’t yet know what the limits of decentralization are." (Kevin Kelly, "New Rules for the New Economy: 10 radical strategies for a connected world", 1998)

"Arriving at standards is often easier said than done. Standard-making is a torturous, bickering process every time. And the end result is universally condemned - since it is the child of compromise. But for a standard to be effective, its adoption must be voluntary. There must be room to dissent by pursuing alternative standards at any time." (Kevin Kelly, "New Rules for the New Economy: 10 radical strategies for a connected world", 1998)

"Mathematics says the sum value of a network increases as the square of the number of members. In other words, as the number of nodes in a network increases arithmetically, the value of the network increases exponentially. Adding a few more members can dramatically increase the value for all members." (Kevin Kelly, "New Rules for the New Economy: 10 radical strategies for a connected world", 1998)

"Networks have existed in every economy. What’s different now is that networks, enhanced and multiplied by technology, penetrate our lives so deeply that 'network' has become the central metaphor around which our thinking and our economy are organized. Unless we can understand the distinctive logic of networks, we can’t profit from the economic transformation now under way." (Kevin Kelly, "New Rules for the New Economy: 10 radical strategies for a connected world", 1998)

"The combinatorial mathematics of networks also boost the opportunities for intermediaries. By definition, every node on a network is a node between other nodes. The more connections there are between members in a net, the more intermediary nodes there can be. Everything in a network is intermediating something else." (Kevin Kelly, "New Rules for the New Economy: 10 radical strategies for a connected world", 1998)

"The distinguishing characteristic of networks is that they contain no clear center and no clear outside boundaries. Within a network everything is potentially equidistant from everything else." (Kevin Kelly, "New Rules for the New Economy: 10 radical strategies for a connected world", 1998)

"The dynamic of our society, and particularly our new economy, will increasingly obey the logic of networks. Understanding how networks work will be the key to understanding how the economy works." (Kevin Kelly, "New Rules for the New Economy: 10 radical strategies for a connected world", 1998)

"The internet model has many lessons for the new economy but perhaps the most important is its embrace of dumb swarm power. The aim of swarm power is superior performance in a turbulent environment. When things happen fast and furious, they tend to route around central control. By interlinking many simple parts into a loose confederation, control devolves from the center to the lowest or outermost points, which collectively keep things on course. A successful system, though, requires more than simply relinquishing control completely to the networked mob." (Kevin Kelly, "New Rules for the New Economy: 10 radical strategies for a connected world", 1998)

"The more interconnected a technology is, the more opportunities it spawns for both use and misuse. [… The law of plentitude is most accurately rendered thus: In a network, the more opportunities that are taken, the faster new opportunities arise." (Kevin Kelly, "New Rules for the New Economy: 10 radical strategies for a connected world", 1998)

"We are connecting everything to everything. […] When we permit any object to transmit a small amount of data and to receive input from its neighborhood, we change an inert object into an animated node." (Kevin Kelly, "New Rules for the New Economy: 10 radical strategies for a connected world", 1998)

"Without some element of governance from the top, bottom-up control will freeze when options are many. Without some element of leadership, the many at the bottom will be paralyzed with choices." (Kevin Kelly, "New Rules for the New Economy: 10 radical strategies for a connected world", 1998)

"But nature can’t plan ahead. It does not hoard innovations for later use. If a variation in nature does not provide an immediate survival advantage, it is too costly to maintain and so over time it disappears." (Kevin Kelly, "What Technology Wants", 2010)

"Entropy is the crisp scientific name for waste, chaos, and disorder. As far as we know, the sole law of physics with no known exceptions anywhere in the universe is this: All creation is headed to the basement. Everything in the universe is steadily sliding down the slope toward the supreme equality of wasted heat and maximum entropy." (Kevin Kelly, "What Technology Wants", 2010)

"In the telephone system a century ago, messages dispersed across the network in a pattern that mathematicians associate with randomness. But in the last decade, the flow of bits has become statistically more similar to the patterns found in self-organized systems. For one thing, the global network exhibits self-similarity, also known as a fractal pattern. We see this kind of fractal pattern in the way the jagged outline of tree branches look similar no matter whether we look at them up close or far away. Today messages disperse through the global telecommunications system in the fractal pattern of self-organization." (Kevin Kelly, "What Technology Wants", 2010)

"Language accelerates learning and creation by permitting communication and coordination. A new idea can be spread quickly if someone can explain it and communicate it to others before they have to discover it themselves. But the chief advantage of language is not communication but autogeneration. Language is a trick that allows the mind to question itself; a magic mirror that reveals to the mind what the mind thinks; a handle that turns a mind into a tool." (Kevin Kelly, "What Technology Wants", 2010)

"The evolution of science and technology parallels the evolution of nature. The major technological transitions are also passages from one level of organization to another."(Kevin Kelly, "What Technology Wants", 2010) 

On Cybernetics (2000-2009)

"An opportunity for cybernetics to change the course of the philosophy of mind was missed when intentionality was misinterpreted as 'the providing of coded knowledge'." (Igor Aleksander, New Scientist Vol. 169, 2001)

"Probably the first clear insight into the deep nature of control […] was that it is not about pulling levers to produce intended and inexorable results. This notion of control applies only to trivial machines. It never applies to a total system that includes any kind of probabilistic element - from the weather, to people; from markets, to the political economy. No: the characteristic of a non-trivial system that is under control, is that despite dealing with variables too many to count, too uncertain to express, and too difficult even to understand, something can be done to generate a predictable goal. Wiener found just the word he wanted in the operation of the long ships of ancient Greece. At sea, the long ships battled with rain, wind and tides - matters in no way predictable. However, if the man operating the rudder kept his eye on a distant lighthouse, he could manipulate the tiller, adjusting continuously in real-time towards the light. This is the function of steersmanship. As far back as Homer, the Greek word for steersman was kubernetes, which transliterates into English as cybernetes." (Stafford Beer, "What is cybernetics?", Kybernetes, 2002) 

“The shocking thing is that there is truth in every one of these notions, and the reason is because cybernetics is an interdisciplinary subject. It must be complicated." (Stafford Beer, "What is cybernetics?", Kybernetes, 2002)

"The science of cybernetics is not about thermostats or machines; that characterization is a caricature. Cybernetics is about purposiveness, goals, information flows, decision-making control processes and feedback (properly defined) at all levels of living systems." (Peter Corning, "Synergy, Cybernetics, and the Evolution of Politics", 2005) 

"The single most important property of a cybernetic system is that it is controlled by the relationship between endogenous goals and the external environment. [...] In a complex system, overarching goals may be maintained (or attained) by means of an array of hierarchically organized subgoals that may be pursued contemporaneously, cyclically, or seriatim." (Peter Corning, "Synergy, Cybernetics, and the Evolution of Politics", 2005) 

"A great deal of the results in many areas of physics are presented in the form of conservation laws, stating that some quantities do not change during evolution of the system. However, the formulations in cybernetical physics are different. Since the results in cybernetical physics establish how the evolution of the system can be changed by control, they should be formulated as transformation laws, specifying the classes of changes in the evolution of the system attainable by control function from the given class, i.e., specifying the limits of control." (Alexander L Fradkov, "Cybernetical Physics: From Control of Chaos to Quantum Control", 2007)

"Cybernetics is the study of systems and processes that interact with themselves and produce themselves from themselves." (Louis Kauffman, 2007)

"Systematic usage of the methods of modern control theory to study physical systems is a key feature of a new research area in physics that may be called cybernetical physics. The subject of cybernetical physics is focused on studying physical systems by means of feedback interactions with the environment. Its methodology heavily relies on the design methods developed in cybernetics. However, the approach of cybernetical physics differs from the conventional use of feedback in control applications (e.g., robotics, mechatronics) aimed mainly at driving a system to a prespecified position or a given trajectory." (Alexander L Fradkov, "Cybernetical Physics: From Control of Chaos to Quantum Control", 2007)

"The methodology of feedback design is borrowed from cybernetics (control theory). It is based upon methods of controlled system model’s building, methods of system states and parameters estimation (identification), and methods of feedback synthesis. The models of controlled system used in cybernetics differ from conventional models of physics and mechanics in that they have explicitly specified inputs and outputs. Unlike conventional physics results, often formulated as conservation laws, the results of cybernetical physics are formulated in the form of transformation laws, establishing the possibilities and limits of changing properties of a physical system by means of control." (Alexander L Fradkov, "Cybernetical Physics: From Control of Chaos to Quantum Control", 2007)

"For me, as I later came to say, cybernetics is the art of creating equilibrium in a world of possibilities and constraints. This is not just a romantic description, it portrays the new way of thinking quite accurately. Cybernetics differs from the traditional scientific procedure, because it does not try to explain phenomena by searching for their causes, but rather by specifying the constraints that determine the direction of their development." (Ernst von Glasersfeld, "The Cybernetics of Snow Drifts 1948", 2009)

"[…] in cybernetics, control is seen not as a function of one agent over something else, but as residing within circular causal networks, maintaining stabilities in a system. Circularities have no beginning, no end and no asymmetries. The control metaphor of communication, by contrast, punctuates this circularity unevenly. It privileges the conceptions and actions of a designated controller by distinguishing between messages sent in order to cause desired effects and feedback that informs the controller of successes or failures." (Klaus Krippendorff, "On Communicating: Otherness, Meaning, and Information", 2009)