Karl Menger - Collected Quotes

"Mathematicians study their problems on account of their intrinsic interest, and develop their theories on account of their beauty." (Karl Menger, The Scientific Monthly, 1937)

"We could compare mathematics so formalized to a game of chess in which the symbols correspond to the chessmen; the formulae, to definite positions of the men on the board; the axioms, to the initial positions of the chessmen; the directions for drawing conclusions, to the rules of movement; a proof, to a series of moves which leads from the initial position to a definite configuration of the men." (Friedrich Waismann & Karl Menger, "Introduction to Mathematical Thinking: The Formation of Concepts in Modern Mathematics", 1951)

"In the mathematical theory of the maximum and minimum problems in calculus of variations, different methods are employed. The old classical method consists in finding criteria -as to whether or not for a given curve the corresponding number assumes a maximum or minimum. In order to find such criteria a considered curve is a little varied, and it is from this method that the name 'calculus of variations' for the whole branch of mathematics is derived." (Karl Menger, "What Is Calculus of Variations and What Are Its Applications?" [James R Newman, "The World of Mathematics" Vol. II], 1956)

"Mathematicians study their problems on account of their intrinsic interest, and develop their theories on account of their beauty. History shows that some of these mathematical theories which were developed without any chance of immediate use later on found very important applications." (Karl Menger, "What Is Calculus of Variations and What Are Its Applications?" [James R Newman, "The World of Mathematics" Vol. II], 1956)

"We frequently find that nature acts in such a way as to minimize certain magnitudes. The soap film will take the shape of a surface of smallest area. Light always follows the shortest path, that is, the straight line, and, even when reflected or broken, follows a path which takes a minimum of time. In mechanical systems we find that the movements actually take place in a form which requires less effort in a certain sense than any other possible movement would use. There was a period, about 150 years ago, when physicists believed that the whole of physics might be deduced from certain minimizing principles, subject to calculus of variations, and these principles were interpreted as tendencies--so to say, economical tendencies of nature. Nature seems to follow the tendency of economizing certain magnitudes, of obtaining maximum effects with given means, or to spend minimal means for given effects." (Karl Menger, "What Is Calculus of Variations and What Are Its Applications?" [James R Newman, "The World of Mathematics" Vol. II], 1956)

"While the minimum and maximum problems of calculus of variations correspond to the problem in the ordinary calculus of finding peaks and pits of a surface, the minimax problems correspond to the problem of finding the saddle points of the surface (the passes of a mountain)."(Karl Menger, "What Is Calculus of Variations and What Are Its Applications?" [James R Newman, "The World of Mathematics" Vol. II], 1956)

"[…] entities must not be reduced to the point of inadequacy and, more generally, that it is in vain to try to do with fewer what requires more." (Karl Menger, "A Counterpart of Occam's Razor in Pure and Applied Mathematics Ontological Uses", Synthese Vol. 12 (4), 1960)

On Randomness XII (Chaos I)

"Chaos is but unperceived order; it is a word indicating the limitations of the human mind and the paucity of observational facts. The words ‘chaos’, ‘accidental’, ‘chance’, ‘unpredictable’ are conveniences behind which we hide our ignorance." (Harlow Shapley, "Of Stars and Men: Human Response to an Expanding Universe", 1958)

"The term ‘chaos’ currently has a variety of accepted meanings, but here we shall use it to mean deterministically, or nearly deterministically, governed behavior that nevertheless looks rather random. Upon closer inspection, chaotic behavior will generally appear more systematic, but not so much so that it will repeat itself at regular intervals, as do, for example, the oceanic tides." (Edward N Lorenz, "Chaos, spontaneous climatic variations and detection of the greenhouse effect", 1991)

"The term chaos is used in a specific sense where it is an inherently random pattern of behaviour generated by fixed inputs into deterministic (that is fixed) rules (relationships). The rules take the form of non-linear feedback loops. Although the specific path followed by the behaviour so generated is random and hence unpredictable in the long-term, it always has an underlying pattern to it, a 'hidden' pattern, a global pattern or rhythm. That pattern is self-similarity, that is a constant degree of variation, consistent variability, regular irregularity, or more precisely, a constant fractal dimension. Chaos is therefore order (a pattern) within disorder (random behaviour)." (Ralph D Stacey, "The Chaos Frontier: Creative Strategic Control for Business", 1991)

"In nonlinear systems - and the economy is most certainly nonlinear - chaos theory tells you that the slightest uncertainty in your knowledge of the initial conditions will often grow inexorably. After a while, your predictions are nonsense." (M Mitchell Waldrop, "Complexity: The Emerging Science at the Edge of Order and Chaos", 1992)

"Intriguingly, the mathematics of randomness, chaos, and order also furnishes what may be a vital escape from absolute certainty - an opportunity to exercise free will in a deterministic universe. Indeed, in the interplay of order and disorder that makes life interesting, we appear perpetually poised in a state of enticingly precarious perplexity. The universe is neither so crazy that we can’t understand it at all nor so predictable that there’s nothing left for us to discover." (Ivars Peterson, "The Jungles of Randomness: A Mathematical Safari", 1997)

"When we look at the world around us, we find that we are not thrown into chaos and randomness but are part of a great order, a grand symphony of life. Every molecule in our body was once a part of previous bodies-living or nonliving-and will be a part of future bodies. In this sense, our body will not die but will live on, again and again, because life lives on. We share not only life's molecules but also its basic principles of organization with the rest of the living world. Arid since our mind, too, is embodied, our concepts and metaphors are embedded in the web of life together with our bodies and brains. We belong to the universe, we are at home in it, and this experience of belonging can make our lives profoundly meaningful." (Fritjof Capra, "The Hidden Connections", 2002)

"[…] we would like to observe that the butterfly effect lies at the root of many events which we call random. The final result of throwing a dice depends on the position of the hand throwing it, on the air resistance, on the base that the die falls on, and on many other factors. The result appears random because we are not able to take into account all of these factors with sufficient accuracy. Even the tiniest bump on the table and the most imperceptible move of the wrist affect the position in which the die finally lands. It would be reasonable to assume that chaos lies at the root of all random phenomena." (Iwo Białynicki-Birula & Iwona Białynicka-Birula, "Modeling Reality: How Computers Mirror Life", 2004) 

"Although the potential for chaos resides in every system, chaos, when it emerges, frequently stays within the bounds of its attractor(s): No point or pattern of points is ever repeated, but some form of patterning emerges, rather than randomness. Life scientists in different areas have noticed that life seems able to balance order and chaos at a place of balance known as the edge of chaos. Observations from both nature and artificial life suggest that the edge of chaos favors evolutionary adaptation." (Terry Cooke-Davies et al, "Exploring the Complexity of Projects", 2009)

"Most systems in nature are inherently nonlinear and can only be described by nonlinear equations, which are difficult to solve in a closed form. Non-linear systems give rise to interesting phenomena such as chaos, complexity, emergence and self-organization. One of the characteristics of non-linear systems is that a small change in the initial conditions can give rise to complex and significant changes throughout the system." (Robert K Logan, "The Poetry of Physics and The Physics of Poetry", 2010)

"A system in which a few things interacting produce tremendously divergent behavior; deterministic chaos; it looks random but its not." (Christopher Langton) 

Donald J Wheeler - Collected Quotes

"Averages, ranges, and histograms all obscure the time-order for the data. If the time-order for the data shows some sort of definite pattern, then the obscuring of this pattern by the use of averages, ranges, or histograms can mislead the user. Since all data occur in time, virtually all data will have a time-order. In some cases this time-order is the essential context which must be preserved in the presentation." (Donald J Wheeler," Understanding Variation: The Key to Managing Chaos" 2nd Ed., 2000)

"Before you can improve any system you must listen to the voice of the system (the Voice of the Process). Then you must understand how the inputs affect the outputs of the system. Finally, you must be able to change the inputs (and possibly the system) in order to achieve the desired results. This will require sustained effort, constancy of purpose, and an environment where continual improvement is the operating philosophy." (Donald J Wheeler, "Understanding Variation: The Key to Managing Chaos" 2nd Ed., 2000)

"Data are collected as a basis for action. Yet before anyone can use data as a basis for action the data have to be interpreted. The proper interpretation of data will require that the data be presented in context, and that the analysis technique used will filter out the noise."  (Donald J Wheeler, "Understanding Variation: The Key to Managing Chaos" 2nd Ed., 2000)

"Data are generally collected as a basis for action. However, unless potential signals are separated from probable noise, the actions taken may be totally inconsistent with the data. Thus, the proper use of data requires that you have simple and effective methods of analysis which will properly separate potential signals from probable noise." (Donald J Wheeler, "Understanding Variation: The Key to Managing Chaos" 2nd Ed., 2000)

"No comparison between two values can be global. A simple comparison between the current figure and some previous value and convey the behavior of any time series. […] While it is simple and easy to compare one number with another number, such comparisons are limited and weak. They are limited because of the amount of data used, and they are weak because both of the numbers are subject to the variation that is inevitably present in weak world data. Since both the current value and the earlier value are subject to this variation, it will always be difficult to determine just how much of the difference between the values is due to variation in the numbers, and how much, if any, of the difference is due to real changes in the process." (Donald J Wheeler, "Understanding Variation: The Key to Managing Chaos" 2nd Ed., 2000)

"No matter what the data, and no matter how the values are arranged and presented, you must always use some method of analysis to come up with an interpretation of the data.

While every data set contains noise, some data sets may contain signals. Therefore, before you can detect a signal within any given data set, you must first filter out the noise." (Donald J Wheeler," Understanding Variation: The Key to Managing Chaos" 2nd Ed., 2000)

"Since the average is a measure of location, it is common to use averages to compare two data sets. The set with the greater average is thought to ‘exceed’ the other set. While such comparisons may be helpful, they must be used with caution. After all, for any given data set, most of the values will not be equal to the average." (Donald J Wheeler, "Understanding Variation: The Key to Managing Chaos" 2nd Ed., 2000)

"The purpose of analysis is insight. The best analysis is the simplest analysis which provides the needed insight." (Donald J Wheeler, "Understanding Variation: The Key to Managing Chaos" 2nd Ed., 2000)

"We analyze numbers in order to know when a change has occurred in our processes or systems. We want to know about such changes in a timely manner so that we can respond appropriately. While this sounds rather straightforward, there is a complication - the numbers can change even when our process does not. So, in our analysis of numbers, we need to have a way to distinguish those changes in the numbers that represent changes in our process from those that are essentially noise." (Donald J Wheeler, "Understanding Variation: The Key to Managing Chaos" 2nd Ed., 2000)

"When a system is predictable, it is already performing as consistently as possible. Looking for assignable causes is a waste of time and effort. Instead, you can meaningfully work on making improvements and modifications to the process. When a system is unpredictable, it will be futile to try and improve or modify the process. Instead you must seek to identify the assignable causes which affect the system. The failure to distinguish between these two different courses of action is a major source of confusion and wasted effort in business today." (Donald J Wheeler, "Understanding Variation: The Key to Managing Chaos" 2nd Ed., 2000)

"When a process displays unpredictable behavior, you can most easily improve the process and process outcomes by identifying the assignable causes of unpredictable variation and removing their effects from your process." (Donald J Wheeler, "Understanding Variation: The Key to Managing Chaos" 2nd Ed., 2000)

"While all data contain noise, some data contain signals. Before you can detect a signal, you must filter out the noise." (Donald J Wheeler, "Understanding Variation: The Key to Managing Chaos" 2nd Ed., 2000)

"Without meaningful data there can be no meaningful analysis. The interpretation of any data set must be based upon the context of those data. Unfortunately, much of the data reported to executives today are aggregated and summed over so many different operating units and processes that they cannot be said to have any context except a historical one - they were all collected during the same time period. While this may be rational with monetary figures, it can be devastating to other types of data." (Donald J Wheeler, "Understanding Variation: The Key to Managing Chaos" 2nd Ed., 2000)

"[…] you simply cannot make sense of any number without a contextual basis. Yet the traditional attempts to provide this contextual basis are often flawed in their execution. [...] Data have no meaning apart from their context. Data presented without a context are effectively rendered meaningless." (Donald J Wheeler, "Understanding Variation: The Key to Managing Chaos" 2nd Ed., 2000)

"Data analysis is not generally thought of as being simple or easy, but it can be. The first step is to understand that the purpose of data analysis is to separate any signals that may be contained within the data from the noise in the data. Once you have filtered out the noise, anything left over will be your potential signals. The rest is just details." (Donald J Wheeler," Myths About Data Analysis", International Lean & Six Sigma Conference, 2012)

"Descriptive statistics are built on the assumption that we can use a single value to characterize a single property for a single universe. […] Probability theory is focused on what happens to samples drawn from a known universe. If the data happen to come from different sources, then there are multiple universes with different probability models. If you cannot answer the homogeneity question, then you will not know if you have one probability model or many. [...] Statistical inference assumes that you have a sample that is known to have come from one universe." (Donald J Wheeler, "Myths About Data Analysis", International Lean & Six Sigma Conference, 2012)

"In order to be effective a descriptive statistic has to make sense - it has to distil some essential characteristic of the data into a value that is both appropriate and understandable. […] the justification for computing any given statistic must come from the nature of the data themselves - it cannot come from the arithmetic, nor can it come from the statistic. If the data are a meaningless collection of values, then the summary statistics will also be meaningless - no arithmetic operation can magically create meaning out of nonsense. Therefore, the meaning of any statistic has to come from the context for the data, while the appropriateness of any statistic will depend upon the use we intend to make of that statistic." (Donald J Wheeler, "Myths About Data Analysis", International Lean & Six Sigma Conference, 2012)

"The four questions of data analysis are the questions of description, probability, inference, and homogeneity. Any data analyst needs to know how to organize and use these four questions in order to obtain meaningful and correct results. [...] 

THE DESCRIPTION QUESTION: Given a collection of numbers, are there arithmetic values that will summarize the information contained in those numbers in some meaningful way?

THE PROBABILITY QUESTION: Given a known universe, what can we say about samples drawn from this universe? [...] 

THE INFERENCE QUESTION: Given an unknown universe, and given a sample that is known to have been drawn from that unknown universe, and given that we know everything about the sample, what can we say about the unknown universe? [...] 

THE HOMOGENEITY QUESTION: Given a collection of observations, is it reasonable to assume that they came from one universe, or do they show evidence of having come from multiple universes?" (Donald J Wheeler, "Myths About Data Analysis", International Lean & Six Sigma Conference, 2012)

From Parts to Wholes (1950-1959)

"For scientific endeavor is a natural whole the parts of which mutually support one another in a way which, to be sure, no one can anticipate." (Albert Einstein, "Out of My Later Years", 1950)

"What the worker needs is to see the plant as if he were a manager. Only thus can he see his part, from his part he can reach the whole. This ‘seeing’ is not a matter of information, training courses, conducted plant tours, or similar devices. What is needed is the actual experience of the whole in and through the individual's work." (Peter F Drucker, "The New Society", 1950)

"Every organism represents a system, by which term we mean a complex of elements in mutual interaction. From this obvious statement the limitations of the analytical and summative conceptions must follow. First, it is impossible to resolve the phenomena of life completely into elementary units; for each individual part and each individual event depends not only on conditions within itself, but also to a greater or lesser extent on the conditions within the whole, or within superordinate units of which it is a part. Hence the behavior of an isolated part is, in general, different from its behavior within the context of the whole. [...] Secondly, the actual whole shows properties that are absent from its isolated parts." (Ludwig von Bertalanffy, "Problems of Life", 1952)

"Individualism is the self-affirmation of the individual self as individual self without regard to its participation in its world. As such it is the opposite of collectivism, the self affirmation of the self as part of a larger whole without regard to its character as an individual self." (Paul Tillich, "The Courage to Be The Courage to Be", 1952)

"Every part of the system is so related to every other part that any change in one aspect results in dynamic changes in all other parts of the total system." (Arthur D Hall & Robert E Fagen, "Definition of System", General Systems Vol. 1, 1956)

"In our definition of system we noted that all systems have interrelationships between objects and between their attributes. If every part of the system is so related to every other part that any change in one aspect results in dynamic changes in all other parts of the total system, the system is said to behave as a whole or coherently. At the other extreme is a set of parts that are completely unrelated: that is, a change in each part depends only on that part alone. The variation in the set is the physical sum of the variations of the parts. Such behavior is called independent or physical summativity." (Arthur D Hall & Robert E Fagen, "Definition of System", General Systems Vol. 1, 1956)

"In our definition of system we noted that all systems have interrelationships between objects and between their attributes. If every part of the system is so related to every other part that any change in one aspect results in dynamic changes in all other parts of the total system, the system is said to behave as a whole or coherently. At the other extreme is a set of parts that are completely unrelated: that is, a change in each part depends only on that part alone. The variation in the set is the physical sum of the variations of the parts. Such behavior is called independent or physical summativity." (Arthur D Hall & Robert E Fagen, "Definition of System", General Systems Vol. 1, 1956)

"[...] the concept of 'feedback', so simple and natural in certain elementary cases, becomes artificial and of little use when the interconnexions between the parts become more complex. When there are only two parts joined so that each affects the other, the properties of the feedback give important and useful information about the properties of the whole. But when the parts rise to even as few as four, if every one affects the other three, then twenty circuits can be traced through them; and knowing the properties of all the twenty circuits does not give complete information about the system. Such complex systems cannot be treated as an interlaced set of more or less independent feedback circuits, but only as a whole. For understanding the general principles of dynamic systems, therefore, the concept of feedback is inadequate in itself. What is important is that complex systems, richly cross-connected internally, have complex behaviours, and that these behaviours can be goal-seeking in complex patterns." (W Ross Ashby, "An Introduction to Cybernetics", 1956)

"It is clear to all that the animal organism is a highly complex system consisting of an almost infinite series of parts connected both with one another and, as a total complex, with the surrounding world, with which it is in a state of equilibrium." (Ivan P Pavlov, "Experimental psychology, and other essays", 1957)

"[…] the comprehension of a structure requires intuitive knowledge of the ethology of its resistance and of its constituent materials." (Eduardo Torroja, "Philosophy of Structures/;, 1958)

On Equilibrium (1920-1939)

"Since the atom, as a whole, is neutral, there must be a positive charge associated with the atom equal in amount to the sum of the negative charges. The electrical forces between the positive and negative charges preserve the equilibrium of the atom." (James Chadwick, "Radioactivity And Radioactive Substances", 1921)

"The circle is the synthesis of the greatest oppositions. It combines the concentric and the eccentric in a single form and in equilibrium. Of the three primary forms [triangle, square, circle], it points most clearly to the fourth dimension." (Wassily Kandinsky, [letter] 1926)

"Order is not pressure which is imposed on society from without, but an equilibrium which is set up from within." (José Ortega y Gasset, "Mirabeau and Politics", 1927) 

"What in the whole denotes a causal equilibrium process, appears for the part as a teleological event." (Ludwig von Bertalanffy, 1929)

"The change from one stable equilibrium to the other may take place as the result of the isolation of a small unrepresentative group of the population, a temporary change in the environment which alters the relative viability of different types, or in several other ways." (John B S Haldane, "The Causes of Evolution", 1932)

"True equilibria can occur only in closed systems and that, in open systems, disequilibria called ‘steady states’, or ‘flow equilibria’ are the predominant and characteristic feature. According to the second law of thermodynamics a closed system must eventually attain a time-independent equilibrium state, with maximum entropy and minimum free energy. An open system may, under certain conditions, attain a time-independent state where the system remains constant as a whole and in its phases, though there is a continuous flow of component materials. This is called a steady state. Steady states are irreversible as a whole. […] A closed system in equilibrium does not need energy for its preservation, nor can energy be obtained from it. In order to perform work, a system must be in disequilibrium, tending toward equilibrium and maintaining a steady state, Therefore the character of an open system is the necessary condition for the continuous working capacity of the organism." (Ludwig on Bertalanffy, "Theoretische Biologie: Band 1: Allgemeine Theorie, Physikochemie, Aufbau und Entwicklung des Organismus", 1932)

"Unaided common sense may indicate an equilibrium, but rarely, if ever, tells us whether it is stable. If much of the investigation here summarised has only proved the obvious, the obvious is worth proving when this can be done. And if the relative importance of selection and mutation is obvious, it has certainly not always been recognised as such." (John B S Haldane, "The Causes of Evolution", 1932)

"The general theory of economic equilibrium was strengthened and made effective as an organon of thought by two powerful subsidiary conceptions - the Margin and Substitution. The notion of the Margin was extended beyond Utility to describe the equilibrium point in given conditions of any economic factor which can be regarded as capable of small variations about a given value, or in its functional relation to a given value." (John Maynard Keynes, "Essays In Biography", 1933)

"A state of equilibrium in a system does not mean, further, that the system is without tension. Systems can, on the contrary, also come to equilibrium in a state of tension (e.g., a spring under tension or a container with gas under pressure).The occurrence of this sort of system, however, presupposes a certain firmness of boundaries and actual segregation of the system from its environment (both of these in a functional, not a spatial, sense). If the different parts of the system are insufficiently cohesive to withstand the forces working toward displacement (i.e., if the system shows insufficient internal firmness, if it is fluid), or if the system is not segregated from its environment by sufficiently firm walls but is open to its neighboring systems, stationary tensions cannot occur. Instead, there occurs a process in the direction of the forces, which encroaches upon the neighboring regions with diffusion of energy and which goes in the direction of an equilibrium at a lower level of tension in the total region. The presupposition for the existence of a stationary state of tension is thus a certain firmness of the system in question, whether this be its own inner firmness or the firmness of its walls." (Kurt Lewin, "A Dynamic Theory of Personality", 1935)

"The process moves in the direction of a state of equilibrium only for the system as a whole. Part processes may at the same time go on in opposed directions, a circumstance which is of the greatest significance for, for example, the theory of detour behavior. It is hence important to take the system whole which is dominant at the moment as basis." (Kurt Lewin, "A Dynamic Theory of Personality", 1935)

"Vertical and horizontal lines are the expression of two opposing forces; they exist everywhere and dominate everything; their reciprocal action constitutes 'life'. I recognized that the equilibrium of any particular aspect of nature rests on the equivalence of its opposites." (Piet M Peintre," Art and Pure Plastic Art", 1937)

"For the state centralisation is the appropriate form of organisation, since it aims at the greatest possible uniformity in social life for the maintenance of political and social equilibrium. But for a movement whose very existence depends on prompt action at any favourable moment and on the independent thought and action of its supporters, centralism could but be a curse by weakening its power of decision and systematically repressing all immediate action. [...] Organisation is, after all, only a means to an end. When it becomes an end in itself, it kills the spirit and the vital initiative of its members and sets up that domination by mediocrity which is the characteristic of all bureaucracies." (Rudolf Rocker, "Anarcho-Syndicalism", 1938)

On Chaos II

“We ought then to consider the present state of the universe as the effect of its previous state and as the cause of that which is to follow. An intelligence that, at a given instant, could comprehend all the forces by which nature is animated and the respective situation of the beings that make it up, if moreover it were vast enough to submit these data to analysis, would encompass in the same formula the movements of the greatest bodies of the universe and those of the lightest atoms. For such an intelligence nothing would be uncertain, and the future, like the past, would be open to its eyes.” (Pierre-Simon de Laplace, “Essai philosophique sur les probabilités”, 1814)

“Certainly, if a system moves under the action of given forces and its initial conditions have given values in the mathematical sense, its future motion and behavior are exactly known. But, in astronomical problems, the situation is quite different: the constants defining the motion are only physically known, that is with some errors; their sizes get reduced along the progresses of our observing devices, but these errors can never completely vanish.” (Jacques Hadamard, “Les surfaces à courbures opposées et leurs lignes géodésiques”, Journal de mathématiques pures et appliqués 5e (4), 1898) 

“In every important advance the physicist finds that the fundamental laws are simplified more and more as experimental research advances. He is astonished to notice how sublime order emerges from what appeared to be chaos. And this cannot be traced back to the workings of his own mind but is due to a quality that is inherent in the world of perception.” (Albert Einstein, 1932) 

“There is a maxim which is often quoted, that ‘The same causes will always produce the same effects.’ To make this maxim intelligible we must define what we mean by the same causes and the same effects, since it is manifest that no event ever happens more that once, so that the causes and effects cannot be the same in all respects. [...] There is another maxim which must not be confounded with that quoted at the beginning of this article, which asserts ‘That like causes produce like effects’. This is only true when small variations in the initial circumstances produce only small variations in the final state of the system. In a great many physical phenomena this condition is satisfied; but there are other cases in which a small initial variation may produce a great change in the final state of the system, as when the displacement of the ‘points’ causes a railway train to run into another instead of keeping its proper course.” (James C Maxwell, “Matter and Motion”, 1876)

"If a single flap of a butterfly's wing can be instrumental in generating a tornado, so all the previous and subsequent flaps of its wings, as can the flaps of the wings of the millions of other butterflies, not to mention the activities of innumerable more powerful creatures, including our own species." (Edward N Lorenz, [talk] 1972)

"If the flap of a butterfly’s wings can be instrumental in generating a tornado, it can equally well be instrumental in preventing a tornado." (Edward N Lorenz, [talk] 1972)

"The term ‘chaos’ currently has a variety of accepted meanings, but here we shall use it to mean deterministically, or nearly deterministically, governed behavior that nevertheless looks rather random. Upon closer inspection, chaotic behavior will generally appear more systematic, but not so much so that it will repeat itself at regular intervals, as do, for example, the oceanic tides." (Edward N Lorenz, "Chaos, spontaneous climatic variations and detection of the greenhouse effect", 1991)

"Unfortunately, recognizing a system as chaotic will not tell us all that we might like to know. It will not provide us with a means of predicting the future course of the system. It will tell us that there is a limit to how far ahead we can predict, but it may not tell us what this limit is. Perhaps the best advice that chaos ‘theory’ can give us is not to jump at conclusions; unexpected occurrences may constitute perfectly normal behavior." (Edward N Lorenz, "Chaos, spontaneous climatic variations and detection of the greenhouse effect", 1991) 

“[…] some systems […] are very sensitive to their starting conditions, so that a tiny difference in the initial ‘push’ you give them causes a big difference in where they end up, and there is feedback, so that what a system does affects its own behavior.” (John Gribbin, “Deep Simplicity”, 2004)

On Statistics: Statistical Thinking

"To a very striking degree our culture has become a Statistical culture. Even a person who may never have heard of an index number is affected [...] by [...] of those index numbers which describe the cost of living. It is impossible to understand Psychology, Sociology, Economics, Finance or a Physical Science without some general idea of the meaning of an average, of variation, of concomitance, of sampling, of how to interpret charts and tables." (Carrol D Wright, 1887)

"I define statistical thinking as thought processes, which recognize that variation is all around us and present in everything we do, all work is a series of interconnected processes, and identifying, characterizing, quantifying, controlling, and reducing variation provide opportunities for improvement." (Ron Snee, “Statistical Thinking and Its Contribution to Total Quality”, The American Statistician, Vol. 44, No. 2 1990) [Link]

“Statistical thinking will one day be as necessary for efficient citizenship as the ability to read and write.” (Samuel S Wilks, 1951) [paraphrasing Herbert G Wells]

“Statistical thinking is a general, fundamental, and independent mode of reasoning about data, variation, and chance.” (David S Moore, 1998)

“Statistics at its best provides methodology for dealing empirically with complicated and uncertain information, in a way that is both useful and scientifically valid” (John M Chambers, 1993)

“It is all too easy to notice the statistical sea that supports our thoughts and actions. If that sea loses its buoyancy, it may take a long time to regain the lost support.” (William Kruskal, “Coordination Today: A Disaster or a Disgrace”, The American Statistician, Vol. 37, No. 3, 1983)

“[…] statistical thinking, though powerful, is never as easy or automatic as simply plugging numbers into formulas. In order to use statistical methods appropriately, you need to understand their logic, not just the computing rules.” (Ann E Watkins et al, “Statistics in Action: Understanding a World of Data”, 2007)

"Numbers already rule your world. And you must not be in the dark about this fact. See how some applied scientists use statistical thinking to make our lives better. You will be amazed how you can use numbers to make everyday decisions in your own life." (Kaiser Fung, "Numbers Rule the World", 2010)

"The issue of group differences is fundamental to statistical thinking. The heart of this matter concerns which groups should be aggregated and which shouldn’t." (Kaiser Fung, "Numbers Rule the World", 2010)

"What is so unconventional about the statistical way of thinking? First, statisticians do not care much for the popular concept of the statistical average; instead, they fixate on any deviation from the average. They worry about how large these variations are, how frequently they occur, and why they exist. [...] Second, variability does not need to be explained by reasonable causes, despite our natural desire for a rational explanation of everything; statisticians are frequently just as happy to pore over patterns of correlation. [...] Third, statisticians are constantly looking out for missed nuances: a statistical average for all groups may well hide vital differences that exist between these groups. Ignoring group differences when they are present frequently portends inequitable treatment. [...] Fourth, decisions based on statistics can be calibrated to strike a balance between two types of errors. Predictably, decision makers have an incentive to focus exclusively on minimizing any mistake that could bring about public humiliation, but statisticians point out that because of this bias, their decisions will aggravate other errors, which are unnoticed but serious. [...] Finally, statisticians follow a specific protocol known as statistical testing when deciding whether the evidence fits the crime, so to speak. Unlike some of us, they don’t believe in miracles. In other words, if the most unusual coincidence must be contrived to explain the inexplicable, they prefer leaving the crime unsolved." (Kaiser Fung, "Numbers Rule the World", 2010) 

On Statistics: Statistics and Truth

“A statistical estimate may be good or bad, accurate or the reverse; but in almost all cases it is likely to be more accurate than a casual observer’s impression, and the nature of things can only be disproved by statistical methods.” (Sir Arthur L Bowley, “Elements of Statistics”, 1901)

“The statistics themselves prove nothing; nor are they at any time a substitute for logical thinking. There are […] many simple but not always obvious snags in the data to contend with. Variations in even the simplest of figures may conceal a compound of influences which have to be taken into account before any conclusions are drawn from the data.” (Alfred R Ilersic, “Statistics”, 1959)

“[…] in the statistical world you can multiply ignorance by a constant and get truth.” (Raymond F Jones, “The Non-Statistical Man”, 1964)

“There are two kinds of statistics, the kind you look up and the kind you make up.” (Rex Todhunter Stout, “Death of a Doxy”, 1966)

“When we can’t prove our point through the use of sound reasoning, we fall back upon statistical ‘mumbo jumbo’ to confuse and demoralize our opponents. (Audrey Haber & Richard P. Runyon, “General Statistics”, 1973)

“No matter how much reverence is paid to anything purporting to be ‘statistics’, the term has no meaning unless the source, relevance, and truth are all checked.” (Tom Burnam, “The Dictionary of Misinformation”, 1975)

“Do not trust any statistics you did not fake yourself.” (Winston Churchill)

“I can prove anything by statistics except the truth.” (George Canning)

“In earlier times, they had no statistics, and so they had to fall back on lies.” (Stephen Leacock)

“it is easy to lie with statistics, but easier to lie without them” (Frederick Mosteller)

On Statistics: Some Modern Definitions (2001 – …)

“Statistics is the branch of mathematics that uses observations and measurements called data to analyze, summarize, make inferences, and draw conclusions based on the data gathered.” (Allan G Bluman, “Probability Demystified”, 2005)

“Put simply, statistics is a range of procedures for gathering, organizing, analyzing and presenting quantitative data. […] Essentially […], statistics is a scientific approach to analyzing numerical data in order to enable us to maximize our interpretation, understanding and use. This means that statistics helps us turn data into information; that is, data that have been interpreted, understood and are useful to the recipient. Put formally, for your project, statistics is the systematic collection and analysis of numerical data, in order to investigate or discover relationships among phenomena so as to explain, predict and control their occurrence.” (Reva B Brown & Mark Saunders, “Dealing with Statistics: What You Need to Know”, 2008)

“Statistics is the art of learning from data. It is concerned with the collection of data, their subsequent description, and their analysis, which often leads to the drawing of conclusions.” (Sheldon M Ross, “Introductory Statistics” 3rd Ed., 2009)

“Statistics is the science of collecting, organizing, analyzing, and interpreting data in order to make decisions.” (Ron Larson & Betsy Farber, “Elementary Statistics: Picturing the World” 5th Ed., 2011)

“Statistics is the discipline of using data samples to support claims about populations.” (Allen B Downey, “Think Stats: Probability and Statistics for Programmers”, 2011)

“Statistics is the scientific discipline that provides methods to help us make sense of data. […] The field of statistics teaches us how to make intelligent judgments and informed decisions in the presence of uncertainty and variation.” (Roxy Peck & Jay L Devore, “Statistics: The Exploration and Analysis of Data” 7th Ed, 2012)

“[…] statistics is a method of pursuing truth. At a minimum, statistics can tell you the likelihood that your hunch is true in this time and place and with these sorts of people. This type of pursuit of truth, especially in the form of an event’s future likelihood, is the essence of psychology, of science, and of human evolution.” (Arthhur Aron et al, "Statistics for Phsychology" 6th Ed., 2012)

“Statistics is the art and science of designing studies and analyzing the data that those studies produce. Its ultimate goal is translating data into knowledge and understanding of the world around us. In short, statistics is the art and science of learning from data.” (Alan Agresti & Christine Franklin, “Statistics: The Art and Science of Learning from Data” 3rd Ed., 2013)

“Statistics is a science that helps us make decisions and draw conclusions in the presence of variability.” (Douglas C Montgomery & George C Runger, “Applied Statistics and Probability for Engineers” 6th Ed., 2014)

“Statistics is an integral part of the quantitative approach to knowledge. The field of statistics is concerned with the scientific study of collecting, organizing, analyzing, and drawing conclusions from data.” (Kandethody M Ramachandran & Chris P Tsokos, “Mathematical Statistics with Applications in R” 2nd Ed., 2015)

“Statistics can be defined as a collection of techniques used when planning a data collection, and when subsequently analyzing and presenting data.” (Birger S Madsen, “Statistics for Non-Statisticians”, 2016)

“Statistics is the science of collecting, organizing, and interpreting numerical facts, which we call data. […] Statistics is the science of learning from data.” (Moore McCabe & Alwan Craig, “The Practice of Statistics for Business and Economics” 4th Ed., 2016)

“Statistics is the science of collecting, organizing, summarizing, and analyzing information to draw conclusions or answer questions. In addition, statistics is about providing a measure of confidence in any conclusions.” (Michael Sullivan, “Statistics: Informed Decisions Using Data”, 5th Ed., 2017)

Further definitions:
1800-1900
1901-1950
1951-2000

Statistics – Some Historical Definitions (1800-1900)

“Il y a, dans la statistique, deux choses qui se trouvent continuellement mélangées, und methode et une science. On emploie la statistique comme methode, toutes les fois que l’on compte on que l’on mesure quelque chose, par example, l’éndendue d’un district, le mobre de habitants d’un pays, la quantité ou le prix de certaines denrées, etc. […] Il y a, de plus, une science de la statistique. Elle consiste à savoir réunir les chiffres, les combiner et les calculer, de la manière la plus propre à conduire à des résultats certains. Mais ceci n’est, à propement parler qu’une branche de mathémetiques.“ (Alphonse P de Candolle, “Considérations sur le statistique des délits” 1833)

“There are two aspects of statistics that are continually mixed, the method and the science. Statistics are used as a method, whenever we measure something, for example, the size of a district, the number of inhabitants of a country, the quantity or price of certain commodities, etc. […] There is, moreover, a science of statistics. It consists of knowing how to gather numbers, combine them and calculate them, in the best way to lead to certain results. But this is, strictly speaking, a branch of mathematics." (Alphonse P de Candolle, “Considerations on Crime Statistics”, 1833)

"[statistics is] that department of political science which is concerned in collecting and arranging facts illustrative of the condition and resources of the state. To reason upon such facts and to draw conclusions from them is not within the province of statistics; but is the business of the statesman and of the political economist." (Penny Cyclopedia, 1842)

“Statistics has then for its object that of presenting a faithful representation of a state at a determined epoch.” (Adolphe Quetelet, 1849) 

"Observations and statistics agree in being quantities grouped about a Mean; they differ, in that the Mean of observations is real, of statistics is fictitious. The mean of observations is a cause, as it were the source from which diverging errors emanate. The mean of statistics is a description, a representative quantity put for a whole group, the best representative of the group, that quantity which, if we must in practice put one quantity for many, minimizes the error unavoidably attending such practice. Thus measurements by the reduction of which we ascertain a real time, number, distance are observations. Returns of prices, exports and imports, legitimate and illegitimate marriages or births and so forth, the averages of which constitute the premises of practical reasoning, are statistics. In short, observations are different copies of one original; statistics are different originals affording one ‘generic portrait’. Different measurements of the same man are observations; but measurements of different men, grouped round l’homme moyen, are prima facie at least statistics." (Francis Y Edgeworth, 1885) 

“[Statistics] are the only tools by which an opening can be cut through the formidable thicket of difficulties that bars the path of those who pursue the Science of man.” (Sir Francis Galton, “Natural Inheritance”, 1889)

Further definitions:
1901-1950
1951-2000
2001- …