Showing posts with label causality. Show all posts
Showing posts with label causality. Show all posts

01 December 2025

John M Bryson - Collected Quotes

"A causal map is a word-and-arrow diagram in which ideas and actions are causally linked with one another through the use of arrows. The arrows indicate how one idea or action leads to another. Causal mapping makesit possible to articulate a large number of ideas and their interconnections in such a way that people can know what to do in an area of concern, how to do it and why, because the arrows indicate the causes and consequences of an idea or action. Causal mapping is therefore a technique for linking strategic thinking and acting, helping make sense of complex problems, and communicating to oneself and others what might be done about them." (John M Bryson et al, "Visible Thinking: Unlocking Causal Mapping For Practical Business Results", 2004)

"A statement of strategic aims is powerful when it represents the interaction between all of the goals [Strategy]: the goals are seen as a system where each goal helps deliver other high-level goals and may in turn be helped by the delivery of subordinate goals." (John M Bryson et al, "Visible Thinking: Unlocking Causal Mapping For Practical Business Results", 2004)

"Causal mapping is a simple and useful technique for addressing situations where thinking– as an individual or as a group– matters. A causal map is a word-and-arrow diagram in which ideas and actions are causally linked with one another through the use of arrows. The arrows indicate how one idea or action leads to another. Causal mapping makes it possible to articulate a large number of ideas and their interconnections in such a way that people can know what to do in an area of concern, how to do it and why, because the arrows indicate the causes and consequences of an idea or action." (John M Bryson et al, "Visible Thinking: Unlocking Causal Mapping For Practical Business Results", 2004)

"Causal mapping is [...] a technique for linking strategic thinking and acting, helping make sense of complex problems, and communicating to oneself and others what might be done about them. With practice, the use of causal mapping can assist you in moving from 'winging it' when thinking matters to a more concrete and rigorous approach that helps you and others achieve success in an easy and far more reliable way" (John M Bryson et al, "Visible Thinking: Unlocking Causal Mapping For Practical Business Results", 2004)

"Causal mapping makes it possible to articulate a large number of ideas and their interconnections in such a way that we can better understand an area of concern. Causal mapping also helps us know what to do about the issue, what it would take to do those things, and what we would like to get out of having done so. Causal mapping is therefore a particularly powerful technique for making sense of complex problems, linking strategic thinking and acting, and helping to communicate to others what might or should be done. " (John M Bryson et al, "Visible Thinking: Unlocking Causal Mapping For Practical Business Results", 2004)

"Linking focuses attention not on topics but on action: what results might be achieved by doing something, and what things needed to be done to make other things happen." (John M Bryson et al, "Visible Thinking: Unlocking Causal Mapping For Practical Business Results", 2004)

"Positive feedback loops are very important. Even when afeedback loop is made up of competencies, because they are self-sustaining they may be very important resources for the future of the business [Strategy]. A positive loop means that each of the competencies in the loop feeds all of the others. When the feedback loop is distinctive, this will be even more important because the distinctiveness is self-sustaining." (John M Bryson et al, "Visible Thinking: Unlocking Causal Mapping For Practical Business Results", 2004)

"The process of constructing a map thus allows you to reflect on your own thinking, or that of someone else. Mapping helps you become conscious of your reasoning and to understand clearly what another person is thinking. In turn, that consciousness and understanding can help you reaffirm what you think or else change your mind. Shared understanding and mutual agreement also become possible." (John M Bryson et al, "Visible Thinking: Unlocking Causal Mapping For Practical Business Results", 2004)

"When an individual uses causal mapping to help clarify their own thinking, we call this technique cognitive mapping, because it is related to personal thinking or cognition. When a group maps their own ideas, we call it oval mapping, because we often use oval-shaped cards to record individuals’ ideas so that they can be arranged into a group’s map. Cognitive maps and oval maps can be used to create a strategic plan, because the maps include goals, strategies and actions, just like strategic plans." (John M Bryson et al, "Visible Thinking: Unlocking Causal Mapping For Practical Business Results", 2004)

"When people question assumptions, the map may clarify what they are. When logic is challenged, the map may help. When people want to know how goals and strategies are linked, the map may show how they are. The map does not make the decisions. Rather, it provides a record that preserves complexity, yet organizes and categorizes that complexity in such a way that people can understand and manage it. And if more mapping needs to be done, the map is there as a base on which to build." (John M Bryson et al, "Visible Thinking: Unlocking Causal Mapping For Practical Business Results", 2004)

28 March 2025

Mental Models LXVII: On Causal Maps

"Causal maps are representations of individuals (or groups) beliefs about causal relations. They include elements, with only two kinds of properties. The first property is 'relevance'. The second  is the possibility of being in one (of two) 'influence relationships' (positive or negative) with one (of three) strengths (weak. moderate, or strong)." (Kivia Markoczy & Jeff Goldberg, "A method for eliciting and comparing causal maps", 1995)

"Short-term memory can hold 7 ± 2 chunks of information at once. This puts a rather sharp limit on the effective size and complexity of a causal map. Presenting a complex causal map all at once makes it hard to see the loops, understand which are important, or understand how they generate the dynamics. Resist the temptation to put all the loops you and your clients have identified into a single comprehensive diagram." (John D Sterman, "Business Dynamics Systems Thinking and Modeling for a Complex World", 2000)

"The robustness of the misperceptions of feedback and the poor performance they cause are due to two basic and related deficiencies in our mental model. First, our cognitive maps of the causal structure of systems are vastly simplified compared to the complexity of the systems themselves. Second, we are unable to infer correctly the dynamics of all but the simplest causal maps. Both are direct consequences of bounded rationality, that is, the many limitations of attention, memory, recall, information processing capability, and time that constrain human decision making." (John D Sterman, "Business Dynamics: Systems thinking and modeling for a complex world", 2000)

"A causal map is an abstract representation of the causal relationships among kinds of objects and events in the world. Such relationships are not, for the most part, directly observable, but they can often be accurately inferred from observations. This includes both observations of patterns of contingency and correlation among events as well as observations of the effects of experimental interventions. We can think of everyday theories and theory-formation processes as cognitive systems that allow us to recover an accurate causal map of the world." (Alison Gopnik & Clark Glymour, "Causal maps and Bayes nets: a cognitive and computational account of theory-formation" [in "The cognitive basis of science"], 2002)

"Causal mapping is a simple and useful technique for addressing situations where thinking - as an individual or as a group - matters. A causal map is a word-and-arrow diagram in which ideas and actions are causally linked with one another through the use of arrows. The arrows indicate how one idea or action leads to another. Causal mapping makes it possible to articulate a large number of ideas and their interconnections in such a way that people can know what to do in an area of concern, how to do it and why, because the arrows indicate the causes and consequences of an idea or action." (John M Bryson et al, "Visible Thinking: Unlocking Causal Mapping For Practical Business Results", 2004)

"Causal mapping is [...]  a technique for linking strategic thinking and acting, helping make sense of complex problems, and communicating to oneself and others what might be done about them. With practice, the use of causal mapping can assist you in moving from 'winging it' when thinking matters to a more concrete and rigorous approach that helps you and others achieve success in an easy and far more reliable way" (John M Bryson et al, "Visible Thinking: Unlocking Causal Mapping For Practical Business Results", 2004)

"Causal mapping makes it possible to articulate a large number of ideas and their interconnections in such a way that we can better understand an area of concern. Causal mapping also helps us know what to do about the issue, what it would take to do those things, and what we would like to get out of having done so. Causal mapping is therefore a particularly powerful technique for making sense of complex problems, linking strategic thinking and acting, and helping to communicate to others what might or should be done. " (John M Bryson et al, "Visible Thinking: Unlocking Causal Mapping For Practical Business Results", 2004)

"When an individual uses causal mapping to help clarify their own thinking, we call this technique cognitive mapping, because it is related to personal thinking or cognition. When a group maps their own ideas, we call it oval mapping, because we often use oval-shaped cards to record individuals’ ideas so that they can be arranged into a group’s map. Cognitive maps and oval maps can be used to create a strategic plan, because the maps include goals, strategies and actions, just like strategic plans." (John M Bryson et al, "Visible Thinking: Unlocking Causal Mapping For Practical Business Results", 2004)

"Causal maps include elements called nodes, which are allowed to have causal relationships of different strengths of positive or negative loading depicted with a number, usually in the range of from 1 (weak) to 3 (strong). The relationships of the nodes are depicted with arcs or links labeled with the assumed polarity and loading factor or strength of causality, Links with positive polarity refer to dependency (when A increases B increases proportionally to the loading factor) and negative to inverse dependency (when A increases, B decreases)." (Hannu Kivijärvi et al, "A Support System for the Strategic Scenario Process", Encyclopedia of Decision Making and Decision Support Technologies, 2008)

"Fifth principle: (a) in finding solutions for systemic problems do not be content with symptomatic solutions but look for systemic-structural levers that can produce the more incisive effect; (b) if there are several systemic levers, choose the most efficient, that which produces the maximum effects with the minimum effort; (c) to activate the chosen structural lever identify the most effective decisional lever (action variable) taking into account the time necessary to produce the desired effect; (d) the choice of structural and decisional levers, as well as the intensity of the actions to modify their values, must follow from a careful construction, interpretation and assessment of the system’s causal map." (Piero Mella, "Systems Thinking: Intelligence in Action", 2012)

"(1) The causal maps are only models of a world of variables and processes; (2) They are models suitable for depicting that world only if they represent a logical image; (3) A logical image is made up of a network of arrows that depict the cause and effect connections among the variables and processes in the world; this network cannot be in contradiction to the world; (4) This depiction of the world relates to the boundaries between the represented and the external systems; the causal maps always depict a portion of a vaster world;" (Piero Mella, "Systems Thinking: Intelligence in Action", 2012)

"In constructing causal maps, whatever technique is adopted, there is always the problem of identifying or defining the system’s boundaries, either if we zoom in or broaden our perspective by zooming out." (Piero Mella, "Systems Thinking: Intelligence in Action", 2012)

"A Causal Map is hierarchical in structure (linking means to ends) and built with a focus on achieving goals. The process of creating the maps is ideally a group process and this in itself will add lots of value to a collective understanding of goals around EDI, what is required to achieve these and some of the potential challenges around this." (Nicola Morrill, "Supporting Your Efforts on Diversity", 2021)

08 September 2021

On Causality (1200-1699)

"The universal cause is one thing, a particular cause another. An effect can be haphazard with respect to the plan of the second, but not of the first. For an effect is not taken out of the scope of one particular cause save by another particular cause which prevents it, as when wood dowsed with water, will not catch fire. The first cause, however, cannot have a random effect in its own order, since all particular causes are comprehended in its causality. When an effect does escape from a system of particular causality, we speak of it as fortuitous or a chance happening […]" (Thomas Aquinas, “Summa Theologica”, cca. 1266-1273)

"Among all the studies of natural causes and reasoning, Light chiefly delights the beholder; and among the great features of mathematics the certainty of its demonstrations is what preeminently tends to elevate the mind of the investigator: Perspective, therefore, might be preferred to all the discourses and systems of the human learning." (Leonardo da Vinci, 1497)

"In the discovery of hidden things and the investigation of hidden causes, stronger reasons are obtained from sure experiments and demonstrated arguments than from probable conjectures and the opinions of philosophical speculators of the common sort […]" (William Gilbert, "De Magnete", 1600)

"As we divided natural philosophy in general into the inquiry of causes, and productions of effects: so that part which concerneth the inquiry of causes we do subdivide according to the received and sound division of causes. The one part, which is physic, inquireth and handleth the material and efficient causes; and the other, which is metaphysic, handleth the formal and final causes." (Francis Bacon, "The Advancement of Learning", 1605)

"The end of our foundation is the knowledge of causes, and secret motions of things; and the enlarging of the bounds of human empire, to the effecting of all things possible." (Francis Bacon, "New Atlantis", 1627)

"From a given determined cause an effect follows of necessity, and on the other hand, if no determined cause is granted, it is impossible that an effect should follow." (Baruch Spinoza, "Ethics", 1677)

"I understand that to be CAUSE OF ITSELF (causa sui) whose essence involves existence and whose nature cannot be conceived unless existing." (Baruch Spinoza, "Ethics", 1677)

"[...] that all men are born ignorant of the causes of things, and that all have a desire of acquiring what is useful; [...]" (Baruch Spinoza, "Ethics", 1677)

"To this purpose the philosophers say, that Nature does nothing in vain, and more is in vain, when less will serve; for Nature is pleased with simplicity, and affects not the pomp of superfluous causes. Therefore to the same natural effects we must, as far as possible, assign the same causes." (Sir Isaac Newton, “The Mathematical Principles of Natural Philosophy”, Voll. II, 1687)

Previous Post <<||>> Next Post

On Causality (1990-1999)

"To live, it seems is to explain, to justify, and to find coherence among diverse outcomes, characteristics, and causes." (Thomas Gilovich, 1991)

"Chaos demonstrates that deterministic causes can have random effects […] There's a similar surprise regarding symmetry: symmetric causes can have asymmetric effects. […] This paradox, that symmetry can get lost between cause and effect, is called symmetry-breaking. […] From the smallest scales to the largest, many of nature's patterns are a result of broken symmetry; […]" (Ian Stewart & Martin Golubitsky, "Fearful Symmetry: Is God a Geometer?", 1992)

"Symmetry breaking in psychology is governed by the nonlinear causality of complex systems (the 'butterfly effect'), which roughly means that a small cause can have a big effect. Tiny details of initial individual perspectives, but also cognitive prejudices, may 'enslave' the other modes and lead to one dominant view." (Klaus Mainzer, "Thinking in Complexity", 1994)

"Systems philosophy brings forth a reorganization of ways of thinking. It creates a new worldview, a new paradigm of perception and explanation, which is manifested in integration, holistic thinking, purpose-seeking, mutual causality, and process-focused inquiry." (Béla H Bánáthy, "Systems Design of Education", 1991)

"Indeed, except for the very simplest physical systems, virtually everything and everybody in the world is caught up in a vast, nonlinear web of incentives and constraints and connections. The slightest change in one place causes tremors everywhere else. We can't help but disturb the universe, as T.S. Eliot almost said. The whole is almost always equal to a good deal more than the sum of its parts. And the mathematical expression of that property - to the extent that such systems can be described by mathematics at all - is a nonlinear equation: one whose graph is curvy." (M Mitchell Waldrop, "Complexity: The Emerging Science at the Edge of Order and Chaos", 1992)

"First, social systems are inherently insensitive to most policy changes that people choose in an effort to alter the behavior of systems. In fact, social systems draw attention to the very points at which an attempt to intervene will fail. Human intuition develops from exposure to simple systems. In simple systems, the cause of a trouble is close in both time and space to symptoms of the trouble. If one touches a hot stove, the burn occurs here and now; the cause is obvious. However, in complex dynamic systems, causes are often far removed in both time and space from the symptoms. True causes may lie far back in time and arise from an entirely different part of the system from when and where the symptoms occur. However, the complex system can mislead in devious ways by presenting an apparent cause that meets the expectations derived from simple systems." (Jay W Forrester, "Counterintuitive Behavior of Social Systems", 1995)

"Swarm systems generate novelty for three reasons: (1) They are 'sensitive to initial conditions' - a scientific shorthand for saying that the size of the effect is not proportional to the size of the cause - so they can make a surprising mountain out of a molehill. (2) They hide countless novel possibilities in the exponential combinations of many interlinked individuals. (3) They don’t reckon individuals, so therefore individual variation and imperfection can be allowed. In swarm systems with heritability, individual variation and imperfection will lead to perpetual novelty, or what we call evolution." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

“The term mental model refers to knowledge structures utilized in the solving of problems. Mental models are causal and thus may be functionally defined in the sense that they allow a problem solver to engage in description, explanation, and prediction. Mental models may also be defined in a structural sense as consisting of objects, states that those objects exist in, and processes that are responsible for those objects’ changing states.” (Robert Hafner & Jim Stewart, “Revising Explanatory Models to Accommodate Anomalous Genetic Phenomena: Problem Solving in the ‘Context of Discovery’”, Science Education 79 (2), 1995)

"By irreducibly complex I mean a single system composed of several well-matched, interacting parts that contribute to the basic function, wherein the removal of any one of the parts causes the system to effectively cease functioning. An irreducibly complex system cannot be produced directly (that is, by continuously improving the initial function, which continues to work by the same mechanism) by slight, successive modification of a precursor, system, because any precursors to an irreducibly complex system that is missing a part is by definition nonfunctional." (Michael Behe, "Darwin’s Black Box", 1996)

"A good model makes the right strategic simplifications. In fact, a really good model is one that generates a lot of understanding from focusing on a very small number of causal arrows." (Robert M Solow, "How Did Economics Get That Way and What Way Did It Get?", Daedalus, Vol. 126, No. 1, 1997)

"A model is a deliberately simplified representation of a much more complicated situation. […] The idea is to focus on one or two causal or conditioning factors, exclude everything else, and hope to understand how just these aspects of reality work and interact." (Robert M Solow, "How Did Economics Get That Way and What Way Did It Get?", Daedalus, Vol. 126, No. 1, 1997)

"Delay time, the time between causes and their impacts, can highly influence systems. Yet the concept of delayed effect is often missed in our impatient society, and when it is recognized, it’s almost always underestimated. Such oversight and devaluation can lead to poor decision making as well as poor problem solving, for decisions often have consequences that don’t show up until years later. Fortunately, mind mapping, fishbone diagrams, and creativity/brainstorming tools can be quite useful here." (Stephen G Haines, "The Managers Pocket Guide to Systems Thinking & Learning", 1998)

"Our simplistic cause-effect analyses, especially when coupled with the desire for quick fixes, usually lead to far more problems than they solve - impatience and knee-jerk reactions included. If we stop for a moment and take a good look our world and its seven levels of complex and interdependent systems, we begin to understand that multiple causes with multiple effects are the true reality, as are circles of causality-effects." (Stephen G Haines, "The Managers Pocket Guide to Systems Thinking & Learning", 1998)

"There is a new science of complexity which says that the link between cause and effect is increasingly difficult to trace; that change (planned or otherwise) unfolds in non-linear ways; that paradoxes and contradictions abound; and that creative solutions arise out of diversity, uncertainty and chaos." (Andy P Hargreaves & Michael Fullan, "What’s Worth Fighting for Out There?", 1998)

"We use mathematics and statistics to describe the diverse realms of randomness. From these descriptions, we attempt to glean insights into the workings of chance and to search for hidden causes. With such tools in hand, we seek patterns and relationships and propose predictions that help us make sense of the world." (Ivars Peterson, "The Jungles of Randomness: A Mathematical Safari", 1998)

"We use mathematics and statistics to describe the diverse realms of randomness. From these descriptions, we attempt to glean insights into the workings of chance and to search for hidden causes. With such tools in hand, we seek patterns and relationships and propose predictions that help us make sense of the world."  (Ivars Peterson, "The Jungles of Randomness: A Mathematical Safari", 1998)

Previous Post <<||>> Next Post

On Causality (2010-2019)

"All forms of complex causation, and especially nonlinear transformations, admittedly stack the deck against prediction. Linear describes an outcome produced by one or more variables where the effect is additive. Any other interaction is nonlinear. This would include outcomes that involve step functions or phase transitions. The hard sciences routinely describe nonlinear phenomena. Making predictions about them becomes increasingly problematic when multiple variables are involved that have complex interactions. Some simple nonlinear systems can quickly become unpredictable when small variations in their inputs are introduced." (Richard N Lebow, "Forbidden Fruit: Counterfactuals and International Relations", 2010)

"Cybernetics is the art of creating equilibrium in a world of possibilities and constraints. This is not just a romantic description, it portrays the new way of thinking quite accurately. Cybernetics differs from the traditional scientific procedure, because it does not try to explain phenomena by searching for their causes, but rather by specifying the constraints that determine the direction of their development." (Ernst von Glasersfeld, "Partial Memories: Sketches from an Improbable Life", 2010)

"Most systems in nature are inherently nonlinear and can only be described by nonlinear equations, which are difficult to solve in a closed form. Non-linear systems give rise to interesting phenomena such as chaos, complexity, emergence and self-organization. One of the characteristics of non-linear systems is that a small change in the initial conditions can give rise to complex and significant changes throughout the system. This property of a non-linear system such as the weather is known as the butterfly effect where it is purported that a butterfly flapping its wings in Japan can give rise to a tornado in Kansas. This unpredictable behaviour of nonlinear dynamical systems, i.e. its extreme sensitivity to initial conditions, seems to be random and is therefore referred to as chaos. This chaotic and seemingly random behaviour occurs for non-linear deterministic system in which effects can be linked to causes but cannot be predicted ahead of time." (Robert K Logan, "The Poetry of Physics and The Physics of Poetry", 2010)

"System dynamics is an approach to understanding the behaviour of over time. It deals with internal feedback loops and time delays that affect the behaviour of the entire system. It also helps the decision maker untangle the complexity of the connections between various policy variables by providing a new language and set of tools to describe. Then it does this by modeling the cause and effect relationships among these variables." (Raed M Al-Qirem & Saad G Yaseen, "Modelling a Small Firm in Jordan Using System Dynamics", 2010)

"In dynamical systems, a bifurcation occurs when a small smooth change made to the parameter values (the bifurcation parameters) of a system causes a sudden 'qualitative' or topological change in its behaviour. Generally, at a bifurcation, the local stability properties of equilibria, periodic orbits or other invariant sets changes." (Gregory Faye, "An introduction to bifurcation theory",  2011)

"Each systems archetype embodies a particular theory about dynamic behavior that can serve as a starting point for selecting and formulating raw data into a coherent set of interrelationships. Once those relationships are made explicit and precise, the 'theory' of the archetype can then further guide us in our data-gathering process to test the causal relationships through direct observation, data analysis, or group deliberation." (Daniel H Kim, "Systems Archetypes as Dynamic Theories", The Systems Thinker Vol. 24 (1), 2013)

"Multiple regression, like all statistical techniques based on correlation, has a severe limitation due to the fact that correlation doesn't prove causation. And no amount of measuring of 'control' variables can untangle the web of causality. What nature hath joined together, multiple regression cannot put asunder." (Richard Nisbett, "2014 : What scientific idea is ready for retirement?", 2013)

"Statisticians set a high bar when they assign a cause to an effect. [...] A model that ignores cause–effect relationships cannot attain the status of a model in the physical sciences. This is a structural limitation that no amount of data - not even Big Data - can surmount." (Kaiser Fung, "Numbersense: How To Use Big Data To Your Advantage", 2013)

"Without precise predictability, control is impotent and almost meaningless. In other words, the lesser the predictability, the harder the entity or system is to control, and vice versa. If our universe actually operated on linear causality, with no surprises, uncertainty, or abrupt changes, all future events would be absolutely predictable in a sort of waveless orderliness." (Lawrence K Samuels, "Defense of Chaos", 2013)

"A basic problem with MRA is that it typically assumes that the independent variables can be regarded as building blocks, with each variable taken by itself being logically independent of all the others. This is usually not the case, at least for behavioral data. […] Just as correlation doesn’t prove causation, absence of correlation fails to prove absence of causation. False-negative findings can occur using MRA just as false-positive findings do—because of the hidden web of causation that we’ve failed to identify." (Richard E Nisbett, "Mindware: Tools for Smart Thinking", 2015)

"The theory behind multiple regression analysis is that if you control for everything that is related to the independent variable and the dependent variable by pulling their correlations out of the mix, you can get at the true causal relation between the predictor variable and the outcome variable. That’s the theory. In practice, many things prevent this ideal case from being the norm." (Richard E Nisbett, "Mindware: Tools for Smart Thinking", 2015)

"The work around the complex systems map supported a concentration on causal mechanisms. This enabled poor system responses to be diagnosed as the unanticipated effects of previous policies as well as identification of the drivers of the sector. Understanding the feedback mechanisms in play then allowed experimentation with possible future policies and the creation of a coherent and mutually supporting package of recommendations for change."  (David C Lane et al, "Blending systems thinking approaches for organisational analysis: reviewing child protection", 2015)

"Correlation is not equivalent to cause for one major reason. Correlation is well defined in terms of a mathematical formula. Cause is not well defined." (David S Salsburg, "Errors, Blunders, and Lies: How to Tell the Difference", 2017)

"Effects without an understanding of the causes behind them, on the other hand, are just bunches of data points floating in the ether, offering nothing useful by themselves. Big Data is information, equivalent to the patterns of light that fall onto the eye. Big Data is like the history of stimuli that our eyes have responded to. And as we discussed earlier, stimuli are themselves meaningless because they could mean anything. The same is true for Big Data, unless something transformative is brought to all those data sets… understanding." (Beau Lotto, "Deviate: The Science of Seeing Differently", 2017)

"The main differences between Bayesian networks and causal diagrams lie in how they are constructed and the uses to which they are put. A Bayesian network is literally nothing more than a compact representation of a huge probability table. The arrows mean only that the probabilities of child nodes are related to the values of parent nodes by a certain formula (the conditional probability tables) and that this relation is sufficient. That is, knowing additional ancestors of the child will not change the formula. Likewise, a missing arrow between any two nodes means that they are independent, once we know the values of their parents. [...] If, however, the same diagram has been constructed as a causal diagram, then both the thinking that goes into the construction and the interpretation of the final diagram change." (Judea Pearl & Dana Mackenzie, "The Book of Why: The new science of cause and effect", 2018)

"Again, classical statistics only summarizes data, so it does not provide even a language for asking [a counterfactual] question. Causal inference provides a notation and, more importantly, offers a solution. As with predicting the effect of interventions [...], in many cases we can emulate human retrospective thinking with an algorithm that takes what we know about the observed world and produces an answer about the counterfactual world." (Judea Pearl & Dana Mackenzie, "The Book of Why: The new science of cause and effect", 2018)

"Bayesian networks inhabit a world where all questions are reducible to probabilities, or (in the terminology of this chapter) degrees of association between variables; they could not ascend to the second or third rungs of the Ladder of Causation. Fortunately, they required only two slight twists to climb to the top." (Judea Pearl & Dana Mackenzie, "The Book of Why: The new science of cause and effect", 2018)

"Some scientists (e.g., econometricians) like to work with mathematical equations; others (e.g., hard-core statisticians) prefer a list of assumptions that ostensibly summarizes the structure of the diagram. Regardless of language, the model should depict, however qualitatively, the process that generates the data - in other words, the cause-effect forces that operate in the environment and shape the data generated." (Judea Pearl & Dana Mackenzie, "The Book of Why: The new science of cause and effect", 2018)

"The calculus of causation consists of two languages: causal diagrams, to express what we know, and a symbolic language, resembling algebra, to express what we want to know. The causal diagrams are simply dot-and-arrow pictures that summarize our existing scientific knowledge. The dots represent quantities of interest, called 'variables', and the arrows represent known or suspected causal relationships between those variables - namely, which variable 'listens' to which others." (Judea Pearl & Dana Mackenzie, "The Book of Why: The new science of cause and effect", 2018)

"We often say that causes precede effects and yet, in the elementary grammar of things, there is no distinction between 'cause' and 'effect'. There are regularities, represented by what we call physical laws, that link events of different times, but they are symmetric between future and past. In a microscopic description, there can be no sense in which the past is different from the future."(Carlo Rovelli, "The Order of Time", 2018)

"With Bayesian networks, we had taught machines to think in shades of gray, and this was an important step toward humanlike thinking. But we still couldn’t teach machines to understand causes and effects. [...] By design, in a Bayesian network, information flows in both directions, causal and diagnostic: smoke increases the likelihood of fire, and fire increases the likelihood of smoke. In fact, a Bayesian network can’t even tell what the 'causal direction' is." (Judea Pearl & Dana Mackenzie, "The Book of Why: The new science of cause and effect", 2018)

Previous Post <<||>> Next Post

On Causality (2000-2009)

"Even if our cognitive maps of causal structure were perfect, learning, especially double-loop learning, would still be difficult. To use a mental model to design a new strategy or organization we must make inferences about the consequences of decision rules that have never been tried and for which we have no data. To do so requires intuitive solution of high-order nonlinear differential equations, a task far exceeding human cognitive capabilities in all but the simplest systems."  (John D Sterman, "Business Dynamics: Systems thinking and modeling for a complex world", 2000)

"A model isolates one or a few causal connections, mechanisms, or processes, to the exclusion of other contributing or interfering factors - while in the actual world, those other factors make their effects felt in what actually happens. Models may seem true in the abstract, and are false in the concrete. The key issue is about whether there is a bridge between the two, the abstract and the concrete, such that a simple model can be relied on as a source of relevantly truthful information about the complex reality." (Uskali Mäki, "Fact and Fiction in Economics: Models, Realism and Social Construction", 2002)

"In a complex system, there is no such thing as simple cause and effect." (Margaret J Wheatley, "It's An Interconnected World", 2002)

"A causal map is a word-and-arrow diagram in which ideas and actions are causally linked with one another through the use of arrows. The arrows indicate how one idea or action leads to another. Causal mapping makesit possible to articulate a large number of ideas and their interconnections in such a way that people can know what to do in an area of concern, how to do it and why, because the arrows indicate the causes and consequences of an idea or action. Causal mapping is therefore a technique for linking strategic thinking and acting, helping make sense of complex problems, and communicating to oneself and others what might be done about them." (John M Bryson et al, "Visible Thinking: Unlocking Causal Mapping For Practical Business Results", 2004)

"Nonetheless, the basic principles regarding correlations between variables are not that difficult to understand. We must look for patterns that reveal potential relationships and for evidence that variables are actually related. But when we do spot those relationships, we should not jump to conclusions about causality. Instead, we need to weigh the strength of the relationship and the plausibility of our theory, and we must always try to discount the possibility of spuriousness." (Joel Best, "More Damned Lies and Statistics: How numbers confuse public issues", 2004)

"We’re accustomed to thinking in terms of centralized control, clear chains of command, the straightforward logic of cause and effect. But in huge, interconnected systems, where every player ultimately affects every other, our standard ways of thinking fall apart. Simple pictures and verbal arguments are too feeble, too myopic." (Steven Strogatz, "Sync: The Emerging Science of Spontaneous", 2004)

"Chance is just as real as causation; both are modes of becoming. The way to model a random process is to enrich the mathematical theory of probability with a model of a random mechanism. In the sciences, probabilities are never made up or 'elicited' by observing the choices people make, or the bets they are willing to place. The reason is that, in science and technology, interpreted probability exactifies objective chance, not gut feeling or intuition. No randomness, no probability." (Mario Bunge, "Chasing Reality: Strife over Realism", 2006)

"Thus, nonlinearity can be understood as the effect of a causal loop, where effects or outputs are fed back into the causes or inputs of the process. Complex systems are characterized by networks of such causal loops. In a complex, the interdependencies are such that a component A will affect a component B, but B will in general also affect A, directly or indirectly.  A single feedback loop can be positive or negative. A positive feedback will amplify any variation in A, making it grow exponentially. The result is that the tiniest, microscopic difference between initial states can grow into macroscopically observable distinctions." (Carlos Gershenson, "Design and Control of Self-organizing Systems", 2007)

"A system is a set of things – people, cells, molecules, or whatever - interconnected in such a way that they produce their own pattern of behavior over time. […] The system, to a large extent, causes its own behavior." (Donella H Meadows, “Thinking in Systems: A Primer”, 2008)

"For me, as I later came to say, cybernetics is the art of creating equilibrium in a world of possibilities and constraints. This is not just a romantic description, it portrays the new way of thinking quite accurately. Cybernetics differs from the traditional scientific procedure, because it does not try to explain phenomena by searching for their causes, but rather by specifying the constraints that determine the direction of their development." (Ernst von Glasersfeld, "The Cybernetics of Snow Drifts 1948", 2009)

"Traditional statistics is strong in devising ways of describing data and inferring distributional parameters from sample. Causal inference requires two additional ingredients: a science-friendly language for articulating causal knowledge, and a mathematical machinery for processing that knowledge, combining it with data and drawing new causal conclusions about a phenomenon." (Judea Pearl, "Causal inference in statistics: An overview", Statistics Surveys 3, 2009)

Previous Post <<||>> Nest Post

On Causality (1975-1989)

"Causation depends on an extraordinary turning of reality at a particular instant such that one event transmutes into another." (David R Heise, "Causal Analysis", 1975)

"The invalid assumption that correlation implies cause is probably among the two or three most serious and common errors of human reasoning." (Stephen J Gould, "The Mismeasure of Man", 1980)

"All certainty in our relationships with the world rests on acknowledgement of causality. Causality is a genetic connection of phenomena through which one thing (the cause) under certain conditions gives rise to, causes something else (the effect). The essence of causality is the generation and determination of one phenomenon by another." (Alexander Spirkin, "Dialectical Materialism", 1983)

"Every phenomenon is related to other phenomena by connections of more than one value. It is the result both of certain conditions and certain basic factors that act as its cause. That is why the cause-effect connection has to be artificially isolated from the rest of conditions so that we can see this connection in its 'pure form'. But this is achieved only by abstraction. In reality we cannot isolate this connection from the whole set of conditions. There is always a closely interwoven mass of extremely diverse secondary conditions, which leave their mark on the form in which the general connection emerges. This means that there can never be two exactly identical phenomena, even if they are generated by the same causes. They have always developed in empirically different conditions. So there can be no absolute identity in the world." (Alexander Spirkin, "Dialectical Materialism", 1983)

"Physics is like that. It is important that the models we construct allow us to draw the right conclusions about the behaviour of the phenomena and their causes. But it is not essential that the models accurately describe everything that actually happens; and in general it will not be possible for them to do so, and for much the same reasons. The requirements of the theory constrain what can be literally represented. This does not mean that the right lessons cannot be drawn. Adjustments are made where literal correctness does not matter very much in order to get the correct effects where we want them; and very often, as in the staging example, one distortion is put right by another. That is why it often seems misleading to say that a particular aspect of a model is false to reality: given the other constraints that is just the way to restore the representation." (Nancy Cartwright, "How the Laws of Physics Lie", 1983)

"The complexities of cause and effect defy analysis." (Douglas Adams, "Dirk Gently's Holistic Detective Agency", 1987)

"Correlation and causation are two quite different words, and the innumerate are more prone to mistake them than most." (John A Paulos, "Innumeracy: Mathematical Illiteracy and its Consequences", 1988)

Previous Post <<||>> Next Post

On Causality (1900-1949)

"Some of the common ways of producing a false statistical argument are to quote figures without their context, omitting the cautions as to their incompleteness, or to apply them to a group of phenomena quite different to that to which they in reality relate; to take these estimates referring to only part of a group as complete; to enumerate the events favorable to an argument, omitting the other side; and to argue hastily from effect to cause, this last error being the one most often fathered on to statistics. For all these elementary mistakes in logic, statistics is held responsible." (Sir Arthur L Bowley, "Elements of Statistics", 1901)

"[...] the present contains nothing more than the past, and what is found in the effect was already in the cause." (Henri Bergson, "Creative Evolution", 1907)

"An exceedingly small cause which escapes our notice determines a considerable effect that we cannot fail to see, and then we say the effect is due to chance. If we knew exactly the laws of nature and the situation of the universe at the initial moment, we could predict exactly the situation of that same universe at a succeeding moment. But even if it were the case that the natural laws had no longer any secret for us, we could still only know the initial situation 'approximately'. If that enabled us to predict the succeeding situation with 'the same approximation', that is all we require, and we should say that the phenomenon had been predicted, that it is governed by laws. But it is not always so; it may happen that small differences in the initial conditions produce very great ones in the final phenomena. A small error in the former will produce an enormous error in the latter. Prediction becomes impossible, and we have the fortuitous phenomenon. (Jules H Poincaré, "Science and Method", 1908)

"To speak of the cause of an event is therefore misleading. Any set of antecedents from which the event can theoretically be inferred by means of correlations might be called a cause of the event. But to speak of the cause is to imply a uniqueness [...]." (Bertrand Russell, "Mysticism and Logic: And Other Essays", 1910)

"It is an enduring truth, which can never be altered, that every infraction of the Law of nature must carry its punitive consequences with it. We can never get beyond that range of cause and effect." (Thomas Troward, "The Edinburgh Lectures on Mental Science", 1915)

"What in the whole denotes a causal equilibrium process, appears for the part as a teleological event." (Ludwig von Bertalanffy, 1929)

"Postulate 1. All chance systems of causes are not alike in the sense that they enable us to predict the future in terms of the past. Postulate 2. Constant systems of chance causes do exist in nature. Postulate 3. Assignable causes of variation may be found and eliminated."(Walter A Shewhart, "Economic Control of Quality of Manufactured Product", 1931)

"To apply the category of cause and effect means to find out which parts of nature stand in this relation. Similarly, to apply the gestalt category means to find out which parts of nature belong as parts to functional wholes, to discover their position in these wholes, their degree of relative independence, and the articulation of larger wholes into sub-wholes." (Kurt Koffka, 1931)

"When the number of factors coming into play in a phenomenological complex is too large, scientific method in most cases fails us. One need only think of the weather, in which case prediction even for a few days ahead is impossible. Nevertheless no one doubts that we are confronted with a causal connection whose causal components are in the main known to us. Occurrences in this domain are beyond the reach of exact prediction because of the variety of factors in operation, not because of any lack of order in nature." (Albert Einstein, "Science and Religion", 1941)

"Time itself will come to an end. For entropy points the direction of time. Entropy is the measure of randomness. When all system and order in the universe have vanished, when randomness is at its maximum, and entropy cannot be increased, when there is no longer any sequence of cause and effect, in short when the universe has run down, there will be no direction to time - there will be no time." (Lincoln Barnett, "The Universe and Dr. Einstein", 1948)

"[...] the conception of chance enters in the very first steps of scientific activity in virtue of the fact that no observation is absolutely correct. I think chance is a more fundamental conception that causality; for whether in a concrete case, a cause-effect relation holds or not can only be judged by applying the laws of chance to the observation." (Max Born, 1949)

Previous Post <<||>> Next Post

On Causality (-1199)

"Analysis is a method where one assumes that which is sought, and from this, through a series of implications, arrives at something which is agreed upon on the basis of synthesis; because in analysis, one assumes that which is sought to be known, proved, or constructed, and examines what this is a consequence of and from what this latter follows, so that by backtracking we end up with something that is already known or is part of the starting points of the theory; we call such a method analysis; it is, in a sense, a solution in reversed direction. In synthesis we work in the opposite direction: we assume the last result of the analysis to be true. Then we put the causes from analysis in their natural order, as consequences, and by putting these together we obtain the proof or the construction of that which is sought. We call this synthesis." (Pappus of Alexandria, cca. 4th century BC)

"All human actions have one or more of these seven causes: chance, nature, compulsions, habit, reason, passion, desire." (Aristotle, 4th century BC)

"In all disciplines in which there is systematic knowledge of things with principles, causes, or elements, it arises from a grasp of those: we think we have knowledge of a thing when we have found its primary causes and principles, and followed it back to its elements." (Aristotle, "Physics", cca. 350 BC)

"We must rather seek for a cause, for every event whether probable or improbable must have some cause." (Polybius, "The Histories", cca. 120 BC)

"The Causes of events are ever more interesting than the events themselves." (Marcus Tullius Cicero, "Epistolae ad atticum" ["Letters to Atticus"], cca. 46-44 BC)

"The most important events are often determined by very trivial causes." (Marcus Tullius Cicero, "Orationes Philippicae", 44-43 BC)

"Constantly regard the universe as one living being, having one substance and one soul; and observe how all things have reference to one perception, the perception of this one living being; and how all things act with one movement; and how all things are the cooperating causes of all things which exist; observe too the continuous spinning of the thread and the contexture of the web." (Marcus Aurelius, "Meditations", cca. 121–180 AD)

"In the series of things those which follow are always aptly fitted to those which have gone before; for this series is not like a mere enumeration of disjointed things, which has only a necessary sequence, but it is a rational connection: and as all existing things are arranged together harmoniously, so the things which come into existence exhibit no mere succession, but a certain wonderful relationship." (Marcus Aurelius, "Meditations", cca. 180 AD)

"On the assumption that all happens by Cause, it is easy to discover the nearest determinants of any particular act or state to trace it plainly to them." (Plotinus, "Enneads", cca. 270 AD)

"Now it is established in the sciences that no knowledge is acquired save through the study of its causes and beginnings, if it has had causes and beginnings; nor completed except by knowledge of its accidents and accompanying essentials. Of these causes there are four kinds: material, efficient, formal, and final." (Ibn Sina [Avicenna] "On Medicine", cca. 1020)

"The knowledge of anything, since all things have causes, is not acquired or complete unless it is known by its causes." (Ibn Sina [Avicenna] "On Medicine", cca. 1020)

Previous Post <<||>> Next Post

On Causality (1950-1974)

"Keep in mind that a correlation may be real and based on real cause and effect, and still be almost worthless in determining action in any single case." (Darell Huff, "How to Lie with Statistics", 1954)

"The well-known virtue of the experimental method is that it brings situational variables under tight control. It thus permits rigorous tests of hypotheses and confidential statements about causation. The correlational method, for its part, can study what man has not learned to control. Nature has been experimenting since the beginning of time, with a boldness and complexity far beyond the resources of science. The correlator’s mission is to observe and organize the data of nature’s experiments." (Lee J Cronbach, "The Two Disciplines of Scientific Psychology", The American Psychologist Vol. 12, 1957)

"Nature is pleased with simplicity, and affects not the pomp of superfluous causes." (Morris Kline, "Mathematics and the Physical World", 1959)

"Can there be laws of chance? The answer, it would seem should be negative, since chance is in fact defined as the characteristic of the phenomena which follow no law, phenomena whose causes are too complex to permit prediction." (Félix E Borel, "Probabilities and Life", 1962)

"Every part of the system is so related to every other part that a change in a particular part causes a changes in all other parts and in the total system." (Arthur D Hall, "A methodology for systems engineering", 1962)

"Certain properties are necessary or sufficient conditions for other properties, and the network of causal relations thus established will make the occurrence of one property at least tend, subject to the presence of other properties, to promote or inhibit the occurrence of another. Arguments from models involve those analogies which can be used to predict the occurrence of certain properties or events, and hence the relevant relations are causal, at least in the sense of implying a tendency to co-occur." (Mary B Hesse," Models and Analogies in Science", 1963)

"Today we preach that science is not science unless it is quantitative. We substitute correlation for causal studies, and physical equations for organic reasoning. Measurements and equations are supposed to sharpen thinking, but [...] they more often tend to make the thinking non-causal and fuzzy." (John R Platt, "Strong Inference", Science Vol. 146 (3641), 1964)

"Cybernetics, based upon the principle of feedback or circular causal trains providing mechanisms for goal-seeking and self-controlling behavior." (Ludwig von Bertalanffy, "General System Theory", 1968)

"In complex systems cause and effect are often not closely related in either time or space. The structure of a complex system is not a simple feedback loop where one system state dominates the behavior. The complex system has a multiplicity of interacting feedback loops. Its internal rates of flow are controlled by nonlinear relationships. The complex system is of high order, meaning that there are many system states (or levels). It usually contains positive-feedback loops describing growth processes as well as negative, goal-seeking loops. In the complex system the cause of a difficulty may lie far back in time from the symptoms, or in a completely different and remote part of the system. In fact, causes are usually found, not in prior events, but in the structure and policies of the system." (Jay Wright Forrester, "Urban dynamics", 1969)

"Technology can relieve the symptoms of a problem without affecting the underlying causes. Faith in technology as the ultimate solution to all problems can thus divert our attention from the most fundamental problem - the problem of growth in a finite system - and prevent us from taking effective action to solve it." (Donella H Meadows, "The Limits to Growth", 1972)

Previous Post <<||>> Next Post

11 July 2021

Virginia Anderson - Collected Quotes

"A system is a group of interacting, interrelated, or interdependent components that form a complex and unified whole." (Virginia Anderson & Lauren Johnson, "Systems Thinking Basics: From Concepts to Causal Loops", 1997)

"[…] dynamic behavior is produced by a combination of reinforcing and balancing loops. Behind any growth or collapse is at least one reinforcing loop, and for every sign of goal-seeking behavior, there is a balancing loop. A period of rapid growth or collapse followed by a slowdown typically signals a shift in dominance from a reinforcing loop that is driving the structure, to a balancing loop." (Virginia Anderson & Lauren Johnson, "Systems Thinking Basics: From Concepts to Causal Loops", 1997)

"[…] feedback is not necessarily transmitted and returned through the same system component - or even through the same system. It may travel through several intervening components within the system first, or return from an external system, before finally arriving again at the component where it started." (Virginia Anderson & Lauren Johnson, "Systems Thinking Basics: From Concepts to Causal Loops", 1997)

"Feedback is the transmission and return of information. […] A system has feedback within itself. But because all systems are part of larger systems, a system also has feedback between itself and external systems. In some systems, the feedback and adjustment processes happen so quickly that it is relatively easy for an observer to follow. In other systems, it may take a long time before the feedback is returned, so an observer would have trouble identifying the action that prompted the feedback." (Virginia Anderson & Lauren Johnson, "Systems Thinking Basics: From Concepts to Causal Loops", 1997)

"In a complex system, it is not uncommon for subsystems to have goals that compete directly with or diverge from the goals of the overall system. […] Feedback gathered from small, local subsystems for use by larger subsystems may be either inaccurately conveyed or inaccurately interpreted. Yet it is this very flexibility and looseness that allow large, complex systems to endure, although it can be hard to predict what these organizations are likely to do next." (Virginia Anderson & Lauren Johnson, "Systems Thinking Basics: From Concepts to Causal Loops", 1997)

"Left to themselves, systems seek to maintain their stability. […] Systems achieve this stability through the interactions, feedback, and adjustments that continually circulate among the system parts, and between the system and its environment." (Virginia Anderson & Lauren Johnson, "Systems Thinking Basics: From Concepts to Causal Loops", 1997)

"One of the strongest benefits of the systems thinking perspective is that it can help you learn to ask the right questions. This is an important first step toward understanding a problem. […] Much of the value of systems thinking comes from the different framework that it gives us for looking at problems in new ways." (Virginia Anderson & Lauren Johnson, "Systems Thinking Basics: From Concepts to Causal Loops", 1997)

"Reinforcing loops can be seen as the engines of growth and collapse. That is, they compound change in one direction with even more change in that direction. Many reinforcing loops have a quality of accelerating movement in a particular direction, a sense that the more one variable changes, the more another changes." (Virginia Anderson & Lauren Johnson, "Systems Thinking Basics: From Concepts to Causal Loops", 1997)

"Systems thinking is most effective when it’s used to look at a problem in a new way, not to advocate a predetermined solution. Strong advocacy will create resistance - both to your ideas, and to systems thinking itself. Present systems thinking in the spirit of inquiry, not inquisition." (Virginia Anderson & Lauren Johnson, "Systems Thinking Basics: From Concepts to Causal Loops", 1997)

09 June 2021

On Principles V: Identity

"The topics of ontology, or metaphysic, are cause, effect, action, passion, identity, opposition, subject, adjunct, and sign." (Isaac Watts, "Logic, or The right use of reason, in the inquiry after truth", 1725)

"Science arises from the discovery of Identity amid Diversity." (William S Jevons, "The Principles of Science: A Treatise on Logic and Scientific Method", 1874)

"The very possibility of mathematical science seems an insoluble contradiction. If this science is only deductive in appearance, from whence is derived that perfect rigour which is challenged by none? If, on the contrary, all the propositions which it enunciates may be derived in order by the rules of formal logic, how is it that mathematics is not reduced to a gigantic tautology? The syllogism can teach us nothing essentially new, and if everything must spring from the principle of identity, then everything should be capable of being reduced to that principle." (Henri Poincaré, "Science and Hypothesis", 1901)

"Metaphors deny distinctions between things: problems often arise from taking structural metaphors too literally. Because unexamined metaphors lead us to assume the identity of unidentical things, conflicts can arise which can only be resolved by understanding the metaphor (which requires its recognition as such), which means reconstructing the analogy on which it is based. […] The unexplained extension of concepts can too often result in the destruction rather than the expansion of meaning." (David Pimm,"Metaphor and Analogy in Mathematics", For the Learning of Mathematics Vol. 1 (3), 1981)

"The idea that one can 'introduce' a kind of objects simply by laying down an identity criterion for them really inverts the proper order of explanation. As Locke clearly understood, one must first have a clear conception of what kind of objects one is dealing with in order to extract a criterion of identity for them from that conception. […] So, rather than 'abstract' a kind of object from a criterion of identity, one must in general 'extract' a criterion of identity from a metaphysically defensible conception of a given kind of objects." (Edward J Lowe, The metaphysics of abstract objects, Journal of Philosophy 92 (10), 1995) 

"There is no unique, global, and universal relation of identity for abstract objects. [...] Abstract objects are of different sorts and this should mean, almost by definition, that there is no global, universal identity for sorts. Each sort X is equipped with an internal relation of identity but there is no identity relation that would apply to all sorts." (Jean-Pierre Marquis," Categorical foundations of mathematics, or how to provide foundations for abstract mathematics", The Review of Symbolic Logic Vol. 6 (1), 2012) 

"Reason is indeed all about identity, or, rather, tautology. Mathematics is the eternal, necessary system of rational, analytic tautology. Tautology is not 'empty', as it is so often characterized by philosophers. It is in fact the fullest thing there, the analytic ground of existence, and the basis of everything. Mathematical tautology has infinite masks to wear, hence delivers infinite variety. Mathematical tautology provides Leibniz’s world that is 'simplest in hypothesis and the richest in phenomena'. No hypothesis cold be simpler than the one revolving around tautologies concerning 'nothing'. There is something - existence - because nothing is tautologous, and 'something' is how that tautology is expressed. If we write x = 0, where x is any expression that has zero as its net result, then we have a world of infinite possibilities where something ('x') equals nothing (0)." (Thomas Stark, "God Is Mathematics: The Proofs of the Eternal Existence of Mathematics", 2018)

30 May 2021

On Conjecture (Unsourced)

"In the study of Nature conjecture must be entirely put aside, and vague hypothesis carefully guarded against. The study of Nature begins with facts, ascends to laws, and raises itself, as far as the limits of man’s intellect will permit, to the knowledge of causes, by the threefold means of observation, experiment and logical deduction." (Jean Baptiste-Andre Dumas)

"Indeed, when in the course of a mathematical investigation we encounter a problem or conjecture a theorem, our minds will not rest until the problem is exhaustively solved and the theorem rigorously proved; or else, until we have found the reasons which made success impossible and, hence, failure unavoidable. Thus, the proofs of the impossibility of certain solutions plays a predominant role in modern mathematics; the search for an answer to such questions has often led to the discovery of newer and more fruitful fields of endeavour." (David Hilbert)

"The conjectures of the scientific intelligence are genuine creative novelties, inherently unpredictable and not determined by the character of the scientist’s physical environment. The thinking mind is not a causal mechanism." (Anthony M Quinton)

"The only use of an hypothesis is, that it should lead to experiments; that it should be a guide to facts. In this application, conjectures are always of use. The destruction of an error hardly ever takes place without the discovery of truth. [...] Hypothesis should be considered merely an intellectual instrument of discovery, which at any time may be relinquished for a better instrument. It should never be spoken of as truth; its highest praise is verisimility. Knowledge can only be acquired by the senses; nature has an archetype in the human imagination; her empire is given only to industry and action, guided and governed by experience." (Sir Humphry Davy) 

"The purpose of life is to conjecture and prove." (Paul Erdős)

"The theory of numbers, more than any other branch of mathematics, began by being an experimental science. Its most famous theorems have all been conjectured, sometimes a hundred years or more before they were proved; and they have been suggested by the evidence of a mass of computations." (Godfrey H Hardy)

"What certainty can there be in a Philosophy which consists in as many Hypotheses as there are Phaenomena to be explained. To explain all nature is too difficult a task for any one man or even for any one age. 'Tis much better to do a little with certainty, & leave the rest for others that come after you, than to explain all things by conjecture without making sure of any thing." (Sir Isaac Newton)

09 May 2021

On Randomness XXVI (Universe)

"Random chance was not a sufficient explanation of the Universe - in fact, random chance was not sufficient to explain random chance; the pot could not hold itself." (Robert A Heinlein, "Stranger in a Strange Land", 1961)

"The line between inner and outer landscapes is breaking down. Earthquakes can result from seismic upheavals within the human mind. The whole random universe of the industrial age is breaking down into cryptic fragments." (William S Burroughs, [preface] 1972)

"There is no reason to assume that the universe has the slightest interest in intelligence -  or even in life. Both may be random accidental by-products of its operations like the beautiful patterns on a butterfly's wings. The insect would fly just as well without them […]" (Arthur C Clarke, "The Lost Worlds of 2001", 1972)

"It is tempting to wonder if our present universe, large as it is and complex though it seems, might not be merely the result of a very slight random increase in order over a very small portion of an unbelievably colossal universe which is virtually entirely in heat-death." (Isaac Asimov, 1976)

"Perhaps randomness is not merely an adequate description for complex causes that we cannot specify. Perhaps the world really works this way, and many events are uncaused in any conventional sense of the word." (Stephen J Gould, "Hen's Teeth and Horse's Toes", 1983)

"The world of science lives fairly comfortably with paradox. We know that light is a wave and also that light is a particle. The discoveries made in the infinitely small world of particle physics indicate randomness and chance, and I do not find it any more difficult to live with the paradox of a universe of randomness and chance and a universe of pattern and purpose than I do with light as a wave and light as a particle. Living with contradiction is nothing new to the human being." (Madeline L'Engle, "Two-Part Invention: The Story of a Marriage", 1988)

"Intriguingly, the mathematics of randomness, chaos, and order also furnishes what may be a vital escape from absolute certainty - an opportunity to exercise free will in a deterministic universe. Indeed, in the interplay of order and disorder that makes life interesting, we appear perpetually poised in a state of enticingly precarious perplexity. The universe is neither so crazy that we can’t understand it at all nor so predictable that there’s nothing left for us to discover." (Ivars Peterson, "The Jungles of Randomness: A Mathematical Safari", 1997)

"Often, we use the word random loosely to describe something that is disordered, irregular, patternless, or unpredictable. We link it with chance, probability, luck, and coincidence. However, when we examine what we mean by random in various contexts, ambiguities and uncertainties inevitably arise. Tackling the subtleties of randomness allows us to go to the root of what we can understand of the universe we inhabit and helps us to define the limits of what we can know with certainty." (Ivars Peterson, "The Jungles of Randomness: A Mathematical Safari", 1998)

"The first view of randomness is of clutter bred by complicated entanglements. Even though we know there are rules, the outcome is uncertain. Lotteries and card games are generally perceived to belong to this category. More troublesome is that nature's design itself is known imperfectly, and worse, the rules may be hidden from us, and therefore we cannot specify a cause or discern any pattern of order. When, for instance, an outcome takes place as the confluence of totally unrelated events, it may appear to be so surprising and bizarre that we say that it is due to blind chance." (Edward Beltrami. "What is Random?: Chance and Order in Mathematics and Life", 1999)

"The tissue of the world is built from necessities and randomness; the intellect of men places itself between both and can control them; it considers the necessity and the reason of its existence; it knows how randomness can be managed, controlled, and used." (Johann Wolfgang von Goethe)

08 May 2021

On Randomness XI (Statistics)

"The postulate of randomness thus resolves itself into the question, 'of what population is this a random sample?' which must frequently be asked by every practical statistician." (Ronald Fisher, "On the Mathematical Foundation of Theoretical Statistics", Philosophical Transactions of the Royal Society of London Vol. A222, 1922)

"The definition of random in terms of a physical operation is notoriously without effect on the mathematical operations of statistical theory because so far as these mathematical operations are concerned random is purely and simply an undefined term." (Walter A Shewhart & W. Edwards "Deming, Statistical Method from the Viewpoint of Quality Control", 1939)

"The purely random sample is the only kind that can be examined with entire confidence by means of statistical theory, but there is one thing wrong with it. It is so difficult and expensive to obtain for many uses that sheer cost eliminates it." (Harold Hotelling, "How to Lie with Statistics", 1954)

"The point is that every experiment involves an error, the magnitude of which is not known beforehand and it varies from one experiment to another. For this reason, no matter what finite number of experiments have been carried out, the arithmetic mean of the values obtained will contain an error. Of course, if the experiments are conducted under identical conditions and the errors are random errors, then the error of the mean will diminish as the number of experiments is increased, but it cannot be reduced to zero for a finite number of experiments. […] The choice of entities for an experiment must be perfectly random, so that even an apparently inessential cause could not lead to erroneous conclusions." (Yakov Khurgin, "Did You Say Mathematics?", 1974)

"Statistics has been likened to a telescope. The latter enables one to see further and to make clear objects which were diminished or obscured by distance. The former enables one to discern structure and relationships which were distorted by other factors or obscured by random variation." (David J Hand, "The Role of Statistics in Psychiatry", Psychological Medicine Vol. 15, 1985)

"We will use the convenient expression 'chosen at random' to mean that the probabilities of the events in the sample space are all the same unless some modifying words are near to the words 'at random'. Usually we will compute the probability of the outcome based on the uniform probability model since that is very common in modeling simple situations. However, a uniform distribution does not imply that it comes from a random source; […]" (Richard W Hamming, "The Art of Probability for Scientists and Engineers", 1991)

"If you perceive the world as some place where things happen at random - random events over which you have sometimes very little control, sometimes fairly good control, but still random events - well, one has to be able to have some idea of how these things behave. […] People who are not used to statistics tend to see things in data - there are random fluctuations which can sometimes delude them - so you have to understand what can happen randomly and try to control whatever can be controlled. You have to expect that you are not going to get a clean-cut answer. So how do you interpret what you get? You do it by statistics." (Lucien LeCam, [interview] 1988)

"When looking at the end result of any statistical analysis, one must be very cautious not to over interpret the data. Care must be taken to know the size of the sample, and to be certain the method for gathering information is consistent with other samples gathered. […] No one should ever base conclusions without knowing the size of the sample and how random a sample it was. But all too often such data is not mentioned when the statistics are given - perhaps it is overlooked or even intentionally omitted." (Theoni Pappas, "More Joy of Mathematics: Exploring mathematical insights & concepts", 1994)

"We use mathematics and statistics to describe the diverse realms of randomness. From these descriptions, we attempt to glean insights into the workings of chance and to search for hidden causes. With such tools in hand, we seek patterns and relationships and propose predictions that help us make sense of the world." (Ivars Peterson, "The Jungles of Randomness: A Mathematical Safari", 1998)

"[In statistics] you have the fact that the concepts are not very clean. The idea of probability, of randomness, is not a clean mathematical idea. You cannot produce random numbers mathematically. They can only be produced by things like tossing dice or spinning a roulette wheel. With a formula, any formula, the number you get would be predictable and therefore not random. So as a statistician you have to rely on some conception of a world where things happen in some way at random, a conception which mathematicians don’t have." (Lucien LeCam, [interview] 1988)

"[...] in the statistical world, what we see and measure around us can be considered as the sum of a systematic mathematical idealized form plus some random contribution that cannot yet be explained. This is the classic idea of the signal and the noise." (David Spiegelhalter, "The Art of Statistics: Learning from Data", 2019)

"Too little attention is given to the need for statistical control, or to put it more pertinently, since statistical control (randomness) is so rarely found, too little attention is given to the interpretation of data that arise from conditions not in statistical control." (William E Deming)

20 April 2021

On Coincidence III

"Is it mere coincidence that the universe happens to possess just those properties which allow part of it to be alive? Some people say yes; it was simply good luck that the universe was born with the particular characteristics that it has. Others say no; our universe is only one of many universes." (Ken Croswell, "Planet Quest: The Epic Discovery of Alien Solar Systems", 1997)

"Most systems displaying a high degree of tolerance against failures are a common feature: Their functionality is guaranteed by a highly interconnected complex network. A cell's robustness is hidden in its intricate regulatory and metabolic network; society's resilience is rooted in the interwoven social web; the economy's stability is maintained by a delicate network of financial and regulator organizations; an ecosystem's survivability is encoded in a carefully crafted web of species interactions. It seems that nature strives to achieve robustness through interconnectivity. Such universal choice of a network architecture is perhaps more than mere coincidences." (Albert-László Barabási, "Linked: How Everything Is Connected to Everything Else and What It Means for Business, Science, and Everyday Life", 2002)

"Coincidence surprises us because our intuition about the likelihood of an event is often wildly inaccurate." (Michael Starbird, "Coincidences, Chaos, and All That Math Jazz", 2005)

"With our heads spinning in the world of coincidence and chaos, we nevertheless must make decisions and take steps into the minefield of our future. To avoid explosive missteps, we rely on data and statistical reasoning to inform our thinking." (Michael Starbird, "Coincidences, Chaos, and All That Math Jazz", 2005)

"The human mind delights in finding pattern - so much so that we often mistake coincidence or forced analogy for profound meaning. No other habit of thought lies so deeply within the soul of a small creature trying to make sense of a complex world not constructed for it." (Stephen J Gould, "The Flamingo's Smile: Reflections in Natural History", 2010)

"History is often the tale of small moments - chance encounters or casual decisions or sheer coincidence - that seem of little consequence at the time, but somehow fuse with other small moments to produce something momentous, the proverbial flapping of a butterfly's wings that triggers a hurricane." (Scott Anderson, "Lawrence in Arabia: War, Deceit, Imperial Folly and the Making of the Modern Middle East", 2013)

"In mathematics, two angles that are said to coincide fit together perfectly. The word 'coincidence' does not describe luck or mistakes. It describes that which fits together perfectly." (Wayne Dyer, "The Essential Wayne Dyer Collection", 2013)

"The happy coincidences between life’s requirements and nature’s choices of parameter-values might be just a series of flukes, but one could be forgiven for beginning to suspect that something deeper is at work. That suspicion is the first deep root of anthropic reasoning." (Frank Wilczek, "Multiversality", 2013) 

On Coincidence II

"People are entirely too disbelieving of coincidence. They are far too ready to dismiss it and to build arcane structures of extremely rickety substance in order to avoid it. I, on the other hand, see coincidence everywhere as an inevitable consequence of the laws of probability, according to which having no unusual coincidence is far more unusual than any coincidence could possibly be." (Isaac Asimov, "The Planet That Wasn't", 1976)

"Our form of life depends, in delicate and subtle ways, on several apparent ‘coincidences’ in the fundamental laws of nature which make the Universe tick. Without those coincidences, we would not be here to puzzle over the problem of their existence […] What does this mean? One possibility is that the Universe we know is a highly improbable accident, ‘just one of those things’." (John R Gribbin, "Genesis: The Origins of Man and the Universe", 1981)

"[…] a mathematician's ultimate concern is that his or her inventions be logical, not realistic. This is not to say, however, that mathematical inventions do not correspond to real things. They do, in most, and possibly all, cases. The coincidence between mathematical ideas and natural reality is so extensive and well documented, in fact, that it requires an explanation. Keep in mind that the coincidence is not the outcome of mathematicians trying to be realistic - quite to the contrary, their ideas are often very abstract and do not initially appear to have any correspondence to the real world. Typically, however, mathematical ideas are eventually successfully applied to describe real phenomena […]"(Michael Guillen, "Bridges to Infinity: The Human Side of Mathematics", 1983)

"Moreover, joint occurrences tend to be better recalled than instances when the effect does not occur. The proneness to remember confirming instances, but to overlook disconfirming ones, further serves to convert, in thought, coincidences into causalities." (Albert Bandura, "Social Foundations of Thought and Action: A social cognitive theory", 1986)

"There is no coherent knowledge, i.e. no uniform comprehensive account of the world and the events in it. There is no comprehensive truth that goes beyond an enumeration of details, but there are many pieces of information, obtained in different ways from different sources and collected for the benefit of the curious. The best way of presenting such knowledge is the list - and the oldest scientific works were indeed lists of facts, parts, coincidences, problems in several specialized domains." (Paul K Feyerabend, "Farewell to Reason", 1987)

"A tendency to drastically underestimate the frequency of coincidences is a prime characteristic of innumerates, who generally accord great significance to correspondences of all sorts while attributing too little significance to quite conclusive but less flashy statistical evidence." (John A Paulos, "Innumeracy: Mathematical Illiteracy and its Consequences", 1988)

"The law of truly large numbers states: With a large enough sample, any outrageous thing is likely to happen." (Frederick Mosteller, "Methods for Studying Coincidences", Journal of the American Statistical Association Vol. 84, 1989)

"Most coincidences are simply chance events that turn out to be far more probable than many people imagine." (Ivars Peterson, "The Jungles of Randomness: A Mathematical Safari", 1997)

"Often, we use the word random loosely to describe something that is disordered, irregular, patternless, or unpredictable. We link it with chance, probability, luck, and coincidence. However, when we examine what we mean by random in various contexts, ambiguities and uncertainties inevitably arise. Tackling the subtleties of randomness allows us to go to the root of what we can understand of the universe we inhabit and helps us to define the limits of what we can know with certainty." (Ivars Peterson, "The Jungles of Randomness: A Mathematical Safari", 1998)

"Randomness is the very stuff of life, looming large in our everyday experience. […] The fascination of randomness is that it is pervasive, providing the surprising coincidences, bizarre luck, and unexpected twists that color our perception of everyday events." (Edward Beltrami, "What is Random?: Chaos and Order in Mathematics and Life", 1999)

04 December 2020

Fuzzy Logic III

"Another direction of research is fuzzy systems. This will greatly increase the use of mathematics from the inanimate to the animate. In the past, mathematics has been used for the analysis of physical systems. With fuzzy systems and computer simulation we can study many processes in the social sciences." (Richard E Bellman, "Eye of the Hurricane: An Autobiography", 1984)

"In the real world, none of these assumptions are uniformly valid. Often people want to know why mathematics and computers cannot be used to handle the meaningful problems of society, as opposed, let us say, to the moon boondoggle and high energy-high cost physics. The answer lies in the fact that we don't know how to describe the complex systems of society involving people, we don't understand cause and effect, which is to say the consequences of decisions, and we don't even know how to make our objectives reasonably precise. None of the requirements of classical science are met. Gradually, a new methodology for dealing with these 'fuzzy' problems is being developed, but the path is not easy." (Richard E Bellman, "Eye of the Hurricane: An Autobiography", 1984)

"One advantage of the use of fuzzy models is the fact that their complexity can be gradually increased as more information is gathered. This increase in complexity can be done automatically or manually by a careful commission of the new operating point." (Jairo Espinosa et al, "Fuzzy Logic, Identification and Predictive Control", 2005)

"Each fuzzy set is uniquely defined by a membership function. […] There are two approaches to determining a membership function. The first approach is to use the knowledge of human experts. Because fuzzy sets are often used to formulate human knowledge, membership functions represent a part of human knowledge. Usually, this approach can only give a rough formula of the membership function and fine-tuning is required. The second approach is to use data collected from various sensors to determine the membership function. Specifically, we first specify the structure of membership function and then fine-tune the parameters of membership function based on the data." (Huaguang Zhang & Derong Liu, "Fuzzy Modeling and Fuzzy Control", 2006)

"Logic is the study of methods and principles of reasoning, where reasoning means obtaining new propositions from existing propositions. In classical logic, propositions are required to be either true or false; that is, the truth value of a proposition is either 0 or 1. Fuzzy logic generalizes classical two-value logic by allowing the truth values of a proposition to be any numbers in [0, 1]. This generalization allows us to perform fuzzy reasoning, also called approximate reasoning; that is, deducing imprecise conclusions (fuzzy propositions) from a collection of imprecise premises (fuzzy propositions). In this section, we first introduce some basic concepts and principles in classical logic and then study their generalizations to fuzzy logic." (Huaguang Zhang & Derong Liu, "Fuzzy Modeling and Fuzzy Control", 2006)

"Fuzzy logic is an application area of fuzzy set theory dealing with uncertainty in reasoning. It utilizes concepts, principles, and methods developed within fuzzy set theory for formulating various forms of sound approximate reasoning. Fuzzy logic allows for set membership values to range (inclusively) between 0 and 1, and in its linguistic form, imprecise concepts like 'slightly', 'quite' and 'very'. Specifically, it allows partial membership in a set." (Larbi Esmahi et al,  Adaptive Neuro-Fuzzy Systems, 2009)

"Like classical logic, fuzzy logic uses formulas to formally represent statements about the world. Given an appropriate semantic structure (such as an evaluation of propositional symbols in the case of propositional logic, or a relational structure in the case of predicate logic), a truth degree of formula ϕ is denoted by ||ϕ||. It is significant that the truth degree ||ϕ|| of ϕ may in general be any element of the set of truth degrees. That is, formulas in fuzzy logic are true to degrees , not just true or false as in the case of classical logic." (Radim Belohlavek & George J Klir, "Concepts and Fuzzy Logic", 2011)

"Nevertheless, the use of fuzzy logic is supported by at least the following three arguments. First, fuzzy logic is rooted in the intuitively appealing idea that the truths of propositions used by humans are a matter of degree. An important consequence is that the basic principles and concepts of fuzzy logic are easily understood. Second, fuzzy logic has led to many successful applications, including many commercial products, in which the crucial part relies on representing and dealing with statements in natural language that involve vague terms. Third, fuzzy logic is a proper generalization of classical logic, follows an agenda similar to that of classical logic, and has already been highly developed. An important consequence is that fuzzy logic extends the rich realm of applications of classical logic to applications in which the bivalent character of classical logic is a limiting factor." (Radim Belohlavek & George J Klir, "Concepts and Fuzzy Logic", 2011)

"The principal idea employed by fuzzy logic is to allow for a partially ordered scale of truth-values, called also truth degrees, which contains the values representing false and true , but also some additional, intermediary truth degrees. That is, the set {0,1} of truth-values of classical logic, where 0 and 1 represent false and true , respectively, is replaced in fuzzy logic by a partially ordered scale of truth degrees with the smallest degree being 0 and the largest one being 1." (Radim Belohlavek & George J Klir, "Concepts and Fuzzy Logic", 2011)

"We use the term fuzzy logic to refer to all aspects of representing and manipulating knowledge that employ intermediary truth-values. This general, commonsense meaning of the term fuzzy logic encompasses, in particular, fuzzy sets, fuzzy relations, and formal deductive systems that admit intermediary truth-values, as well as the various methods based on them." (Radim Belohlavek & George J Klir, "Concepts and Fuzzy Logic", 2011)

Related Posts Plugin for WordPress, Blogger...

On Literature: On Revolutions (From Fiction to Science-Fiction)

"No revolution, no heresy is comfortable or easy. For it is a leap, it is a break in the smooth evolutionary curve, and a break is a wo...