20 November 2026

🪸On Systems Thinking: On Function (2010-)

"All forms of complex causation, and especially nonlinear transformations, admittedly stack the deck against prediction. Linear describes an outcome produced by one or more variables where the effect is additive. Any other interaction is nonlinear. This would include outcomes that involve step functions or phase transitions. The hard sciences routinely describe nonlinear phenomena. Making predictions about them becomes increasingly problematic when multiple variables are involved that have complex interactions. Some simple nonlinear systems can quickly become unpredictable when small variations in their inputs are introduced." (Richard N Lebow, "Forbidden Fruit: Counterfactuals and International Relations", 2010)

"Discrete dynamic systems that evolve in space and time. A cellular automaton is composed of a set of discrete elements – the cells – connected with other cells of the automaton, and in each time unit each cell receives information about the current state of the cells to which it is connected. The cellular automaton evolve according a transition rule that specifies the current possible states of each cell as a function of the preceding state of the cell and the states of the connected cells." (Francesc S. Beltran et al, "A Language Shift Simulation Based on Cellular Automata", 2011)

"Operational thinking is about mapping relationships. It is about capturing interactions, interconnections, the sequence and flow of activities, and the rules of the game. It is about how systems do what they do, or the dynamic process of using elements of the structure to produce the desired functions. In a nutshell, it is about unlocking the black box that lies between system input and system output." (Jamshid Gharajedaghi, "Systems Thinking: Managing Chaos and Complexity A Platform for Designing Business Architecture" 3rd Ed., 2011)

"Cellular automata" (henceforth: CA) are discrete, abstract computational systems that have proved useful both as general models of complexity and as more specific representations of non-linear dynamics in a variety of scientific fields. Firstly, CA are" (typically) spatially and temporally discrete: they are composed of a finite or denumerable set of homogenous, simple units, the atoms or cells. [...] Secondly, CA are abstract: they can be specified in purely mathematical terms and physical structures can implement them. Thirdly, CA are computational systems: they can compute functions and solve algorithmic problems." (Francesco Berto & Jacopo Tagliabue, "Cellular Automata", Stanford Encyclopedia of Philosophy, 2012)

"Cybernetics studies the concepts of control and communication in living organisms, machines and organizations including self-organization. It focuses on how a" (digital, mechanical or biological) system processes information, responds to it and changes or being changed for better functioning" (including control and communication)." (Dmitry A Novikov, "Cybernetics 2.0", 2016)

"Quantum theory can be thought of as the science of constructing wavefunctions and extracting predictions of measurable outcomes from them. […] The wavefunction is a little bit like a map - the best possible kind of map. It encodes all that can be said about a quantum system." (Hans C von Baeyer, "QBism: The future of quantum physics", 2016)

"Mathematics is the domain of all formal languages, and allows the expression of arbitrary statements" (most of which are uncomputable). Computation may be understood in terms of computational systems, for instance via defining states" (which are sets of discernible differences, i.e. bits), and transition functions that let us derive new states." (Joscha Bach, "The Cortical Conductor Theory: Towards Addressing Consciousness in AI Models", 2017)

🪸On Systems Thinking: On Function (2000-2009)

 

"Bounded rationality simultaneously constrains the complexity of our cognitive maps and our ability to use them to anticipate the system dynamics. Mental models in which the world is seen as a sequence of events and in which feedback, nonlinearity, time delays, and multiple consequences are lacking lead to poor performance when these elements of dynamic complexity are present. Dysfunction in complex systems can arise from the misperception of the feedback structure of the environment. But rich mental models that capture these sources of complexity cannot be used reliably to understand the dynamics. Dysfunction in complex systems can arise from faulty mental simulation-the misperception of feedback dynamics. These two different bounds on rationality must both be overcome for effective learning to occur. Perfect mental models without a simulation capability yield little insight; a calculus for reliable inferences about dynamics yields systematically erroneous results when applied to simplistic models." (John D Sterman, "Business Dynamics: Systems thinking and modeling for a complex world", 2000)

"Systems thinking expands the focus of the observer, whereas analytical thinking reduces it. In other words, analysis looks into things, synthesis looks out of them. This attitude of systems thinking is often called expansionism, an alternative to classic reductionism. Whereas analytical thinking concentrates on static and structural properties, systems thinking concentrates on the function and behaviour of whole systems. Analysis gives description and knowledge; systems thinking gives explanation and understanding." (Lars Skyttner, "General Systems Theory: Ideas and Applications", 2001)

"The function of living matter is apparently to expand the organization of the universe. Here, locally decreased entropy as a result of biological order in existing life is invalidating the effects of the second law of thermodynamics, although at the expense of increased entropy in the whole system. It is the running down of the universe that made the sun and the earth possible. It is the running down of the sun that made life and us possible." (Lars Skyttner, "General Systems Theory: Ideas and Applications", 2001)

"Probably the first clear insight into the deep nature of control […] was that it is not about pulling levers to produce intended and inexorable results. This notion of control applies only to trivial machines. It never applies to a total system that includes any kind of probabilistic element - from the weather, to people; from markets, to the political economy. No: the characteristic of a non-trivial system that is under control, is that despite dealing with variables too many to count, too uncertain to express, and too difficult even to understand, something can be done to generate a predictable goal. Wiener found just the word he wanted in the operation of the long ships of ancient Greece. At sea, the long ships battled with rain, wind and tides - matters in no way predictable. However, if the man operating the rudder kept his eye on a distant lighthouse, he could manipulate the tiller, adjusting continuously in real-time towards the light. This is the function of steersmanship. As far back as Homer, the Greek word for steersman was kubernetes, which transliterates into English as cybernetes." (Stafford Beer, "What is cybernetics?", Kybernetes, 2002)

"Systems thinking means the ability to see the synergy of the whole rather than just the separate elements of a system and to learn to reinforce or change whole system patterns. Many people have been trained to solve problems by breaking a complex system, such as an organization, into discrete parts and working to make each part perform as well as possible. However, the success of each piece does not add up to the success of the whole. to the success of the whole. In fact, sometimes changing one part to make it better actually makes the whole system function less effectively." (Richard L Daft, "The Leadership Experience", 2002)

"The function performed by a System is not operationally identical to the function of the same name performed by a person. In general, a function performed by a larger System is not operationally identical to the function of the same name as performed by a smaller System." (John Gall, "Systemantics: The Systems Bible", 2002)

"A self-organizing system not only regulates or adapts its behavior, it creates its own organization. In that respect it differs fundamentally from our present systems, which are created by their designer. We define organization as structure with function. Structure means that the components of a system are arranged in a particular order. It requires both connections, that integrate the parts into a whole, and separations that differentiate subsystems, so as to avoid interference. Function means that this structure fulfils a purpose." (Francis Heylighen & Carlos Gershenson, "The Meaning of Self-organization in Computing", IEEE Intelligent Systems, 2003)

"When defining living systems, the term dynamic equilibrium is essential. It does not imply something which is steady or stable. On the contrary, it is a floating state characterized by invisible movements and preparedness for change. To be in dynamic equilibrium is adapting adjustment to balance. Homeostasis stands for the sum of all control functions creating the state of dynamic equilibrium in a healthy organism. It is the ability of the body to maintain a narrow range of internal conditions in spite of environmental changes." (Lars Skyttner, "General Systems Theory: Problems, Perspective, Practice", 2005)

"A system described as self-organizing is one in which elements interact in order to achieve dynamically a global function or behavior." (Carlos Gershenson, "A general methodology for designing self-organizing systems", 2006)

"An ecology provides the special formations needed by organizations. Ecologies are: loose, free, dynamic, adaptable, messy, and chaotic. Innovation does not arise through hierarchies. As a function of creativity, innovation requires trust, openness, and a spirit of experimentation - where random ideas and thoughts can collide for re-creation." (George Siemens, "Knowing Knowledge", 2006)

"A great deal of the results in many areas of physics are presented in the form of conservation laws, stating that some quantities do not change during evolution of the system. However, the formulations in cybernetical physics are different. Since the results in cybernetical physics establish how the evolution of the system can be changed by control, they should be formulated as transformation laws, specifying the classes of changes in the evolution of the system attainable by control function from the given class, i.e., specifying the limits of control." (Alexander L Fradkov, "Cybernetical Physics: From Control of Chaos to Quantum Control", 2007)

"In engineering, a self-organizing system would be one in which elements are designed to dynamically and autonomously solve a problem or perform a function at the system level. In other words, the engineer will not build a system to perform a function explicitly, but elements will be engineered in such a way that their behaviour and interactions will lead to the system function. Thus, the elements need to divide, but also to integrate, the problem." (Carlos Gershenson, "Design and Control of Self-organizing Systems", 2007)

"We have to be aware that even in mathematical and physical models of self-organizing systems, it is the observer who ascribes properties, aspects, states, and probabilities; and therefore entropy or order to the system. But organization is more than low entropy: it is structure that has a function or purpose." (Carlos Gershenson, "Design and Control of Self-organizing Systems", 2007)

"[…] in cybernetics, control is seen not as a function of one agent over something else, but as residing within circular causal networks, maintaining stabilities in a system. Circularities have no beginning, no end and no asymmetries. The control metaphor of communication, by contrast, punctuates this circularity unevenly. It privileges the conceptions and actions of a designated controller by distinguishing between messages sent in order to cause desired effects and feedback that informs the controller of successes or failures." (Klaus Krippendorff, "On Communicating: Otherness, Meaning, and Information", 2009)

"Generally, these programs fall within the techniques of reinforcement learning and the majority use an algorithm of temporal difference learning. In essence, this computer learning paradigm approximates the future state of the system as a function of the present state. To reach that future state, it uses a neural network that changes the weight of its parameters as it learns." (Diego Rasskin-Gutman, "Chess Metaphors: Artificial Intelligence and the Human Mind", 2009)

17 November 2026

🪸On Systems Thinking: On Function (1990-1999)

"An artificial neural network is an information-processing system that has certain performance characteristics in common with biological neural networks. Artificial neural networks have been developed as generalizations of mathematical models of human cognition or neural biology, based on the assumptions that: 1. Information processing occurs at many simple elements called neurons. 2. Signals are passed between neurons over connection links. 3. Each connection link has an associated weight, which, in a typical neural net, multiplies the signal transmitted. 4. Each neuron applies an activation function" (usually nonlinear) to its net input" (sum of weighted input signals) to determine its output signal." (Laurene Fausett, "Fundamentals of Neural Networks", 1994)

"It [Living Systems Theory (LST)] involves observing and measuring important relationships between inputs and outputs of the total system and identifying the structures that perform each of the [20] sub‐system processes. […] The flows of relevant matter, energy, and information through the system and the adjustment processes of subsystems and the total system are also examined. The status and function of the system are analyzed and compared with what is average or normal for that type of system. If the system is experiencing a disturbance in some steady state, an effort is made to discover the source of the strain and correct it." (James G Miller & Jessie L Miller, "Applications of living systems theory", Systemic Practice and Action Research 8, 1995)

"Self-organization refers to the spontaneous formation of patterns and pattern change in open, nonequilibrium systems. […] Self-organization provides a paradigm for behavior and cognition, as well as the structure and function of the nervous system. In contrast to a computer, which requires particular programs to produce particular results, the tendency for self-organization is intrinsic to natural systems under certain conditions." (J A Scott Kelso, "Dynamic Patterns : The Self-organization of Brain and Behavior", 1995)

"The reason catastrophe theory can tell us about such abrupt changes in a system's behavior is that we usually observe a dynamical system when it's at or near its steady-state, or equilibrium, position. And under various assumptions about the nature of the system's dynamical law of motion, the set of all possible equilibrium states is simply the set of critical points of a smooth function closely related to the system dynamics. When these critical points are nondegenerate, Morse's Theorem applies. But it is exactly when they become degenerate that the system can move sharply from one equilibrium position to another. The Thorn Classification Theorem tells when such shifts will occur and what direction they will take." (John L Casti, "Five Golden Rules", 1995)

"A new level of organization means a simplification of system function, and of the corresponding system structure, it also means the initiation of a process of progressive structural and functional complexification." (Ervin László, Evolution: The general theory", 1996)

"All systems evolve, although the rates of evolution may vary over time both between and within systems. The rate of evolution is a function of both the inherent stability of the system and changing environmental circumstances. But no system can be stabilized forever. For the universe as a whole, an isolated system, time’s arrow points toward greater and greater breakdown, leading to complete molecular chaos, maximum entropy, and heat death. For open systems, including the living systems that are of major interest to us and that interchange matter and energy with their external environments, time’s arrow points to evolution toward greater and greater complexity. Thus, the universe consists of islands of increasing order in a sea of decreasing order. Open systems evolve and maintain structure by exporting entropy to their external environments." (L Douglas Kiel, "Chaos Theory in the Social Sciences: Foundations and Applications", 1996)

"By irreducibly complex I mean a single system composed of several well-matched, interacting parts that contribute to the basic function, wherein the removal of any one of the parts causes the system to effectively cease functioning. An irreducibly complex system cannot be produced directly" (that is, by continuously improving the initial function, which continues to work by the same mechanism) by slight, successive modification of a precursor, system, because any precursors to an irreducibly complex system that is missing a part is by definition nonfunctional." (Michael Behe, "Darwin’s Black Box", 1996)

"Contrary to what happens at equilibrium, or near equilibrium, systems far from equilibrium do not conform to any minimum principle that is valid for functions of free energy or entropy production." (Ilya Prigogine, "The End of Certainty: Time, Chaos, and the New Laws of Nature", 1996)

"Fuzzy systems are excellent tools for representing heuristic, commonsense rules. Fuzzy inference methods apply these rules to data and infer a solution. Neural networks are very efficient at learning heuristics from data. They are 'good problem solvers' when past data are available. Both fuzzy systems and neural networks are universal approximators in a sense, that is, for a given continuous objective function there will be a fuzzy system and a neural network which approximate it to any degree of accuracy." (Nikola K Kasabov, "Foundations of Neural Networks, Fuzzy Systems, and Knowledge Engineering", 1996)

"Analysis of a system reveals its structure and how it works. It provides the knowledge required to make it work efficiently and to repair it when it stops working. Its product is know-how, knowledge, not understanding. To enable a system to perform effectively we must understand it - we must be able to explain its behavior - and this requires being aware of its functions in the larger systems of which it is a part." (Russell L Ackoff, "Re-Creating the Corporation", 1999)

"Cybernetics is the science of effective organization, of control and communication in animals and machines. It is the art of steersmanship, of regulation and stability. The concern here is with function, not construction, in providing regular and reproducible behaviour in the presence of disturbances. Here the emphasis is on families of solutions, ways of arranging matters that can apply to all forms of systems, whatever the material or design employed. [...] This science concerns the effects of inputs on outputs, but in the sense that the output state is desired to be constant or predictable – we wish the system to maintain an equilibrium state. It is applicable mostly to complex systems and to coupled systems, and uses the concepts of feedback and transformations" (mappings from input to output) to effect the desired invariance or stability in the result." (Chris Lucas, "Cybernetics and Stochastic Systems", 1999)

"From a functional point of view, mental models can be described as symbolic structures which permit people: to generate descriptions of the purpose of a system, to generate descriptions of the architecture of a system, to provide explanations of the state of a system, to provide explanations of the functioning of a system, to make predictions of future states of a system." (Gert Rickheit & Lorenz Sichelschmidt, "Mental Models: Some Answers, Some Questions, Some Suggestions", 1999)

🪸On Systems Thinking: On Function (1980-1989)

"A system is an internally organised whole where elements are so intimately connected that they operate as one in relation to external conditions and other systems. An element may be defined as the minimal unit performing a definite function in the whole. Systems may be either simple or complex. A complex system is one whose elements may also be regarded as systems or subsystems." (Alexander Spirkin, "Dialectical Materialism", 1983) 

"All environmental areas, from the primeval forest to the large city, can be regarded as ecosystems and investigated accordingly, most of the attention being given to the lasting existence and functioning or 'equilibrium' of these systems." (Wolfgang Haber, Universitas: A Quarterly German Review of the Arts and Sciences Vol.26 (2), 1984)

"Any approach to the study of organizations is built on specific assumptions about the nature of organizations and how they are designed and function." (Richard L Daft & Karl E Weick, "Toward a model of organizations as interpretation systems", Academy of Management Review Vol 9 (2), 1984)

"Nature is disordered, powerful and chaotic, and through fear of the chaos we impose system on it. We abhor complexity, and seek to simplify things whenever we can by whatever means we have at hand. We need to have an overall explanation of what the universe is and how it functions. In order to achieve this overall view we develop explanatory theories which will give structure to natural phenomena: we classify nature into a coherent system which appears to do what we say it does." (James Burke,"The Day the Universe Changed", 1985)

"Mental models are the mechanisms whereby humans are able to generate descriptions of system purpose and form, explanations of system functioning and observed system states, and predictions of future system states." (William B Rouse & Nancy M Morris, "On looking into the black box: Prospects and limits in the search for mental models", Psychological Bulletin" (3), 1986)

"The system always kicks back. - Systems get in the way - or, in slightly more elegant language: Systems tend to oppose their own proper functions. Systems tend to malfunction conspicuously just after their greatest triumph." (John Gall, "Systemantics: The underground text of systems lore", 1986)

"In cybernetics a system is normally described as a black box whereby the whole of a system's generative mechanisms are lumped into a single transfer function" (TF). This acts on an input to produce an output. To ensure that the output is monitored, so that a system may remain homeostatic" (the critical variables remain within acceptable limits) or attain a new steady state" (according to input decisions, say), the output of the TF is brought back into its input where the difference between the desired and actual levels is identified. This is known as feedback." (Robert L Flood & Ewart R Carson, "Dealing with Complexity: An introduction to the theory and application of systems", 1988)

13 November 2026

🅣On Alan M Turing - Historical Perspectives

"In 1936 the notion of a computable function was clarified by Turing, and he showed the existence of universal computers that, with an appropriate program, could compute anything computed by any other computer." (John McCarthy, "Towards a Mathematical Science of Computation", 1962)

"Turing had a strong predeliction for working things out from first principles, usually in the first instance without consulting any previous work on the subject, and no doubt it was this habit which gave his work that characteristically original flavor." (James H Wilkinson,"Some Comments from a Numerical Analyst", 1971)

"When taken as a way of modeling cognitive architecture, connectionism really does represent an approach that is quite different from that of the classical cognitive science that it seeks to replace. Classical models of the mind were derived from the structure of Turing and Von Neumann machines. They are not, of course, committed to the details of these machines as exemplified in Turing's original formulation or in typical commercial computers - only to the basic idea that the kind of computing that is relevant to understanding cognition involves operations on symbols." (Zenon Pylyshyn et al. "Connectionism and cognitive architecture: A critical analysis", Cognition 28 1988)

"A large part of Turing's genius was to show that the very primitive type of abstract computing machine he invented is actually the most general type of computer imaginable. In fact, every real-life computer that's ever been built is just a special case that materially embodies the machine that Turing dreamed up." (John L Casti, "Mathematical Mountaintops: The Five Most Famous Problems of All Time", 2001)

"So in the end it wasn't Gödel, it wasn't Turing, and it wasn't my results that are making mathematics go into an experimental mathematics direction, in a quasi-empirical direction. The reason why mathematicians are changing their working habits is the computer. I think that this is an excellent joke!" (Gregory Chaitin," Thinking about Godel and Turing: Essays on Complexity, 1970-2007", 2007)

"Although I'm not prepared to move up my prediction of a computer passing the Turing test by 2029, the progress that has been achieved in systems like Watson should give anyone substantial confidence that the advent of Turing-level AI is close at hand. If one were to create a version of Watson that was optimized for the Turing test, it would probably come pretty close." (Ray Kurzweil,"How to Create a Mind: The Secret of Human Thought Revealed", Penguin, 2012)

"The Turing machine (which was hypothetical at the time) didn’t provide a universal algorithm for all mathematical problems; in fact, Turing proved that no such algorithm exists. However, it did help lay the foundation for how the modern computer would work. Most notably, Turing introduced the concept of a universal computing machine - a theoretical device capable of performing any logical operation that can be expressed algorithmically." (Robert Barton & Jerome Henry, "Demystifying Generative AI A Practical and Intuitive Introduction", 2026)


02 November 2026

🅼Michel de Montaigne - Collected Quotes

"It is the sharpness of our mind that gives the edge to our pains and pleasures." (Michel de Montaigne, "Essais", 1580

"Our wisdom and deliberation for the most part follow the lead of chance." (Michel de Montaigne, "Essays", 1580)

"The sciences and arts are not cast in a mold, but formed and shaped little by little, by repeated handling and polishing, as bears lick their cubs into shape at leisure." (Michel de Montaigne, "Essays", 1580)

"Almost all the opinions we have are taken on authority and on credit." (Michel de Montaigne, "De la phisionomie" ["Of Physiognomy"], 1588)

"In this present that God has made us, there is nothing unworthy our care; we stand accountable for it even to a hair; and is it not a commission to man, to conduct man according to his condition; 'tis express, plain, and the very principal one, and the Creator has seriously and strictly prescribed it to us. Authority has power only to work in regard to matters of common judgment, and is of more weight in a foreign language; therefore let us again charge at it in this place." (Michel de Montaigne, "Essais" Book III, 1595)

"There never was in the world two opinions alike, no more than two hairs or two grains; the most universal quality is diversity." (Michel de Montaigne, "Essais", 1595)

Related Posts Plugin for WordPress, Blogger...

🪸On Systems Thinking: On Function (2010-)

"All forms of complex causation, and especially nonlinear transformations, admittedly stack the deck against prediction. Linear describ...