On Linearity II

"Why are nonlinear systems so much harder to analyze than linear ones? The essential difference is that linear systems can be broken down into parts. Then each part can be solved separately and finally recombined to get the answer. This idea allows a fantastic simplification of complex problems, and underlies such methods as normal modes, Laplace transforms, superposition arguments, and Fourier analysis. In this sense, a linear system is precisely equal to the sum of its parts." (Steven H Strogatz, "Non-Linear Dynamics and Chaos, 1994)

"When we examine the modeling literature, its most striking aspect is the predominance of 'flat' linear models. Why is this the case? After all, from a singularity theory viewpoint these linear objects are mathematical rarities. On mathematical grounds we should certainly not expect to see them put forth as credible representations of reality. Yet they are. And the reason is simple: linearity is a neutral assumption that leads to mathematically tractable models. So unless there is good reason to do otherwise, why not use a linear model?"  (John L Casti, "Five Golden Rules", 1995)

"In a linear system a tiny push produces a small effect, so that cause and effect are always proportional to each other. If one plotted on a graph the cause against the effect, the result would be a straight line. In nonlinear systems, however, a small push may produce a small effect, a slightly larger push produces a proportionately larger effect, but increase that push by a hair’s breadth and suddenly the system does something radically different." (F David Peat, "From Certainty to Uncertainty", 2002)

"Linearity means that the rule that determines what a piece of a system is going to do next is not influenced by what it is doing now. More precisely, this is intended in a differential or incremental sense: For a linear spring, the increase of its tension is proportional to the increment whereby it is stretched, with the ratio of these increments exactly independent of how much it has already been stretched. Such a spring can be stretched arbitrarily far, and in particular will never snap or break. Accordingly, no real spring is linear." (Heinz-Otto Peitgen et al, "Chaos and Fractals: New Frontiers of Science" 2nd Ed., 2004) 

"Most long-range forecasts of what is technically feasible in future time periods dramatically underestimate the power of future developments because they are based on what I call the 'intuitive linear' view of history rather than the 'historical exponential' view." (Ray Kurzweil, "The Singularity is Near", 2005)

"Linear systems do not benefit from noise because the output of a linear system is just a simple scaled version of the input [...] Put noise in a linear system and you get out noise. Sometimes you get out a lot more noise than you put in. This can produce explosive effects in feedback systems that take their own outputs as inputs." (Bart Kosko, "Noise", 2006)

"On a linear system like a scale, the whole is equal to the sum of the parts. That’s the first key property of linearity. The second is that causes are proportional to effects. […] These two properties - the proportionality between cause and effect, and the equality of the whole to the sum of the parts - are the essence of what it means to be linear. […] The great advantage of linearity is that it allows for reductionist thinking. To solve a linear problem, we can break it down to its simplest parts, solve each part separately, and put the parts back together to get the answer." (Steven H Strogatz, "Infinite Powers: The Story of Calculus - The Most Important Discovery in Mathematics", 2019)

"[...] perhaps one of the most important features of complex systems, which is a key differentiator when comparing with chaotic systems, is the concept of emergence. Emergence 'breaks' the notion of determinism and linearity because it means that the outcome of these interactions is naturally unpredictable. In large systems, macro features often emerge in ways that cannot be traced back to any particular event or agent. Therefore, complexity theory is based on interaction, emergence and iterations." (Luis Tomé & Şuay Nilhan Açıkalın, "Complexity Theory as a New Lens in IR: System and Change" [in "Chaos, Complexity and Leadership 2017", Şefika Şule Erçetin & Nihan Potas], 2019)

"With a linear growth of errors, improving the measurements could always keep pace with the desire for longer prediction. But when errors grow exponentially fast, a system is said to have sensitive dependence on its initial conditions. Then long-term prediction becomes impossible. This is the philosophically disturbing message of chaos." (Steven H Strogatz, "Infinite Powers: The Story of Calculus - The Most Important Discovery in Mathematics", 2019)

On Nonlinearity VI

"Up until now most economists have concerned themselves with linear systems, not because of any belief that the facts were so simple, but rather because of the mathematical difficulties involved in nonlinear systems [... Linear systems are] mathematically simple, and exact solutions are known. But a high price is paid for this simplicity in terms of special assumptions which must be made." (Paul A Samuelson, "Foundations of Economic Analysis", 1966)

"Linear relationships are easy to think about: the more the merrier. Linear equations are solvable, which makes them suitable for textbooks. Linear systems have an important modular virtue: you can take them apart and put them together again - the pieces add up. Nonlinear systems generally cannot be solved and cannot be added together. [...] Nonlinearity means that the act of playing the game has a way of changing the rules. [...] That twisted changeability makes nonlinearity hard to calculate, but it also creates rich kinds of behavior that never occur in linear systems." (James Gleick, "Chaos: Making a New Science", 1987)

"Never in the annals of science and engineering has there been a phenomenon so ubiquitous‚ a paradigm so universal‚ or a discipline so multidisciplinary as that of chaos. Yet chaos represents only the tip of an awesome iceberg‚ for beneath it lies a much finer structure of immense complexity‚ a geometric labyrinth of endless convolutions‚ and a surreal landscape of enchanting beauty. The bedrock which anchors these local and global bifurcation terrains is the omnipresent nonlinearity that was once wantonly linearized by the engineers and applied scientists of yore‚ thereby forfeiting their only chance to grapple with reality." (Leon O Chua, "Editorial", International Journal of Bifurcation and Chaos, Vol. l (1), 1991) 

"It remains an unhappy fact that there is no best method for finding the solution to general nonlinear optimization problems. About the best general procedure yet devised is one that relies upon imbedding the original problem within a family of problems, and then developing relations linking one member of the family to another. If this can be done adroitly so that one family member is easily solvable, then these relations can be used to step forward from the solution of the easy problem to that of the original problem. This is the key idea underlying dynamic programming, the most flexible and powerful of all optimization methods." (John L Casti, "Five Golden Rules", 1995)

"When it comes to modeling processes that are manifestly governed by nonlinear relationships among the system components, we can appeal to the same general idea. Calculus tells us that we should expect most systems to be 'locally' flat; that is, locally linear. So a conservative modeler would try to extend the word 'local' to hold for the region of interest and would take this extension seriously until it was shown to be no longer valid." (John L Casti, "Five Golden Rules", 1995)

"A system at a bifurcation point, when pushed slightly, may begin to oscillate. Or the system may flutter around for a time and then revert to its normal, stable behavior. Or, alternatively it may move into chaos. Knowing a system within one range of circumstances may offer no clue as to how it will react in others. Nonlinear systems always hold surprises." (F David Peat, "From Certainty to Uncertainty", 2002)

"In a linear system a tiny push produces a small effect, so that cause and effect are always proportional to each other. If one plotted on a graph the cause against the effect, the result would be a straight line. In nonlinear systems, however, a small push may produce a small effect, a slightly larger push produces a proportionately larger effect, but increase that push by a hair’s breadth and suddenly the system does something radically different." (F David Peat, "From Certainty to Uncertainty", 2002)

"Complex systems are full of interdependencies - hard to detect - and nonlinear responses." (Nassim N Taleb, "Antifragile: Things That Gain from Disorder", 2012)

Catastrophe Theory III

"On the plane of philosophy properly speaking, of metaphysics, catastrophe theory cannot, to be sure, supply any answer to the great problems which torment mankind. But it favors a dialectical, Heraclitean view of the universe, of a world which is the continual theatre of the battle between 'logoi', between archetypes." (René F Thom, "Catastrophe Theory: Its Present State and Future Perspectives", 1975)

"At the large scale where many processes and structures appear continuous and stable much of the time, important changes may occur discontinuously. When only a few variables are involved, as well as an optimizing process, the event may be analyzed using catastrophe theory. As the number of variables in- creases the bifurcations can become more complex to the point where chaos theory becomes the relevant approach. That chaos theory as well as the fundamentally discontinuous quantum processes may be viewed through fractal eyeglasses can also be admitted. We can even argue that a cascade of bifurcations to chaos contains two essentially structural catastrophe points, namely the initial bifurcation point at which the cascade commences and the accumulation point at which the transition to chaos is finally achieved." (J Barkley Rosser Jr., "From Catastrophe to Chaos: A General Theory of Economic Discontinuities", 1991)

"Catastrophe theory is a local theory, telling us what a function looks like  in a small neighborhood of a critical point; it says nothing about what the function may be doing far away from the singularity. Yet most of the applications of the theory [...]  involve extrapolating these rock-solid, local results to regions that may  well be distant in time and space from the singularity." (John L Casti, "Five Golden Rules", 1995)

"Chaos and catastrophe theories are among the most interesting recent developments in nonlinear modeling, and both have captured the interests of scientists in many disciplines. It is only natural that social scientists should be concerned with these theories. Linear statistical models have proven very useful in a great deal of social scientific empirical analyses, as is evidenced by how widely these models have been used for a number of decades. However, there is no apparent reason, intuitive or otherwise, as to why human behavior should be more linear than the behavior of other things, living and nonliving. Thus an intellectual movement toward nonlinear models is an appropriate evolutionary movement in social scientific thinking, if for no other reason than to expand our paradigmatic boundaries by encouraging greater flexibility in our algebraic specifications of all aspects of human life." (Courtney Brown, "Chaos and Catastrophe Theories", 1995)

"[...] chaos and catastrophe theories per se address behavioral phenomena that are consequences of two general types of nonlinear dynamic behavior. In the most elementary of behavioral terms, chaotic phenomena are a class of deterministic processes that seem to mimic random or stochastic dynamics. Catastrophe phenomena, on the other hand, are a class of dynamic processes that exhibit a sudden and large scale change in at least one variable in correspondence with relatively small changes in other variables or, in some cases, parameters." (Courtney Brown, "Chaos and Catastrophe Theories", 1995)

"Chaos and catastrophe theories directly address the social scientists' need to understand classes of nonlinear complexities that are certain to appear in social phenomena. The probabilistic properties of many chaos and catastrophe models are simply not known, and there is little likelihood that general procedures will be developed soon to alleviate the difficulties inherent with probabilistic approaches in such complicated settings." (Courtney Brown, "Chaos and Catastrophe Theories", 1995)

"Fundamental to catastrophe theory is the idea of a bifurcation. A bifurcation is an event that occurs in the evolution of a dynamic system in which the characteristic behavior of the system is transformed. This occurs when an attractor in the system changes in response to change in the value of a parameter. A catastrophe is one type of bifurcation. The broader framework within which catastrophes are located is called dynamical bifurcation theory." (Courtney Brown, "Chaos and Catastrophe Theories", 1995)

"Probably the most important reason that catastrophe theory received as much popular press as it did in the mid-1970s is not because of its unchallenged mathematical elegance, but because it appears to offer a coherent mathematical framework within which to talk about how discontinuous behaviors - stock market booms and busts or cellular differentiation, for instance - might emerge as the result of smooth changes in the inputs to a system, things like interest rates in a speculative market or the diffusion rate of chemicals in a developing embryo. These kinds of changes are often termed bifurcations, and playa central role in applied mathematical modeling. Catastrophe theory enables us to understand more clearly how - and why - they occur." (John L Casti, "Five Golden Rules", 1995)

"The goal of catastrophe theory is to classify smooth functions with degenerate critical points, just as Morse's Theorem gives us a complete classification for Morse functions. The difficulty, of course, is that there are a lot more ways for critical points to 'go bad' than there are for them to stay 'nice'. Thus, the classification problem is much harder for functions having degenerate critical points, and has not yet been fully carried out for all possible types of degeneracies. Fortunately, though, we can obtain a partial classification for those functions having critical points that are not too bad. And this classification turns out to be sufficient to apply the results to a wide range of phenomena like the predator-prey situation sketched above, in which 'jumps' in the system's biomass can occur when parameters describing the process change only slightly." (John L Casti, "Five Golden Rules", 1995)

"The reason catastrophe theory can tell us about such abrupt changes in a system's behavior is that we usually observe a dynamical system when it's at or near its steady-state, or equilibrium, position. And under various assumptions about the nature of the system's dynamical law of motion, the set of all possible equilibrium states is simply the set of critical points of a smooth function closely related to the system dynamics. When these critical points are nondegenerate, Morse's Theorem applies. But it is exactly when they become degenerate that the system can move sharply from one equilibrium position to another. The Thorn Classification Theorem tells when such shifts will occur and what direction they will take." (John L Casti, "Five Golden Rules", 1995)

On Chaos IV

"One of the central problems studied by mankind is the problem of the succession of form. Whatever is the ultimate nature of reality (assuming that this expression has meaning), it is indisputable that our universe is not chaos. We perceive beings, objects, things to which we give names. These beings or things are forms or structures endowed with a degree of stability; they take up some part of space and last for some period of time." (René Thom, "Structural Stability and Morphogenesis", 1972)

"'Disorder' is not mere chaos; it implies defective order." (John M Ziman, "Models of Disorder", 1979)

"Chaos and catastrophe theories are among the most interesting recent developments in nonlinear modeling, and both have captured the interests of scientists in many disciplines. It is only natural that social scientists should be concerned with these theories. Linear statistical models have proven very useful in a great deal of social scientific empirical analyses, as is evidenced by how widely these models have been used for a number of decades. However, there is no apparent reason, intuitive or otherwise, as to why human behavior should be more linear than the behavior of other things, living and nonliving. Thus an intellectual movement toward nonlinear models is an appropriate evolutionary movement in social scientific thinking, if for no other reason than to expand our paradigmatic boundaries by encouraging greater flexibility in our algebraic specifications of all aspects of human life." (Courtney Brown, "Chaos and Catastrophe Theories", 1995)

"[...] chaos and catastrophe theories per se address behavioral phenomena that are consequences of two general types of nonlinear dynamic behavior. In the most elementary of behavioral terms, chaotic phenomena are a class of deterministic processes that seem to mimic random or stochastic dynamics. Catastrophe phenomena, on the other hand, are a class of dynamic processes that exhibit a sudden and large scale change in at least one variable in correspondence with relatively small changes in other variables or, in some cases, parameters." (Courtney Brown, "Chaos and Catastrophe Theories", 1995)

"Nature normally hates power laws. In ordinary systems all quantities follow bell curves, and correlations decay rapidly, obeying exponential laws. But all that changes if the system is forced to undergo a phase transition. Then power laws emerge-nature's unmistakable sign that chaos is departing in favor of order. The theory of phase transitions told us loud and clear that the road from disorder to order is maintained by the powerful forces of self-organization and is paved by power laws. It told us that power laws are not just another way of characterizing a system's behavior. They are the patent signatures of self-organization in complex systems." (Albert-László Barabási, "Linked: How Everything Is Connected to Everything Else and What It Means for Business, Science, and Everyday Life", 2002)

"Chaos is not pure disorder, it carries within itself the indistinctness between the potentialities of order, of disorder, and of organization from which a cosmos will be born, which is an ordered universe." (Edgar Morin, "Restricted Complexity, General Complexity" [in (Carlos Gershenson et al [Eds.], "Worldviews, Science and Us: Philosophy and Complexity", 2007)])

"Chaos can be understood as a dynamical process in which microscopic information hidden in the details of a system’s state is dug out and expanded to a macroscopically visible scale (stretching), while the macroscopic information visible in the current system’s state is continuously discarded (folding)." (Hiroki Sayama, "Introduction to the Modeling and Analysis of Complex Systems", 2015)

"God has put a secret art into the forces of Nature so as to enable it to fashion itself out of chaos into a perfect world system." (Immanuel Kant)

"Science, like art, music and poetry, tries to reduce chaos to the clarity and order of pure beauty." (Detlev W Bronk)

George B Dantzig - Collected Quotes

 "All such problems can be formulated as mathematical programming problems. Naturally, we can propose many sophisticated algorithms and a theory but the final test of a theory is its capacity to solve the problems which originated it." (George B Dantzig, "Linear Programming and Extensions", 1963)

"If the system exhibits a structure which can be represented by a mathematical equivalent, called a mathematical model, and if the objective can be also so quantified, then some computational method may be evolved for choosing the best schedule of actions among alternatives. Such use of mathematical models is termed mathematical programming." (George B Dantzig, "Linear Programming and Extensions", 1963)

"Linear programming is viewed as a revolutionary development giving man the ability to state general objectives and to find, by means of the simplex method, optimal policy decisions for a broad class of practical decision problems of great complexity. In the real world, planning tends to be ad hoc because of the many special-interest groups with their multiple objectives." (George B Dantzig, "Mathematical Programming: The state of the art", 1983)

"Linear programming and its generalization, mathematical programming, can be viewed as part of a great revolutionary development that has given mankind the ability to state general goals and lay out a path of detailed decisions to be taken in order to 'best' achieve these goals when faced with practical situations of great complexity. The tools for accomplishing this are the models that formulate real-world problems in detailed mathematical terms, the algorithms that solve the models, and the software that execute the algorithms on computers based on the mathematical theory."  (George B Dantzig & Mukund N Thapa, "Linear Programming" Vol I, 1997)

"Linear programming is concerned with the maximization or minimization of a linear objective function in many variables subject to linear equality and inequality constraints."  (George B Dantzig & Mukund N Thapa, "Linear Programming" Vol I, 1997)

"Mathematical programming (or optimization theory) is that branch of mathematics dealing with techniques for maximizing or minimizing an objective function subject to linear, nonlinear, and integer constraints on the variables."  (George B Dantzig & Mukund N Thapa, "Linear Programming" Vol I, 1997)

"Models of the real world are not always easy to formulate because of the richness, variety, and ambiguity that exists in the real world or because of our ambiguous understanding of it." (George B Dantzig & Mukund N Thapa, "Linear Programming" Vol I, 1997)

"The linear programming problem is to determine the values of the variables of the system that (a) are nonnegative or satisfy certain bounds, (b) satisfy a system  of linear constraints, and (c) minimize or maximize a linear form in the variables called an objective." (George B Dantzig & Mukund N Thapa, "Linear Programming" Vol I, 1997)

On Economics V (Ecology I)

"[…] for as all organic beings are striving, it may be said, to seize on each place in the economy of nature, if any one species does not become modified and improved in a corresponding degree with its competitors, it will soon be exterminated." (Charles Darwin, "On the Origin of Species", 1859)

"By ecology we mean the body of knowledge concerning the economy of nature - the investigation of the total relations of the animal both to its inorganic and to its organic environment; including, above all, its friendly and inimical relations with those animals and plants with which it comes directly or indirectly into contact - in a word, ecology is the study of all those complex interrelations referred to by Darwin as the conditions of the struggle for existence." (Ernst Haeckel, [lecture] 1869)

"The world is a complex, interconnected, finite, ecological–social–psychological–economic system. We treat it as if it were not, as if it were divisible, separable, simple, and infinite. Our persistent, intractable global problems arise directly from this mismatch." (Donella Meadows,"Whole Earth Models and Systems", 1982)

"Ecological Economics studies the ecology of humans and the economy of nature, the web of interconnections uniting the economic subsystem to the global ecosystem of which it is a part." (Robert Costanza, "Ecological Economics: the science and management of sustainability", 1992)

"When the study of the household (ecology) and the management of the household (economics) can be merged, and when ethics can be extended to include environmental as well as human values, then we can be optimistic about the future of humankind. Accordingly, bringing together these three 'E's' is the ultimate holism and the great challenge for our future." (Eugene Odum," Ecology and our endangered life-support systems", 1993)

"Economics emphasizes competition, expansion, and domination; ecology emphasizes cooperation, conservation, and partnership. (Fritjof Capra, "The Web of Life", 1996)

"A major clash between economics and ecology derives from the fact that nature is cyclical, whereas our industrial systems are linear. Our businesses take resources, transform them into products plus waste, and sell the products to consumers, who discard more waste […]" (Fritjof Capra, "The Web of Life", 1996)

"The answers to the human problems of ecology are to be found in economy. And the answers to the problems of economy are to be found in culture and character. To fail to see this is to go on dividing the world falsely between guilty producers and innocent consumers." (Wendell Berry, "What Are People For?: Essays", 2010)

"Economists don't seem to have noticed that the economy sits entirely within the ecology." (Carl Safina, "The View from Lazy Point: A Natural Year in an Unnatural World", 2011)

On Nonlinearity III

"Finite systems of deterministic ordinary nonlinear differential equations may be designed to represent forced dissipative hydrodynamic flow. Solutions of these equations can be identified with trajectories in phase space. For those systems with bounded solutions, it is found that nonperiodic solutions are ordinarily unstable with respect to small modifications, so that slightly differing initial states can evolve into considerably different states. Systems with bounded solutions are shown to possess bounded numerical solutions. (Edward N Lorenz, "Deterministic Nonperiodic Flow", Journal of the Atmospheric Science 20, 1963)

"We've seen that even in the simplest situations nonlinearities can interfere with a linear approach to aggregates. That point holds in general: nonlinear interactions almost always make the behavior of the aggregate more complicated than would be predicted by summing or averaging." (Lewis Mumford, "The Myth of the Machine" Vol 1, 1967)

"The structure of a complex system is not a simple feedback loop where one system state dominates the behavior. The complex system has a multiplicity of interacting feedback loops. Its internal rates of flow are controlled by non‐linear relationships. The complex system is of high order, meaning that there are many system states (or levels). It usually contains positive‐feedback loops describing growth processes as well as negative, goal‐seeking loops." (Jay F Forrester, "Urban Dynamics", 1969)

"I would therefore urge that people be introduced to [the logistic equation] early in their mathematical education. This equation can be studied phenomenologically by iterating it on a calculator, or even by hand. Its study does not involve as much conceptual sophistication as does elementary calculus. Such study would greatly enrich the student’s intuition about nonlinear systems. Not only in research but also in the everyday world of politics and economics, we would all be better off if more people realized that simple nonlinear systems do not necessarily possess simple dynamical properties." (Robert M May, "Simple Mathematical Models with Very Complicated Dynamics", Nature Vol. 261 (5560), 1976)

"Most physical systems, particularly those complex ones, are extremely difficult to model by an accurate and precise mathematical formula or equation due to the complexity of the system structure, nonlinearity, uncertainty, randomness, etc. Therefore, approximate modeling is often necessary and practical in real-world applications. Intuitively, approximate modeling is always possible. However, the key questions are what kind of approximation is good, where the sense of 'goodness' has to be first defined, of course, and how to formulate such a good approximation in modeling a system such that it is mathematically rigorous and can produce satisfactory results in both theory and applications." (Guanrong Chen & Trung Tat Pham, "Introduction to Fuzzy Sets, Fuzzy Logic, and Fuzzy Control Systems", 2001) 

"Thus, nonlinearity can be understood as the effect of a causal loop, where effects or outputs are fed back into the causes or inputs of the process. Complex systems are characterized by networks of such causal loops. In a complex, the interdependencies are such that a component A will affect a component B, but B will in general also affect A, directly or indirectly.  A single feedback loop can be positive or negative. A positive feedback will amplify any variation in A, making it grow exponentially. The result is that the tiniest, microscopic difference between initial states can grow into macroscopically observable distinctions." (Carlos Gershenson, "Design and Control of Self-organizing Systems", 2007)

"Where simplifications fail, causing the most damage, is when something nonlinear is simplified with the linear as a substitute. That is the most common Procrustean bed." (Nassim N Taleb, "Antifragile: Things that Gain from Disorder", 2012)

"Complex systems defy intuitive solutions. Even a third-order, linear differential equation is unsolvable by inspection. Yet, important situations in management, economics, medicine, and social behavior usually lose reality if simplified to less than fifth-order nonlinear dynamic systems. Attempts to deal with nonlinear dynamic systems using ordinary processes of description and debate lead to internal inconsistencies. Underlying assumptions may have been left unclear and contradictory, and mental models are often logically incomplete. Resulting behavior is likely to be contrary to that implied by the assumptions being made about' underlying system structure and governing policies." (Jay W Forrester, "Modeling for What Purpose?", The Systems Thinker Vol. 24 (2), 2013)

"There is no linear additive process that, if all the parts are taken together, can be understood to create the total system that occurs at the moment of self-organization; it is not a quantity that comes into being. It is not predictable in its shape or subsequent behavior or its subsequent qualities. There is a nonlinear quality that comes into being at the moment of synchronicity." (Stephen H Buhner, "Plant Intelligence and the Imaginal Realm: Beyond the Doors of Perception into the Dreaming of Earth", 2014)

"Exponentially growing systems are prevalent in nature, spanning all scales from biochemical reaction networks in single cells to food webs of ecosystems. How exponential growth emerges in nonlinear systems is mathematically unclear. […] The emergence of exponential growth from a multivariable nonlinear network is not mathematically intuitive. This indicates that the network structure and the flux functions of the modeled system must be subjected to constraints to result in long-term exponential dynamics." (Wei-Hsiang Lin et al, "Origin of exponential growth in nonlinear reaction networks", PNAS 117 (45), 2020)

On Linearity I

"Today it is no longer questioned that the principles of the analysts are the more far-reaching. Indeed, the synthesists lack two things in order to engage in a general theory of algebraic configurations: these are on the one hand a definition of imaginary elements, on the other an interpretation of general algebraic concepts. Both of these have subsequently been developed in synthetic form, but to do this the essential principle of synthetic geometry had to be set aside. This principle which manifests itself so brilliantly in the theory of linear forms and the forms of the second degree, is the possibility of immediate proof by means of visualized constructions." (Felix Klein, "Riemannsche Flächen", 1906)

"The conception of tensors is possible owing to the circumstance that the transition from one co-ordinate system to another expresses itself as a linear transformation in the differentials. One here uses the exceedingly fruitful mathematical device of making a problem 'linear' by reverting to infinitely small quantities." (Hermann Weyl, "Space - Time - Matter", 1922)

"Any organism must be treated as-a-whole; in other words, that an organism is not an algebraic sum, a linear function of its elements, but always more than that. It is seemingly little realized, at present, that this simple and innocent-looking statement involves a full structural revision of our language […]" (Alfred Korzybski, "Science and Sanity", 1933)

"Beauty had been born, not, as we so often conceive it nowadays, as an ideal of humanity, but as measure, as the reduction of the chaos of appearances to the precision of linear symbols. Symmetry, balance, harmonic division, mated and mensurated intervals - such were its abstract characteristics." (Herbert E Read, "Icon and Idea", 1955)

"We've seen that even in the simplest situations nonlinearities can interfere with a linear approach to aggregates. That point holds in general: nonlinear interactions almost always make the behavior of the aggregate more complicated than would be predicted by summing or averaging." (Lewis Mumford, "The Myth of the Machine" Vol 1, 1967)

"It is sometimes said that the great discovery of the nineteenth century was that the equations of nature were linear, and the great discovery of the twentieth century is that they are not." (Thomas W Körner, "Fourier Analysis", 1988)

"A major clash between economics and ecology derives from the fact that nature is cyclical, whereas our industrial systems are linear. Our businesses take resources, transform them into products plus waste, and sell the products to consumers, who discard more waste […]" (Fritjof Capra, "The Web of Life", 1996)

"The first idea is that human progress is exponential (that is, it expands by repeatedly multiplying by a constant) rather than linear (that is, expanding by repeatedly adding a constant). Linear versus exponential: Linear growth is steady; exponential growth becomes explosive." (Ray Kurzweil, "The Singularity is Near", 2005)

"Without precise predictability, control is impotent and almost meaningless. In other words, the lesser the predictability, the harder the entity or system is to control, and vice versa. If our universe actually operated on linear causality, with no surprises, uncertainty, or abrupt changes, all future events would be absolutely predictable in a sort of waveless orderliness." (Lawrence K Samuels, "Defense of Chaos: The Chaology of Politics, Economics and Human Action", 2013)

"There is no linear additive process that, if all the parts are taken together, can be understood to create the total system that occurs at the moment of self-organization; it is not a quantity that comes into being. It is not predictable in its shape or subsequent behavior or its subsequent qualities. There is a nonlinear quality that comes into being at the moment of synchronicity." (Stephen H Buhner, "Plant Intelligence and the Imaginal Realm: Beyond the Doors of Perception into the Dreaming of Earth", 2014)

On Randomness X (From Fiction to Science-Fiction)

"Our lives today are not conducted in linear terms. They are much more quantified; a stream of random events is taking place." (James G Ballard, [Conversation with George MacBeth on Third Programme - BBC], 1967)

"The line between inner and outer landscapes is breaking down. Earthquakes can result from seismic upheavals within the human mind. The whole random universe of the industrial age is breaking down into cryptic fragments." (William S Burroughs, [preface] 1972)

"There is no reason to assume that the universe has the slightest interest in intelligence -  or even in life. Both may be random accidental by-products of its operations like the beautiful patterns on a butterfly's wings. The insect would fly just as well without them […]" (Arthur C Clarke, "The Lost Worlds of 2001", 1972)

"It is tempting to wonder if our present universe, large as it is and complex though it seems, might not be merely the result of a very slight random increase in order over a very small portion of an unbelievably colossal universe which is virtually entirely in heat-death." (Isaac Asimov, 1976)

"In the end, each life is no more than the sum of contingent facts, a chronicle of chance intersections, of flukes, of random events that divulge nothing but their own lack of purpose."

(Paul Auster, "The Locked Room", 1988)

"The natural world is full of irregularity and random alteration, but in the antiseptic, dust-free, shadowless, brightly lit, abstract realm of the mathematicians they like their cabbages spherical, please". (William A M Boyd, Brazzaville Beach, 1990)

"There are only patterns, patterns on top of patterns, patterns that affect other patterns. Patterns hidden by patterns. Patterns within patterns. If you watch close, history does nothing but repeat itself. What we call chaos is just patterns we haven't recognized. What we call random is just patterns we can't decipher. what we can't understand we call nonsense. What we can't read we call gibberish. There is no free will. There are no variables." (Chuck Palahniuk, "Survivor", 1999)

"Because the question for me was always whether that shape we see in our lives was there from the beginning or whether these random events are only called a pattern after the fact. Because otherwise we are nothing." (Cormac McCarthy, "All the Pretty Horses", 2010)

"All the ideas in the universe can be described by words. Therefore, if you simply take all the words and rearrange them randomly enough times, you’re bound to hit upon at least a few great ideas eventually."  (Jarod Kintz, "The Days of Yay are Here! Wake Me Up When They're Over", 2011)

"Chaos is impatient. It's random. And above all it's selfish. It tears down everything just for the sake of change, feeding on itself in constant hunger. But Chaos can also be appealing. It tempts you to believe that nothing matters except what you want." (Rick Riordan, "The Throne of Fire", 2011)

On Prediction VIII (Systems II)

"Computation offers a new means of describing and investigating scientific and mathematical systems. Simulation by computer may be the only way to predict how certain complicated systems evolve." (Stephen Wolfram, "Computer Software in Science and Mathematics", 1984)

"When a system is predictable, it is already performing as consistently as possible. Looking for assignable causes is a waste of time and effort. Instead, you can meaningfully work on making improvements and modifications to the process. When a system is unpredictable, it will be futile to try and improve or modify the process. Instead you must seek to identify the assignable causes which affect the system. The failure to distinguish between these two different courses of action is a major source of confusion and wasted effort in business today." (Donald J Wheeler, "Understanding Variation: The Key to Managing Chaos" 2nd Ed., 2000)

"Complexity arises when emergent system-level phenomena are characterized by patterns in time or a given state space that have neither too much nor too little form. Neither in stasis nor changing randomly, these emergent phenomena are interesting, due to the coupling of individual and global behaviours as well as the difficulties they pose for prediction. Broad patterns of system behaviour may be predictable, but the system's specific path through a space of possible states is not." (Steve Maguire et al, "Complexity Science and Organization Studies", 2006)

"The only way to look into the future is use theories since conclusive data is only available about the past." (Clayton Christensen et al, "Seeing What’s Next: Using the Theories of Innovation to Predict Industry Change", 2004)

"A scientific theory is a concise and coherent set of concepts, claims, and laws (frequently expressed mathematically) that can be used to precisely and accurately explain and predict natural phenomena." (Mordechai Ben-Ari, "Just a Theory: Exploring the Nature of Science", 2005)

"Complexity carries with it a lack of predictability different to that of chaotic systems, i.e. sensitivity to initial conditions. In the case of complexity, the lack of predictability is due to relevant interactions and novel information created by them." (Carlos Gershenson, "Understanding Complex Systems", 2011)

"Complexity scientists concluded that there are just too many factors - both concordant and contrarian - to understand. And with so many potential gaps in information, almost nobody can see the whole picture. Complex systems have severe limits, not only to predictability but also to measurability. Some complexity theorists argue that modelling, while useful for thinking and for studying the complexities of the world, is a particularly poor tool for predicting what will happen." (Lawrence K Samuels, "Defense of Chaos: The Chaology of Politics, Economics and Human Action", 2013)

"Without precise predictability, control is impotent and almost meaningless. In other words, the lesser the predictability, the harder the entity or system is to control, and vice versa. If our universe actually operated on linear causality, with no surprises, uncertainty, or abrupt changes, all future events would be absolutely predictable in a sort of waveless orderliness." (Lawrence K Samuels, "Defense of Chaos: The Chaology of Politics, Economics and Human Action", 2013)

"The problem of complexity is at the heart of mankind’s inability to predict future events with any accuracy. Complexity science has demonstrated that the more factors found within a complex system, the more chances of unpredictable behavior. And without predictability, any meaningful control is nearly impossible. Obviously, this means that you cannot control what you cannot predict. The ability ever to predict long-term events is a pipedream. Mankind has little to do with changing climate; complexity does." (Lawrence K Samuels, "The Real Science Behind Changing Climate", 2014)

"[...] perhaps one of the most important features of complex systems, which is a key differentiator when comparing with chaotic systems, is the concept of emergence. Emergence 'breaks' the notion of determinism and linearity because it means that the outcome of these interactions is naturally unpredictable. In large systems, macro features often emerge in ways that cannot be traced back to any particular event or agent. Therefore, complexity theory is based on interaction, emergence and iterations." (Luis Tomé & Şuay Nilhan Açıkalın, "Complexity Theory as a New Lens in IR: System and Change" [in "Chaos, Complexity and Leadership 2017", Şefika Şule Erçetin & Nihan Potas], 2019)