On Universality XII: Data Science

"A Universal Turing Machine is an ideal mathematical object; it represents a formal manipulation of symbols and owes allegiance to criteria of logical consistency but not to physical laws and constraints. Thus, for example, physical variables play no essential role in the concept of algorithm. In reality, however, every logical operation occurs at a minimum cost of KT of energy dissipation (where K is Boltzman's constant and T is temperature) and, in fact, occurs at a much higher cost to insure reliability." (Claudia Carello et al, "The Inadequacies of the Computer Metaphor", 1982)

"The basic idea of cognitive science is that intelligent beings are semantic engines - in other words, automatic formal systems with interpretations under which they consistently make sense. We can now see why this includes psychology and artificial intelligence on a more or less equal footing: people and intelligent computers (if and when there are any) turn out to be merely different manifestations of the same underlying phenomenon. Moreover, with universal hardware, any semantic engine can in principle be formally imitated by a computer if only the right program can be found. (John Haugeland, "Semantic Engines: An introduction to mind design", 1981)

"Looking at ourselves from the computer viewpoint, we cannot avoid seeing that natural language is our most important 'programming language'. This means that a vast portion of our knowledge and activity is, for us, best communicated and understood in our natural language. [...] One could say that natural language was our first great original artifact and, since, as we increasingly realize, languages are machines, so natural language, with our brains to run it, was our primal invention of the universal computer. One could say this except for the sneaking suspicion that language isn’t something we invented but something we became, not something we constructed but something in which we created, and recreated, ourselves." (Justin Leiber, Invitation to cognitive science", 1991)

"[...] a general-purpose universal optimization strategy is theoretically impossible, and the only way one strategy can outperform another is if it is specialized to the specific problem under consideration." Yu-Chi Ho & David L Pepyne, "Simple explanation of the no-free-lunch theorem and its implications", Journal of Optimization Theory and Applications 115, 2002)

"Much of machine learning is concerned with devising different models, and different algorithms to fit them. We can use methods such as cross validation to empirically choose the best method for our particular problem. However, there is no universally best model - this is sometimes called the no free lunch theorem. The reason for this is that a set of assumptions that works well in one domain may work poorly in another." (Kevin P Murphy, "Machine Learning: A Probabilistic Perspective", 2012)

"The no free lunch theorem for machine learning states that, averaged over all possible data generating distributions, every classification algorithm has the same error rate when classifying previously unobserved points. In other words, in some sense, no machine learning algorithm is universally any better than any other. The most sophisticated algorithm we can conceive of has the same average performance (over all possible tasks) as merely predicting that every point belongs to the same class. [...] the goal of machine learning research is not to seek a universal learning algorithm or the absolute best learning algorithm. Instead, our goal is to understand what kinds of distributions are relevant to the 'real world' that an AI agent experiences, and what kinds of machine learning algorithms perform well on data drawn from the kinds of data generating distributions we care about." (Ian Goodfellow et al, "Deep Learning", 2015)

On Universality VII: Trivia

"There never was in the world two opinions alike, no more than two hairs or two grains; the most universal quality is diversity." (Michel de Montaigne, "Essais", 1595)

"By the very nature of poetry it is impossible for everyone to be at the same time a sublime poet and a sublime metaphysician, for metaphysics abstracts the mind from the senses, and the poetic faculty must submerge the whole mind in the senses. Metaphysics soars up to universals, and the poetic faculty must plunge deep into particulars." (Giambattista Vico, "The New Science", 1725)

"But to form the idea of an object, and to form an idea simply is the same thing; the reference of the idea to an object being an extraneous denomination, of which in itself it bears no mark or character. Now as it is impossible to form an idea of an object, that is possessed of quantity and quality, and yet is possessed of no precise degree of either; it follows, that there is an equal impossibility of forming an idea, that is not limited and confined in both these particulars. Abstract ideas are therefore in themselves individual, however they may become general in their representation. The image in the mind is only that of a particular object, though the application of it in our reasoning be the same, as if it were universal." (David Hume,"Treatise of Human Nature", 1738)

"Our mental vision or conception of ideas is nothing but a revelation made to us by our Maker. When we voluntarily turn our thoughts to any object, and raise up its image in the fancy, it is not the will which creates that idea: It is the universal Creator, who discovers it to the mind, and renders it present to us." (David Hume,"An Enquiry Concerning Human Understanding", 1748)

"It is universally allowed that nothing exists without a cause of its existence, and that chance, when strictly examined, is a mere negative word, and means not any real power which has anywhere a being in nature. (David Hume, "An Enquiry Concerning Human Understanding", 1748)

"The most useful truths are always universal, and unconnected with accidents and customs. (Samuel Johnson, "The Idler", 1767)

"[...] if there were really such images in the mind, or in the brain, they could not be general, because every thing that really exists is an individual. Universals are neither acts of the mind, nor images in the mind." (Thomas Reid, "Essays on the Intellectual Powers of Man", 1785)

"Nothing universal can be rationally affirmed on any moral or any political subject. Pure metaphysical abstraction does not belong to these matters. The lines of morality are not like the ideal lines of mathematics. They are broad and deep as well as long. They admit of exceptions; they demand modifications. These exceptions and modifications are not made by the process of logic, but by the rules of prudence. Prudence is not only the first in rank of the virtues political and moral, but she is the director, regulator, the standard of them all. Metaphysics cannot live without definition; but prudence is cautious how she defines." (Edmund Burke,"Appeal from the New to the Old Whigs", 1791)

"To repeat abstractly, universally, and distinctly in concepts the whole inner nature of the world, and thus to deposit it as a reflected image in permanent concepts always ready for the faculty of reason, this and nothing else is philosophy." (Arthur Schopenhauer, "The World as Will and Representation", 1819)

"In philosophy equally as in poetry it is the highest and most useful prerogative of genius to produce the strongest impressions of novelty, while it rescues admitted truths from the neglect caused by the very circumstance of their universal admission." (Samuel T Coleridge, "Aids to Reflection", 1825)

"Poetry is the universal art of the spirit which has become free in itself and which is not tied down for its realization to external sensuous material; instead, it launches out exclusively in the inner space and the inner time of ideas and feelings." (G W Friedrich Hegel, "Introduction to Aesthetics", 1842)

"One of the greatest obstacles to the free and universal movement of human knowledge is the tendency that leads different kinds of knowledge to separate into systems." (Claude Bernard,"An Introduction to the Study of Experimental Medicine", 1865)

"Everything which distinguishes man from the animals depends upon this ability to volatilize perceptual metaphors in a schema, and thus to dissolve an image into a concept. For something is possible in the realm of these schemata which could never be achieved with the vivid first impressions: the construction of a pyramidal order according to castes and degrees, the creation of a new world of laws, privileges, subordinations, and clearly marked boundaries - a new world, one which now confronts that other vivid world of first impressions as more solid, more universal, better known, and more human than the immediately perceived world, and thus as the regulative and imperative world." (Friedrich Nietzsche, "On Truth and Lie in an Extra-Moral Sense", 1873)

"While all that we have is a relation of phenomena, a mental image, as such, in juxtaposition with or soldered to a sensation, we can not as yet have assertion or denial, a truth or a falsehood. We have mere reality, which is, but does not stand for anything, and which exists, but by no possibility could be true. […] the image is not a symbol or idea. It is itself a fact, or else the facts eject it. The real, as it appears to us in perception, connects the ideal suggestion with itself, or simply expels it from the world of reality. […] you possess explicit symbols all of which are universal and on the other side you have a mind which consists of mere individual impressions and images, grouped by the laws of a mechanical attraction." (Francis H Bradley, "Principles of Logic", 1883)

"Theoretical philosophy aimed to discover the unity of experience, namely, in the form of some universal explanation. It strived to yield a world picture, one which is harmoniously integral and completely understandable." (Alexander Bogdanov, "Tektology: The Universal Organizational Science" Vol. I, 1913)

"The word 'causality' has, unfortunately enough, no fewer than three principal meanings - a clear symptom of the long and twisted history of the causal problem. The single word 'causality' is in fact used to designate: {a) a category (corresponding to the causal bond); (b) a principle (the general law of causation), and (c) a doctrine, namely, that which holds the universal validity of the causal principle, to the exclusion of other principles of determination." (Mario Bunge, "Causality: The place of the casual principles in modern science", 1959)

"Awareness of universals is called conceiving, and a universal of which we are aware is called a concept." (Bertrand Russell, "Basic writings", 1961)

"A diagram thus enables us to discover the internal categorization which characterizes the information being processed in a much shorter time than does a map. […] A diagram permits the rapid and precise internal processing of information having three components, but it does not permit introducing the information into a universal system of visual memorization and geographic comparison. It is a closed graphic system, limited solely to the information being processed. […] In a diagram, one begins by attributing a meaning to the planar dimensions, then one plots the correspondences." (Jacques Bertin, "Semiology of graphics", 1967)

"Theories represent the phenomena just in case their models, in some sense, 'share the same structure' with those phenomena - that, in slogan form, is what is called the semantic view of theories. [...] Embedding, that means displaying an isomorphism to selected parts of those models. Here is the argument to present the first challenge. For a phenomenon to be embeddable in a model, that means that it is isomorphic to a part of that model. So the two, the phenomenon and the relevant model part must have the same structure. Therefore, the phenomenon must have a structure, and this shared structure is obviously not itself a physical, concrete individual - so what is implied here is something of the order of realism about universals." (Bas C van Fraassen, "Scientific Representation: Paradoxes of Perspective", 2008)

On Universality VI: Physics

"Time with its continuity logically involves some other kind of continuity than its own. Time, as the universal form of change, cannot exist unless there is something to undergo change, and to undergo a change continuous in time, there must be a continuity of changeable qualities." (Charles S Peirce, "The Law of Mind", 1892)

"Organic evolution has its physical analogue in the universal law that the world tends, in all its parts and particles, to pass from certain less probable to certain more probable configurations or states. This is the second law of thermodynamics." (D'Arcy Wentworth Thompson, "On Growth and Form", 1917)

"The supreme task of the physicist is to arrive at those universal elementary laws from which the cosmos can be built up by pure deduction. There is no logical path to these laws; only intuition, resting on sympathetic understanding of experience, can reach them." (Albert Einstein, "Principles of Research", 1918)

"In our recognition that order is universal, a fact confirmed by myriads of observations of patient, indefatigable, and devoted investigators, the old saying that 'an irreverent astronomer is mad' can apply with equal force to the physicist. Man learns something of his own minute and colossal stature, and he comes to feel that his own intelligence, which enables him to make such sublime discoveries, is the supreme achievement of evolution." (Harvey B Lemon, "Atomic Structure", 1927)

"A theory is the more impressive the greater the simplicity of its premises is, the more different kinds of things it relates, and the more extended is its area of applicability. Therefore the deep impression which classical thermodynamics made upon me. It is the only physical theory of universal content concerning which I am convinced that, within the framework of the applicability of its basic concepts, it will never be overthrown (for the special attention of those who are skeptics on principle)." (Albert Einstein, "Autobiographical Notes", 1949)

"Every object that we perceive appears in innumerable aspects. The concept of the object is the invariant of all these aspects. From this point of view, the present universally used system of concepts in which particles and waves appear simultaneously, can be completely justified. The latest research on nuclei and elementary particles has led us, however, to limits beyond which this system of concepts itself does not appear to suffice. The lesson to be learned from what I have told of the origin of quantum mechanics is that probable refinements of mathematical methods will not suffice to produce a satisfactory theory, but that somewhere in our doctrine is hidden a concept, unjustified by experience, which we must eliminate to open up the road." (Max Born, "The Statistical Interpretations of Quantum Mechanics", [Nobel lecture] 1954)

"The mathematicians and physics men Have their mythology; they work alongside the truth, Never touching it; their equations are false But the things work. Or, when gross error appears, They invent new ones; they drop the theory of waves In universal ether and imagine curved space." (Robinson Jeffers," The Beginning and the End and Other Poems, The Great Wound", 1963)

"Many cumbersome developments in the standard treatments of mechanics can be simplified and better understood when formulated with modern conceptual tools, as in the well-known case of the use of the 'universal' definition of tensor products of vector spaces to simplify some of the notational excesses of tensor analysis as traditionally used in relativity theory." (Saunders Mac Lane, "Hamiltonian Mechanics and Geometry", The American Mathematical Monthly Vol. 77 (6), 1970)

"Order is not universal. In fact, many chaologists and physicists posit that universal laws are more flexible than first realized, and less rigid - operating in spurts, jumps, and leaps, instead of like clockwork. Chaos prevails over rules and systems because it has the freedom of infinite complexity over the known, unknown, and the unknowable." (Lawrence K Samuels, "Defense of Chaos: The Chaology of Politics, Economics and Human Action", 2013)

On Universality IV: Science

"[…] there do exist among us doctrines of solid and acknowledged certainty, and truths of which the discovery has been received with universal applause. These constitute what we commonly term Sciences; and of these bodies of exact and enduring knowledge, we have within our reach so large and varied a collection, that we may examine them, and the history of their formation, with good prospect of deriving from the study such instruction as we seek." (William Whewell, "The Philosophy of the Inductive Sciences Founded upon Their History" Vol. 1, 1847)

"What are the sciences but maps of universal laws, and universal laws but the channels of universal power; and universal power but the outgoings of a universal mind?" (Edward Thomson, "Evidences of Revealed Religion", 1872)

"As for me (and probably I am not alone in this opinion), I believe that a single universally valid principle summarizing an abundance of established experimental facts according to the rules of induction, is more reliable than a theory which by its nature can never be directly verified; so I prefer to give up the theory rather than the principle, if the two are incompatible." (Ernst Zermelo, "Über mechanische Erklärungen irreversibler Vorgänge. Eine Antwort auf Hrn. Boltzmann’s ‘Entgegnung’" Annalen der Physik und Chemie 59, 1896)

"It should therewith be remembered that as mathematics studies neutral complexes, mathematical thinking is an organizational process and hence its methods, as well as the methods of all other sciences and those of any practice, fall within the province of a general tektology. Tektology is a unique science which must not only work out its own methods by itself but must study them as well; therefore it is the completion of the cycle of sciences." (Alexander Bogdanov, "Tektology: The Universal Organizational Science" Vol. I, 1913)

"To the grand primary impression of the world power, the immensities, the pervading order, and the universal flux, with which the man of feeling has been nurtured from the old, modern science has added thrilling impressions of manifoldedness, intricacy, uniformity, inter-relatedness, and evolution. Science widens and clears the emotional window. There are great vistas to which science alone can lead, and they make for elevation of mind." (J Arthur Thomson, "The Outline of Science" Vol. 4, 1937)

"In the testing of a scientific model or theory, one rarely has a general measure of goodness-of-fit, a universal yardstick by which one accepts or rejects the model. Indeed, science does not and should not work this way; a theory is kept until a better one is found. One way that science does work is by comparing two or more theories to determine their relative merits in handling relevant data." (Robert R Bush & Frederick Mosteller, "A Comparison of Eight Models?", Studies in Mathematical Learning Theory, 1959)

"The aim of science is to apprehend this purely intelligible world as a thing in itself, an object which is what it is independently of all thinking, and thus antithetical to the sensible world. [...] The world of thought is the universal, the timeless and spaceless, the absolutely necessary, whereas the world of sense is the contingent, the changing and moving appearance which somehow indicates or symbolizes it." (Robin G Collingwood, "Essays in the Philosophy of Art", 1964)

"One of the chief motivations behind the attempt to defend a distinction between theoretical and observational terms has been the desire to explain how a theory can be tested against the data of experience, and how one theory can be said to ‘account for the facts’ better than another; that is, to give a precise characterization of the idea, almost universally accepted in modern times, that the sciences are ‘based on experience’, that they are ‘empirical’." (Dudley Shapere, "Philosophical Problems of Natural Science", 1965)

"The word ‘induction’ has two essentially different meanings. Scientific induction is a process by which scientists make observations of particular cases, such as noticing that some crows are black, then leap to the universal conclusion that all crows are black. The conclusion is never certain. There is always the possibility that at least one unobserved crow is not black." (Martin Gardner, "Aha! Insight", 1978)

"Needless to say that once the universal approach exists we can go from one field to another and use the results of one field to promote another field. However, we should never forget limitations of 'universal approaches'. It is hiqhly dangerous to apply such an approach, if it has worked in a certain domain, to other domains as a dogma. Using any universal approach you must again and again check whether the prepositions made are fulfilled by the objects to which these approaches are applied. Going to more and more abstractions where we must heavily rely on mathematics which, after all, is the Queen of science." (Hermann Haken, 1979)

"In natural science we are concerned ultimately, not with convenient arrangements of observational data which can be generalized into universal explanatory form, but with movements of thought, at once theoretical and empirical, which penetrate into the intrinsic structure of the universe in such a way that there becomes disclosed to us its basic design and we fi nd ourselves at grips with reality.[...] We cannot pursue natural science scientifically without engaging at the same time in meta-scientific operations." (Thomas F Torrance, "Divine and Contingent Order", 1981)

"The passion and beauty and joy of science is that we humans have invented a process to understand the universe in a way that is true for everyone. We are finding universal truths." (Bill Nye, 2000)

"Both induction and deduction, reasoning from the particular and the general, and back again from the universal to the specific, form the essence to scientific thinking." (Hans Christian von Baeyer, "Information, The New Language of Science", 2003)

"Just because people doing science are embedded in a particular social and cultural milieu, it doesn’t follow that science is not universal." (Mordechai Ben-Ari, "Just a Theory: Exploring the Nature of Science", 2005)

"I think that science may be styled the knowledge of universals, or abstract wisdom; and art is science reduced to practice - or science is reason, and art the mechanism of it - and may be called practical science. Science, in fine, is the theorem, and art the problem." (Laurence Sterne)

On Universality X: Mathematics III

"How can it be that writing down a few simple and elegant formulae, like short poems governed by strict rules such as those of the sonnet or the waka, can predict universal regularities of Nature? Perhaps we see equations as simple because they are easily expressed in terms of mathematical notation already invented at an earlier stage of development of the science, and thus what appears to us as elegance of description really reflects the interconnectedness of Nature’s laws at different levels." (Murray Gell-Mann, 1969)

"In spite of its universality and good precision the linear model is very elementary in its means which are mainly those of linear algebra, so even people with very modest mathematical training can understand and master it. The last is very important for a creative and non-routine use of the analytical means which are given by the model." (Leonid V Kantorovich, "Mathematics in Economics: Achievements, Difficulties, Perspectives," 1975)

"We are now compelled to accept the fact that there is no such thing as an absolute proof or a universally acceptable proof. We know that, if we question the statements we accept on an intuitive basis, we shall be able to prove them only if we accept others on an intuitive basis." (Morris Kline,"Mathematics: The loss of certainty", 1980)

"In the initial stages of research, mathematicians do not seem to function like theorem-proving machines. Instead, they use some sort of mathematical intuition to ‘see’ the universe of mathematics and determine by a sort of empirical process what is true. This alone is not enough, of course. Once one has discovered a mathematical truth, one tries to find a proof for it." (Rudy Rucker, "Infinity and the Mind: The science and philosophy of the infinite", 1982)

"If there are paradoxes in mathematics, think of how many paradoxes there must be in ordinary speech. The existence of paradoxes involves logic. This led naturally to the question of local logics. It seems to me that it is no more natural to expect that a universal logic will hold than that a universal geometry holds." (Richard E Bellman, "Eye of the Hurricane: An Autobiography", 1984)

"While the equations represent the discernment of eternal and universal truths, however, the manner in which they are written is strictly, provincially human. That is what makes them so much like poems, wonderfully artful attempts to make infinite realities comprehensible to finite beings." (Michael Guillen," Five Equations That Changed the World", 1995)

"Differentiability of a function can be established by examining the behavior of the function in the immediate neighborhood of a single point a in its domain. Thus, all we need is coordinates in the vicinity of the point a. From this point of view, one might say that local coordinates have more essential qualities. However, if are not looking at individual surfaces, we cannot find a more general and universal notion than smoothness. (Kenji Ueno & Toshikazu Sunada, "A Mathematical Gift, III: The Interplay Between Topology, Functions, Geometry, and Algebra", Mathematical World Vol. 23, 1996)

"Mathematicians, like the rest of us, cherish clever ideas; in particular they delight in an ingenious picture. But this appreciation does not overwhelm a prevailing skepticism. After all, a diagram is - at best - just a special case and so can't establish a general theorem. Even worse, it can be downright misleading. Though not universal, the prevailing attitude is that pictures are really no more than heuristic devices; they are psychologically suggestive and pedagogically important - but they prove nothing. I want to oppose this view and to make a case for pictures having a legitimate role to play as evidence and justification - a role well beyond the heuristic. In short, pictures can prove theorems." (James R Brown, "Philosophy of Mathematics: An Introduction to the World of Proofs and Pictures", 1999)

On Universality III: Nature

"Nature, in the manifold signification of the word - whether considered as the universality of all that is and ever will be - as the inner moving force of all phenomena, or as their mysterious prototype - reveals itself to the simple mind and feelings of man as something earthly, and closely allied to himself."(Alexander von Humboldt, "Cosmos: A Sketch of a Physical Description of the Universe", 1845)

"Any opinion as to the form in which the energy of gravitation exists in space is of great importance, and whoever can make his opinion probable will have, made an enormous stride in physical speculation. The apparent universality of gravitation, and the equality of its effects on matter of all kinds are most remarkable facts, hitherto without exception; but they are purely experimental facts, liable to be corrected by a single observed exception. We cannot conceive of matter with negative inertia or mass; but we see no way of accounting for the proportionality of gravitation to mass by any legitimate method of demonstration. If we can see the tails of comets fly off in the direction opposed to the sun with an accelerated velocity, and if we believe these tails to be matter and not optical illusions or mere tracks of vibrating disturbance, then we must admit a force in that direction, and we may establish that it is caused by the sun if it always depends upon his position and distance." (James C Maxwell, [Letter to William Huggins] 1868)

"[...] there is a universal principle, operating in every department of nature and at every stage of evolution, which is conservative, creative and constructive. [...] I have at last fixed upon the word synergy, as the term best adapted to express its twofold character of ‘energy’ and ‘mutuality’ or the systematic and organic ‘working together’ of the antithetical forces of nature. [...] Synergy is a synthesis of work, or synthetic work, and this is what is everywhere taking place. It may be said to begin with the primary atomic collision in which mass, motion, time, and space are involved, and to find its simplest expression in the formula for force, which implies a plurality of elements, and signifies an interaction of these elements." (Lester F Ward, "Pure Sociology", 1903)

"[…] there is a special relationship, a profound affinity between mathematics and tektology. Mathematical laws do not refer to a particular area of natural phenomena, as the laws of the other, special, sciences do, but to each and all phenomena, considered merely in their quantitative aspect; mathematics is in its own way universal, like tektology." (Alexander Bogdanov, "Tektology: The Universal Organizational Science" Vol. I, 1913)

"It should therewith be remembered that as mathematics studies neutral complexes, mathematical thinking is an organizational process and hence its methods, as well as the methods of all other sciences and those of any practice, fall within the province of a general tektology. Tektology is a unique science which must not only work out its own methods by itself but must study them as well; therefore it is the completion of the cycle of sciences." (Alexander Bogdanov, "Tektology: The Universal Organizational Science" Vol. I, 1913)

"[...] our knowledge of the external world must always consist of numbers, and our picture of the universe - the synthesis of our knowledge - must necessarily be mathematical in form. All the concrete details of the picture, the apples, the pears and bananas, the ether and atoms and electrons, are mere clothing that we ourselves drape over our mathematical symbols - they do not belong to Nature, but to the parables by which we try to make Nature comprehensible." (Sir James H Jeans, "The New World-Picture of Modern Physics", Supplement to Nature, Vol. 134 (3384), 1934)

"This, however, is very speculative; the point of interest for our present enquiry is that physical reality is built up, apparently, from a few fundamental types of units whose properties determine many of the properties of the most complicated phenomena, and this seems to afford a sufficient explanation of the emergence of analogies between mechanisms and similarities of relation-structure among these combinations without the necessity of any theory of objective universals." (Kenneth Craik, "The Nature of Explanation", 1943)

"How can it be that writing down a few simple and elegant formulae, like short poems governed by strict rules such as those of the sonnet or the waka, can predict universal regularities of Nature? Perhaps we see equations as simple because they are easily expressed in terms of mathematical notation already invented at an earlier stage of development of the science, and thus what appears to us as elegance of description really reflects the interconnectedness of Nature’s laws at different levels." (Murray Gell-Mann, 1969)

"To give a causal explanation of an event means to deduce a statement which describes it, using as premises of the deduction one or more universal laws, together with certain singular statements, the initial conditions. [...] We have thus two different kinds of statement, both of which are necessary ingredients of a complete causal explanation." (Karl Popper, "The Philosophy of Karl Popper", 1974)

"What will prove altogether remarkable is that some very simple schemes to produce erratic numbers behave identically to some of the erratic aspects of natural phenomena." (Mitchell Figenbaum, "Universal Behavior in Nonlinear Systems", 1980)

"Theories represent the phenomena just in case their models, in some sense, 'share the same structure' with those phenomena - that, in slogan form, is what is called the semantic view of theories. [...] Embedding, that means displaying an isomorphism to selected parts of those models. Here is the argument to present the first challenge. For a phenomenon to be embeddable in a model, that means that it is isomorphic to a part of that model. So the two, the phenomenon and the relevant model part must have the same structure. Therefore, the phenomenon must have a structure, and this shared structure is obviously not itself a physical, concrete individual - so what is implied here is something of the order of realism about universals." (Bas C van Fraassen, "Scientific Representation: Paradoxes of Perspective", 2008)

"There is no unique, global, and universal relation of identity for abstract objects. [...] Abstract objects are of different sorts and this should mean, almost by definition, that there is no global, universal identity for sorts. Each sort X is equipped with an internal relation of identity but there is no identity relation that would apply to all sorts." (Jean-Pierre Marquis," Categorical foundations of mathematics, or how to provide foundations for abstract mathematics", The Review of Symbolic Logic Vol. 6 (1), 2012)

"Direct experience is inherently too limited to form an adequate foundation either for theory or for application. At the best it produces an atmosphere that is of value in drying and hardening the structure of thought. The greater value of indirect experience lies in its greater variety and extent. History is universal experience, the experience not of another, but of many others under manifold conditions." (Basil L Hart, "Why Don't We Learn from History?", 2015)

"The man of science will acts as if this world were an absolute whole controlled by laws independent of his own thoughts or act; but whenever he discovers a law of striking simplicity or one of sweeping universality or one which points to a perfect harmony in the cosmos, he will be wise to wonder what role his mind has played in the discovery, and whether the beautiful image he sees in the pool of eternity reveals the nature of this eternity, or is but a reflection of his own mind." (Tobias Dantzig)

On Universality XI: Mathematics IV

"Contrary to popular belief, mathematics is not a universal language. Rather, mathematics is based on a strict set of definitions and rules that have been instated and to which meaning has been given." (Christopher Tremblay, "Mathematics for Game Developers", 2004)

"At every major step physics has required, and frequently stimulated, the introduction of new mathematical tools and concepts. Our present understanding of the laws of physics, with their extreme precision and universality, is only possible in mathematical terms." (Michael F Atiyah, 2005)

"Algebraic symbols carry a universality of interpretation that allows them to be manipulated in a way that words cannot. Indeed, this was the key breakthrough that allowed mathematics to flourish in a way that was not possible until the advent of algebra. All higher mathematics relies on constant use of algebraic manipulation and would be impossible without it." (Peter M Higgins, "Number Story: From Counting to Cryptography", 2008)

"Math is a way to describe reality and figure out how the world works, a universal language that has become the gold standard of truth. In our world, increasingly driven by science and technology, mathematics is becoming, ever more, the source of power, wealth, and progress. Hence those who are fluent in this new language will be on the cutting edge of progress." (Edward Frenkel, "Love and Math", 2014)

"Mathematics connect themselves on the one side with common life and the physical sciences; on the other side with philosophy, in regard to our notions of space and time, and in the questions which have arisen as to the universality and necessity of the truths of mathematics, and the foundation of our knowledge of them." (Arthur Cayley)

"[…] the mathematician learns early to accept no fact, to believe no statement, however apparently reasonable or obvious or trivial, until it has been proved, rigorously and totally by a series of steps proceeding from universally accepted first principles." (Alfred Adler)

"‘Tis of singular use, rightly to understand, and carefully to distinguish from hypotheses or mere suppositions, the true and certain consequences of experimental and mathematical philosophy; which do, with wonderful strength and advantage, to all such as are capable of apprehending them, confirm, establish, and vindicate against all objections, those great and fundamental truths of natural religion, which the wisdom of providence has at the same time universally implanted, in some degree, in the minds of persons even of the meanest capacities, not qualified to examine demonstrative proofs." (Samuel Clarke)

"The mathematics of rhythm are universal. They don't belong to any particular culture." (John McLaughlin)

On Universality VIII: Complex Systems II

"Many of the systems that surround us are complex. The goal of understanding their properties motivates much if not all of scientific inquiry. […] all scientific endeavor is based, to a greater or lesser degree, on the existence of universality, which manifests itself in diverse ways. In this context, the study of complex systems as a new endeavor strives to increase our ability to understand the universality that arises when systems are highly complex." (Yaneer Bar-Yamm, "Dynamics of Complexity", 1997)

"It [collective intelligence] is a form of universally distributed intelligence, constantly enhanced, coordinated in real time, and resulting in the effective mobilization of skills. I'll add the following indispensable characteristic to this definition: The basis and goal of collective intelligence is mutual recognition and enrichment of individuals rather than the cult of fetishized or hypostatized communities." (Pierre Levy, "Collective Intelligence", 1999)

"The existence of the tipping point means it is theoretically possible to completely eradicate a disease. Eradication does not require a perfect vaccine and universal immunization but only the weaker condition that the reproduction rate of the disease fall and remain below one so that new cases arise at a lower rate than old cases are resolved." (John D Sterman, "Business Dynamics: Systems thinking and modeling for a complex world", 2000)

"Systems science, with such an ambition and with its basic Systems Theory, provides a general language with which to tie together various areas in interdisciplinary communication. As such it automatically strives towards a universal science, i.e. to join together the many splintered disciplines with a 'law of laws', applicable to them all and integrating all scientific knowledge." (Lars Skyttner, "General Systems Theory: Ideas and Applications", 2001)

"Most systems displaying a high degree of tolerance against failures are a common feature: Their functionality is guaranteed by a highly interconnected complex network. A cell's robustness is hidden in its intricate regulatory and metabolic network; society's resilience is rooted in the interwoven social web; the economy's stability is maintained by a delicate network of financial and regulator organizations; an ecosystem's survivability is encoded in a carefully crafted web of species interactions. It seems that nature strives to achieve robustness through interconnectivity. Such universal choice of a network architecture is perhaps more than mere coincidences." (Albert-László Barabási, "Linked: How Everything Is Connected to Everything Else and What It Means for Business, Science, and Everyday Life", 2002)

"The diversity of networks in business and the economy is mindboggling. There are policy networks, ownership networks, collaboration networks, organizational networks, network marketing-you name it. It would be impossible to integrate these diverse interactions into a single all-encompassing web. Yet no matter what organizational level we look at, the same robust and universal laws that govern nature's webs seem to greet us. The challenge is for economic and network research alike to put these laws into practice." (Albert-László Barabási, "Linked: How Everything Is Connected to Everything Else and What It Means for Business, Science, and Everyday Life", 2002)

"If universality is one of the observed characteristics of complex dynamical systems in many fields of study, a second characteristic that flows from the study of these systems is that of emergence. As self-organizing systems go about their daily business, they are constantly exchanging matter and energy with their environment, and this allows them to remain in a state that is far from equilibrium. That allows spontaneous behavior to give rise to new patterns." (Terry Cooke-Davies et al, "Exploring the Complexity of Projects", 2009)

"Laws of complexity hold universally across hierarchical scales (scalar, self-similarity) and are not influenced by the detailed behavior of constituent parts." (Jamshid Gharajedaghi, "Systems Thinking: Managing Chaos and Complexity A Platform for Designing Business Architecture" 3rd Ed., 2011)

"A catastrophe is a universal unfolding of a singular function germ. The singular function germs are called organization centers of the catastrophes. [...] Catastrophe theory is concerned with the mathematical modeling of sudden changes - so called 'catastrophes' - in the behavior of natural systems, which can appear as a consequence of continuous changes of the system parameters. While in common speech the word catastrophe has a negative connotation, in mathematics it is neutral." (Werner Sanns, "Catastrophe Theory" [Mathematics of Complexity and Dynamical Systems, 2012])

"Order is not universal. In fact, many chaologists and physicists posit that universal laws are more flexible than first realized, and less rigid - operating in spurts, jumps, and leaps, instead of like clockwork. Chaos prevails over rules and systems because it has the freedom of infinite complexity over the known, unknown, and the unknowable." (Lawrence K Samuels, "Defense of Chaos: The Chaology of Politics, Economics and Human Action", 2013)

"And that’s what good networkers do. No matter the field, discipline, or industry, if we want to succeed, we must master the networks. Because as the First Law of Success reminds us, the harder it is to measure performance, the less performance matters." (Albert-László Barabási, "The Formula: The Universal Laws of Success", 2018)

On Universality II: Complex Systems I

"One of the greatest obstacles to the free and universal movement of human knowledge is the tendency that leads different kinds of knowledge to separate into systems." (Claude Bernard, "An Introduction to the Study of Experimental Medicine", 1865)

"All biologic phenomena act to adjust: there are no biologic actions other than adjustments. Adjustment is another name for Equilibrium. Equilibrium is the Universal, or that which has nothing external to derange it." (Charles Fort, The Book of the Damned, 1919)

"Thus, there exist models, principles, and laws that apply to generalized systems or their subclasses, irrespective of their particular kind, the nature of their component elements, and the relations or 'forces' between them. It seems legitimate to ask for a theory, not of systems of a more or less special kind, but of universal principles applying to systems in general. In this way we postulate a new discipline called General System Theory. Its subject matter is the formulation and derivation of those principles which are valid for ‘systems’ in general." (Ludwig von Bertalanffy, "General System Theory: Foundations, Development, Applications", 1968)

"In general, one might define a complex of semantic components connected by logical constants as a concept. The dictionary of a language is then a system of concepts in which a phonological form and certain syntactic and morphological characteristics are assigned to each concept. This system of concepts is structured by several types of relations. It is supplemented, furthermore, by redundancy or implicational rules […] representing general properties of the whole system of concepts. […] At least a relevant part of these general rules is not bound to particular languages, but represents presumably universal structures of natural languages. They are not learned, but are rather a part of the human ability to acquire an arbitrary natural language." (Manfred Bierwisch, "Semantics", 1970)

"The rehabilitation of order as a universal principle, however, suggested at the same time that orderliness by itself is not sufficient to account for the nature of organized systems in general or for those created by man in particular." (Rudolf Arnheim, "Entropy and Art: An Essay on Disorder and Order", 1974)

"Cellular automata are discrete dynamical systems with simple construction but complex self-organizing behaviour. Evidence is presented that all one-dimensional cellular automata fall into four distinct universality classes. Characterizations of the structures generated in these classes are discussed. Three classes exhibit behaviour analogous to limit points, limit cycles and chaotic attractors. The fourth class is probably capable of universal computation, so that properties of its infinite time behaviour are undecidable." (Stephen Wolfram, "Nonlinear Phenomena, Universality and complexity in cellular automata", Physica 10D, 1984)

"Cellular automata are mathematical models for complex natural systems containing large numbers of simple identical components with local interactions. They consist of a lattice of sites, each with a finite set of possible values. The value of the sites evolve synchronously in discrete time steps according to identical rules. The value of a particular site is determined by the previous values of a neighbourhood of sites around it." (Stephen Wolfram, "Nonlinear Phenomena, Universality and complexity in cellular automata", Physica 10D, 1984)

"Cellular automata may be considered as discrete dynamical systems. In almost all cases, cellular automaton evolution is irreversible. Trajectories in the configuration space for cellular automata therefore merge with time, and after many time steps, trajectories starting from almost all initial states become concentrated onto 'attractors'. These attractors typically contain only a very small fraction of possible states. Evolution to attractors from arbitrary initial states allows for 'self-organizing' behaviour, in which structure may evolve at large times from structureless initial states. The nature of the attractors determines the form and extent of such structures." (Stephen Wolfram, "Nonlinear Phenomena, Universality and complexity in cellular automata", Physica 10D, 1984)

"The concept of universal connection. Nothing in the world stands by itself. Every object is a link in an endless chain and is thus connected with all the other links. And this chain of the universe has never been broken; it unites all objects and processes in a single whole and thus has a universal character. We cannot move so much as our little finger without 'disturbing' the whole universe. The life of the universe, its history lies in an infinite web of connections." (Alexander Spirkin, "Dialectical Materialism", 1983)

"Fuzzy systems are excellent tools for representing heuristic, commonsense rules. Fuzzy inference methods apply these rules to data and infer a solution. Neural networks are very efficient at learning heuristics from data. They are 'good problem solvers' when past data are available. Both fuzzy systems and neural networks are universal approximators in a sense, that is, for a given continuous objective function there will be a fuzzy system and a neural network which approximate it to any degree of accuracy." (Nikola K Kasabov, "Foundations of Neural Networks, Fuzzy Systems, and Knowledge Engineering", 1996)

On Universality IX: Mathematics II

"All of mathematics can be deduced from the sole notion of an integer; here we have a fact universally acknowledged today." (Émile Borel, "Contribution a l'analyse arithmetique du continu", 1903)

"A mathematical theorem and its demonstration are prose. But if the mathematician is overwhelmed with the grandeur and wondrous harmony of geometrical forms, of the importance and universal application of mathematical maxims, or, of the mysterious simplicity of its manifold laws which are so self-evident and plain and at the same time so complicated and profound, he is touched by the poetry of his science; and if he but understands how to give expression to his feelings, the mathematician turns poet, drawing inspiration from the most abstract domain of scientific thought." (Paul Carus," Friedrich Schiller: A Sketch of His Life and an Appreciation of His Poetry", 1905)

"Without doubt one of the most characteristic features of mathematics in the last century is the systematic and universal use of the complex variable. Most of its great theories received invaluable aid from it, and many owe their very existence to it." (James Pierpont, "History of Mathematics in the Nineteenth Century", Congress of Arts and Sciences Vol. 1, 1905)

"For thought raised on specialization the most potent objection to the possibility of a universal organizational science is precisely its universality. Is it ever possible that the same laws be applicable to the combination of astronomic worlds and those of biological cells, of living people and the waves of the ether, of scientific ideas and quanta of energy? [...] Mathematics provide a resolute and irrefutable answer: yes, it is undoubtedly possible, for such is indeed the case. Two and two homogenous separate elements amount to four such elements, be they astronomic systems or mental images, electrons or workers; numerical structures are indifferent to any element, there is no place here for specificity." (Alexander Bogdanov, "Tektology: The Universal Organizational Science" Vol. I, 1913)

"[…] there is a special relationship, a profound affinity between mathematics and tektology. Mathematical laws do not refer to a particular area of natural phenomena, as the laws of the other, special, sciences do, but to each and all phenomena, considered merely in their quantitative aspect; mathematics is in its own way universal, like tektology." (Alexander Bogdanov, "Tektology: The Universal Organizational Science" Vol. I, 1913)

"Numbers constitute the only universal language." (Nathanael West, "Miss Lonelyhearts", 1933)

"[…] the merit of mathematics, in all its forms, consists in its truth; truth conveyed to the understanding, not directly by words but by symbols which serve as the world’s only universal written language." (David Eugene Smith, "The Poetry of Mathematics and Other Essays", 1934)

"[...] our knowledge of the external world must always consist of numbers, and our picture of the universe - the synthesis of our knowledge - must necessarily be mathematical in form. All the concrete details of the picture, the apples, the pears and bananas, the ether and atoms and electrons, are mere clothing that we ourselves drape over our mathematical symbols - they do not belong to Nature, but to the parables by which we try to make Nature comprehensible." (Sir James H Jeans, "The New World-Picture of Modern Physics", Supplement to Nature, Vol. 134 (3384), 1934)

"Given any domain of thought in which the fundamental objective is a knowledge that transcends mere induction or mere empiricism, it seems quite inevitable that its processes should be made to conform closely to the pattern of a system free of ambiguous terms, symbols, operations, deductions; a system whose implications and assumptions are unique and consistent; a system whose logic confounds not the necessary with the sufficient where these are distinct; a system whose materials are abstract elements interpretable as reality or unreality in any forms whatsoever provided only that these forms mirror a thought that is pure. To such a system is universally given the name Mathematics." (Samuel T Sanders, "Mathematics", National Mathematics Magazine, 1937)

"Mathematical research can lend its organisational characteristics to poetry, whereby disjointed metaphors take on a universal sense. Similarly, the axiomatic foundations of group theory can be assimilated into a larger moral concept of a unified universe. Without this, mathematics would be a laborious Barbary." (Dan Barbilian,"The Autobiography of the Scientist", 1940)

"Here, then, in mathematics we have a universal language, valid, useful, intelligible everywhere in place and in time - in banks and insurance companies, on the parchments of the architects who raised the Temple of Solomon, and on the blueprints of the engineers who, with their calculus of chaos, master the winds. Here is a discipline of a hundred branches, fabulously rich, literally without limit in its sphere of application, laden with honors for an unbroken record of magnificent accomplishment. Here is a creation of the mind, both mystic and pragmatic in appeal. Austere and imperious as logic, it is still sufficiently sensitive and flexible to meet each new need." (Edward Kasner & James R Newman, "Mathematics and the Imagination", 1940)

On Universality I: Mathematics I

"The mathematician speculates the causes of a certain sensible effect, without considering its actual existence; for the contemplation of universals excludes the knowledge of particulars; and he whose intellectual eye is fixed on that which is general and comprehensive, will think but little of that which is sensible and singular. (Proclus Lycaeus, cca 5th century)

"Indeed, many geometric things can be discovered or elucidated by algebraic principles, and yet it does not follow that algebra is geometrical, or even that it is based on geometric principles (as some would seem to think). This close affinity of arithmetic and geometry comes about, rather, because geometry is, as it were, subordinate to arithmetic, and applies universal principles of arithmetic to its special objects." (John Wallis, "Mathesis Universalis", 1657)

"Algebra is a general Method of Computation by certain Signs and Symbols which have been contrived for this Purpose, and found convenient. It is called an Universal Arithmetic, and proceeds by Operations and Rules similar to those in Common Arithmetic, founded upon the same Principles." (Colin Maclaurin, "A Treatise on Algebra", 1748)

"Mathematical analysis […] in the study of all phenomena, interprets them by the same language, as if to attest the unity and simplicity of the plan of the universe, and take still more evident that unchangeable order which presides over all natural causes. […] There cannot be a language more universal and more simple, more free from errors and obscurities, more worthy to express the invariable relations of all natural things." (Baron Jean-Baptiste-Joseph Fourier,"Théorie Analytique de la Chaleur", 1822)

"Every theorem in geometry is a law of external nature, and might have been ascertained by generalizing from observation and experiment, which in this case resolve themselves into comparisons and measurements. But it was found practicable, and being practicable was desirable, to deduce these truths by ratiocination from a small number of general laws of nature, the certainty and universality of which was obvious to the most careless observer, and which compose the first principles and ultimate premises of the science." (John S Mill, "A System of Logic, Ratiocinative and Inductive", 1843)

"Partitions constitute the sphere in which analysis lives, moves, and has its being; and no power of language can exaggerate or paint too forcibly the importance of this till recently almost neglected, but vast, subtle, and universally permeating, element of algebraical thought and expression." (James J Sylvester, "On the Partition of Numbers", 1857)

"Every process of what has been called Universal Geometry - the great creation of Descartes and his successors, in which a single train of reasoning solves whole classes of problems at once, and others common to large groups of them - is a practical lesson in the management of wide generalizations, and abstraction of the points of agreement from those of difference among objects of great and confusing diversity, to which the purely inductive sciences cannot furnish many superior. Even so elementary an operation as that of abstracting from the particular configuration of the triangles or other figures, and the relative situation of the particular lines or points, in the diagram which aids the apprehension of a common geometrical demonstration, is a very useful, and far from being always an easy, exercise of the faculty of generalization so strangely imagined to have no place or part in the processes of mathematics." (John S Mill, "An Examination of Sir William Hamilton’s Philosophy", 1865)

"Music is like geometric figures and numbers, which are the universal forms of all possible objects of experience." (Friedrich Nietzsche,"Birth of Tragedy", 1872)

"Mathematics connect themselves on the one side with common life and physical science; on the other side with philosophy in regard to our notions of space and time, and in the questions which have arisen as to the universality and necessity of the truths of mathematics and the foundation of our knowledge of them." (Arthur Cayley, 1888)