On Functions: On Machine Learning

"Learning a complicated function that matches the training data closely but fails to recognize the underlying process that generates the data. As a result of overfitting, the model performs poor on new input. Overfitting occurs when the training patterns are sparse in input space and/or the trained networks are too complex." (Frank Padberg, "Counting the Hidden Defects in Software Documents", 2010)

"Neural networks can model very complex patterns and decision boundaries in the data and, as such, are very powerful. In fact, they are so powerful that they can even model the noise in the training data, which is something that definitely should be avoided. One way to avoid this overfitting is by using a validation set in a similar way as with decision trees.[...] Another scheme to prevent a neural network from overfitting is weight regularization, whereby the idea is to keep the weights small in absolute sense because otherwise they may be fitting the noise in the data. This is then implemented by adding a weight size term (e.g., Euclidean norm) to the objective function of the neural network." (Bart Baesens, "Analytics in a Big Data World: The Essential Guide to Data Science and Its Applications", 2014)

"Supervised learning, or function approximation, is simply fitting data to a function of any variety.  […] Unsupervised learning involves figuring out what makes the data special. […] Reinforcement learning involves figuring out how to play a multistage game with rewards and payoffs. Think of it as the algorithms that optimize the life of something." (Matthew Kirk, "Thoughtful Machine Learning", 2015)

"Bias is error from incorrect assumptions built into the model, such as restricting an interpolating function to be linear instead of a higher-order curve. [...] Errors of bias produce underfit models. They do not fit the training data as tightly as possible, were they allowed the freedom to do so. In popular discourse, I associate the word 'bias' with prejudice, and the correspondence is fairly apt: an apriori assumption that one group is inferior to another will result in less accurate predictions than an unbiased one. Models that perform lousy on both training and testing data are underfit." (Steven S Skiena, "The Data Science Design Manual", 2017)

"In Boosting, the selection of samples is done by giving more and more weight to hard-to-classify observations. Gradient boosting classification produces a prediction model in the form of an ensemble of weak predictive models, usually decision trees. It generalizes the model by optimizing for the arbitrary differentiable loss function. At each stage, regression trees fit on the negative gradient of binomial or multinomial deviance loss function." (Danish Haroon,Python Machine Learning Case Studies", 2017)

"In machine learning, a model is defined as a function, and we describe the learning function from the training data as inductive learning. Generalization refers to how well the concepts are learned by the model by applying them to data not seen before. The goal of a good machine-learning model is to reduce generalization errors and thus make good predictions on data that the model has never seen." (Umesh R Hodeghatta & Umesha Nayak,Business Analytics Using R: A Practical Approach", 2017)

"Just as they did thirty years ago, machine learning programs" (including those with deep neural networks) operate almost entirely in an associational mode. They are driven by a stream of observations to which they attempt to fit a function, in much the same way that a statistician tries to fit a line to a collection of points. Deep neural networks have added many more layers to the complexity of the fitted function, but raw data still drives the fitting process. They continue to improve in accuracy as more data are fitted, but they do not benefit from the 'super-evolutionary speedup'. " (Judea Pearl & Dana Mackenzie, "The Book of Why: The new science of cause and effect", 2018)

"The beauty of quantum machine learning is that we do not need to depend on an algorithm like gradient descent or convex objective function. The objective function can be nonconvex or something else." (Amit Ray,Quantum Computing Algorithms for Artificial Intelligence", 2018

On Functions (1950-1959)

"When the mathematician speaks of the existence of a 'functional relation' between two variable quantities, he means that they are connected by a simple 'formula that is to say, if we are told the value of one of the variable quantities we can find the value of the second quantity by substituting in the formula which tells us how they are related. [...] The thing to be clear about before we proceed further is that a functional relationship in mathematics means an exact and predictable relationship, with no ifs or buts about lt. It is useful in practice so long as the ifs and buts are only tiny voices which even the most ardent protagonist of proportional representation can ignore with a clear conscience." (Michael J Moroney, "Facts from Figures", 1951)

"Just as mathematics aims to study such entities as numbers, functions, spaces, etc., the subject matter of metamathematics is mathematics itself." (Frank C DeSua, "Mathematics: A Non-Technical Exposition", American Scientist, 3 Jul 1954)

"A common and very powerful constraint is that of continuity. It is a constraint because whereas the function that changes arbitrarily can undergo any change, the continuous function can change, at each step, only to a neighbouring value." (W Ross Ashby, "An Introduction to Cybernetics", 1956) 

"The mere fact that the same mathematical expression -Σ pi log(pi) [i is index], occurs both in statistical mechanics and in information theory does not in itself establish any connection between these fields. This can be done only by finding new viewpoints from which thermodynamic entropy and information-theory entropy appear as the same concept." (Edwin T Jaynes, "Information Theory and Statistical Mechanics" I, 1956)

"There are good statistics and bad statistics; it may be doubted if there are many perfect data which are of any practical value. It is the statistician's function to discriminate between good and bad data; to decide when an informed estimate is justified and when it is not; to extract the maximum reliable information from limited and possibly biased data." (Alfred R Ilersic, "Statistics", 1959)

On Functions (1825-1849)

"In analysis, one is largely occupied by functions which can be expressed as powers. As soon as other powers enter - this, however, is not often the case - then it does not work any more and a number of connected, incorrect theorems arise from false conclusions." (Niels H Abel, [Letter to Christoffer Hansteen] 1826)

"Complete knowledge of the nature of an analytic function must also include insight into its behavior for imaginary values of the arguments. Often the latter is indispensable even for a proper appreciation of the behavior of the function for real arguments. It is therefore essential that the original determination of the function concept be broadened to a domain of magnitudes which includes both the real and the imaginary quantities, on an equal footing, under the single designation complex numbers." (Carl F Gauss, cca. 1831)

"Every mathematical method has its inverse, as truly, and for the same reason, as it is impossible to make a road from one town to another, without at the same time making one from the second to the first. The combinatorial analysis is analysis by means of combinations; the calculus of generating functions is combination by means of analysis." (Augustus de Morgan, "The Differential and Integral Calculus", 1836)

"A function of x is a number which is given for each x and which changes gradually together with x. The value of the function could be given either by an analytic expression or by a condition which offers a means for testing all numbers and selecting one from them, or lastly the dependence may exist but remain unknown." (Nikolai I Lobachevsky, 1838)

"The immense part which those laws [laws of number and extension] take in giving a deductive character to the other departments of physical science, is well known; and is not surprising, when we consider that all causes operate according to mathematical laws. The effect is always dependent upon, or in mathematical language, is a function of, the quantity of the agent; and generally of its position also. We cannot, therefore, reason respecting causation, without introducing considerations of quantity and extension at every step; and if the nature of the phenomena admits of our obtaining numerical data of sufficient accuracy, the laws of quantity become the grand instruments for calculating forward to an effect, or backward to a cause." (John S Mill, "A System of Logic, Ratiocinative and Inductive", 1843)

"[…] a function of the variable x will be continuous between two limits a and b of this variable if between two limits the function has always a value which is unique and finite, in such a way that an infinitely small increment of this variable always produces an infinnitely small increment of the function itself." (Augustin-Louis Cauchy, "Mémoire sur les fonctions continues" ["Memoir on continuous functions"], 1844)

"The concept of rotation led to geometrical exponential magnitudes, to the analysis of angles and of trigonometric functions, etc. I was delighted how thorough the analysis thus formed and extended, not only the often very complex and unsymmetric formulae which are fundamental in tidal theory, but also the technique of development parallels the concept." (Hermann GGrassmann, "Ausdehnungslehre", 1844)

On Functions (1925-1949)

"Every scientific problem can be stated most clearly if it is thought of as a search for the nature of the relation between two defi nitely stated variables. Very often a scientific problem is felt and stated in other terms, but it cannot be so clearly stated in any way as when it is thought of as a function by which one variable is shown to be dependent upon or related to some other variable." (Louis L Thurstone, "The Fundamentals of Statistics", 1925)

"Meantime, there is no doubt a certain crudeness in the use of a complex wave function. If it were unavoidable in principle, and not merely a facilitation of the calculation, this would mean that there are in principle two wave functions, which must be used together in order to obtain information on the state of the system. [...] Our inability to give more accurate information about this is intimately connected with the fact that, in the pair of equations [considered], we have before us only the substitute - extraordinarily convenient for the calculation, to be sure - for a real wave equation of probably the fourth order, which, however, I have not succeeded in forming for the non-conservative case."(Edwin Schrödinger, "Quantisation as a Problem of Proper Values" , Annalen der Physik Vol. 81" (4), 1926)

"In order to regain in a rigorously defined function those properties that are analogous to those ascribed to an empirical curve with respect to slope and curvature (first and higher difference quotients), we need not only to require that the function is continuous and has a finite number of maxima and minima in a finite interval, but also assume explicitly that it has the first and a series of higher derivatives (as many as one will want to use)." (Felix Klein, "Elementary Mathematics from a Higher Standpoint" Vol III: "Precision Mathematics and Approximation Mathematics", 1928)

"No one has ever been able to prove, for example, that every even number greater than two can be expressed as the sum of two primes. Yet this is as well established by observation as any of the laws of physics. It is known that this and various other theorems are true if a certain hypothesis about the Zeta function, enunciated by Riemann nearly a century ago, is correct. No one has been able to prove this hypothesis. It has only been shown that all the consequences deducible if it is true are so far verified by experience. But any day a computer with little knowledge of pure mathematics may disprove it. Here then is a possible triumph for the mathematical amateur." (John B S Haldane, "Possible Worlds and Other Essays", 1928)

"The course of the values of a continuous function is determined at all points of an interval, if only it is determined for all rational points of this interval." (Felix Klein, "Elementary Mathematics from a Higher Standpoint" Vol III: "Precision Mathematics and Approximation Mathematics", 1928)

"The most general definition of a function that we have reached in modern mathematics starts by fixing the values that the independent variable x can take on. We define that x must successively pass through the points of a certain 'point set'. The language used is therefore geometric […]." (Felix Klein, "Elementary Mathematics from a Higher Standpoint" Vol III: "Precision Mathematics and Approximation Mathematics", 1928)

"What had already been done for music by the end of the eighteenth century has at last been begun for the pictorial arts. Mathematics and physics furnished the means in the form of rules to be followed and to be broken. In the beginning it is wholesome to be concerned with the functions and to disregard the finished form. Studies in algebra, in geometry, in mechanics characterize teaching directed towards the essential and the functional, in contrast to apparent. One learns to look behind the façade, to grasp the root of things. One learns to recognize the undercurrents, the antecedents of the visible. One learns to dig down, to uncover, to find the cause, to analyze." (Paul Klee, "Bauhaus prospectus", 1929)

"The general theory of economic equilibrium was strengthened and made effective as an organon of thought by two powerful subsidiary conceptions - the Margin and Substitution. The notion of the Margin was extended beyond Utility to describe the equilibrium point in given conditions of any economic factor which can be regarded as capable of small variations about a given value, or in its functional relation to a given value." (John M Keynes, "Essays In Biography", 1933)

"The method of successive approximations is often applied to proving existence of solutions to various classes of functional equations; moreover, the proof of convergence of these approximations leans on the fact that the equation under study may be majorised by another equation of a simple kind. Similar proofs may be encountered in the theory of infinitely many simultaneous linear equations and in the theory of integral and differential equations. Consideration of semiordered spaces and operations between them enables us to easily develop a complete theory of such functional equations in abstract form." (Leonid V Kantorovich, "On one class of functional equations", 1936)

"There is thus a possibility that the ancient dream of philosophers to connect all Nature with the properties of whole numbers will some day be realized. To do so physics will have to develop a long way to establish the details of how the correspondence is to be made. One hint for this development seems pretty obvious, namely, the study of whole numbers in modern mathematics is inextricably bound up with the theory of functions of a complex variable, which theory we have already seen has a good chance of forming the basis of the physics of the future. The working out of this idea would lead to a connection between atomic theory and cosmology." (Paul A M Dirac, [Lecture delivered on presentation of the James Scott prize] 1939)

"In mathematics, a definite quantitative relation between two or more variables, whether expressed verbally, by a formula, or by a graph, is called a functional relationship, or simply a mathematical function. Each variable is said to be a function of the other. The word function, as used here, has nothing to do with use or purpose; it simply calls attention to the fact that the quantities in question are quantitatively related to each other in a definite manner." (William L Schaaf, "Mathematics for Mechanics", 1942)

"It should be observed first that the whole concept of a category is essentially an auxiliary one; our basic concepts are essentially those of a functor and of a natural transformation […]. The idea of a category is required only by the precept that every function should have a definite class as domain and a definite class as range, for the categories are provided as the domains and ranges of functors. Thus one could drop the category concept altogether […]" (Samuel Eilenberg & Saunders Mac Lane, "A general theory of natural equivalences", Transactions of the American Mathematical Society 58, 1945)

"As usual we may make the errors of I) rejecting the null hypothesis when it is true, II) accepting the null hypothesis when it is false. But there is a third kind of error which is of interest because the present test of significance is tied up closely with the idea of making a correct decision about which distribution function has slipped furthest to the right. We may make the error of III) correctly rejecting the null hypothesis for the wrong reason." (Frederick Mosteller, "A k-Sample Slippage Test for an Extreme Population", The Annals of Mathematical Statistics 19, 1948)

"The first attempts to consider the behavior of so-called ‘random neural nets’ in a systematic way have led to a series of problems concerned with relations between the 'structure' and the ‘function’ of such nets. The ‘structure’ of a random net is not a clearly defined topological manifold such as could be used to describe a circuit with explicitly given connections. In a random neural net, one does not speak of "this" neuron synapsing on ‘that’ one, but rather in terms of tendencies and probabilities associated with points or regions in the net." (Anatol Rapoport. "Cycle distributions in random nets." The Bulletin of Mathematical Biophysics 10 (3), 1948)

On Functions (Unsourced)

"Combinatorics is an honest subject. No adèles, no sigma-algebras. You count balls in a box, and you either have the right number or you haven’t. You get the feeling that the result you have discovered is forever, because it’s concrete. Other branches of mathematics are not so clear-cut. Functional analysis of infinite-dimensional spaces is never fully convincing: you don’t get a feeling of having done an honest day’s work. Don’t get the wrong idea - combinatorics is not just putting balls into boxes. Counting finite sets can be a highbrow undertaking, with sophisticated techniques." (Gian-Carlo Rota, [interview]) 

"How could it be that the Riemann zeta function so convincingly mimics a quantum system without being one?" (Michael V Berry) [33] 

"I believe that numbers and functions of Analysis are not the arbitrary result of our minds; I think that they exist outside of us, with the same character of necessity as the things of objective reality, and we meet them or discover them, and study them, as do the physicists, the chemists and the zoologists." (Charles Hermite)

"I turn away with fright and horror from the lamentable evil of functions which do not have derivatives." (Charles Hermite, [letter to Thomas J Stieltjes])

"[...] in one of those unexpected connections that make theoretical physics so delightful, the quantum chorology of spectra turns out to be deeply connected to the arithmetic of prime numbers, through the celebrated zeros of the  Riemann zeta function: the zeros mimic quantum energy levels of a classically chaotic system. The connection is not only deep but also tantalizing, since its basis is still obscure - though it has been fruitful for both mathematics and physics." (Michael V Berry)

"It’s a whole beautiful subject and the Riemann zeta function is just the fi rst one of these, but it’s just the tip of the iceberg. They are just the most amazing objects, these L-functions - the fact that they exist, and have these incredible properties are tied up with all these arithmetical things - and it’s just a beautiful subject. Discovering these things is like discovering a gemstone or something. You’re amazed that this thing exists, has these properties and can do this." (J Brian Conrey)

"Reality is a wave function traveling both backward and forward in time." (John L Casti)

"The chief weakness of the machine is that it will not learn by its mistakes. The only way to improve its play is by improving the program. Some thought has been given to designing a program that would develop its own improvements in strategy with increasing experience in play. Although it appears to be theoretically possible, the methods thought of so far do not seem to be very practical. One possibility is to devise a program that would change the terms and coefficients involved in the evaluation function on the basis of the results of games the machine had already played. Small variations might be introduced in these terms, and the values would be selected to give the greatest percentage of wins." (Claude E Shannon)

"The theory of functions with one independent variable is very closely connected with the theory of algebraic curves. The geometry of such a curve becomes therefore of fundamental importance." (Heegaard)

"We shall consider the simplest maximum and minimum problem that points to a natural transition from functions of a finite number of variables to magnitudes that depend on an infinite number of variables." (Vito Volterra)

"When graphing a function, the width of the line should be inversely proportional to the precision of the data." (Marvin J Albinak)

On Functions (1875-1899)

"The concept of power, which includes as a special case the concept of whole number, that foundation of the theory of number, and which ought to be considered as the most general genuine origin of sets [Moment bei Mannigfaltigkeiten], is by no means restricted to linear point sets, but can be regarded as an attribute of any well-defined collection, whatever may be the character of its elements. [...] Set theory in the conception used here, if we only consider mathematics for now and forget other applications, includes the areas of arithmetic, function theory and geometry. It contains them in terms of the concept of power and brings them all together in a higher unity. Discontinuity and continuity are similarly considered from the same point of view and are thus measured with the same measure." (Georg Cantor, "Ober unendliche, lineare Punktmannichfaltigkeiten", 1879)

"The probable error, the mean error, the mean square of error, are forms divined to resemble in an essential feature the real object of which they are the imperfect symbols - the quantity of evil, the diminution of pleasure, incurred by error. The proper symbol, it is submitted, for the quantity of evil incurred by a simple error is not any power of the error, nor any definite function at all, but an almost arbitrary function, restricted only by the conditions that it should vanish when the independent variable, the error, vanishes, and continually increase with the increase of the error." (Francis Y Edgeworth, "The method of least squares", 1883)

"With the happy expression 'Invariants' chosen by Mr. Sylvester, and quite appropriate to the meaning of the matter, one originally denotes only rational functions of the coefficients of forms that remain unchanged under certain linear transformations of the variables of the forms. But the same expression has since then also been extended to some other entities [Bildungen] that remain unchanged under transformation. This multiple applicability of the concept of invariants rests upon the fact that it belongs to a much more general and abstract realm of ideas. In fact, when the concept of invariants is separated from the direct formal relation to a process of transformation and it is tied rather to the general concept of equivalence, then the concept of invariants reaches the most general realm of thought. For, every abstraction, - say an abstraction from certain differences that are presented by a number of objects, - states an equivalence and the concept originating from the abstraction, for instance the concept of a species, represents the 'invariant of the equivalence'." (Leopold Kronecker,"Zur Theorie der elliptischen Functionen", 1889-1890)

"Mathematics accomplishes really nothing outside of the realm of magnitude; marvellous, however, is the skill with which it masters magnitude wherever it finds it. We recall at once the network of lines which it has spun about heavens and earth; the system of lines to which azimuth and altitude, declination and right ascension, longitude and latitude are referred; those abscissas and ordinates, tangents and normals, circles of curvature and evolutes; those trigonometric and logarithmic functions which have been prepared in advance and await application. A look at this apparatus is sufficient to show that mathematicians are not magicians, but that everything is accomplished by natural means; one is rather impressed by the multitude of skillful machines, numerous witnesses of a manifold and intensely active industry, admirably fitted for the acquisition of true and lasting treasures."(Johann F Herbart, 1890)

"We are led naturally to extend the language of geometry to the case of any number of variables, still using the word point to designate any system of values of n variables (the coördinates of the point), the word space (of n dimensions) to designate the totality of all these points or systems of values, curves or surface to designate the spread composed of points whose coördinates are given functions (with the proper restrictions) of one or two parameters (the straight line or plane, when they are linear fractional functions with the same denominator), etc. Such an extension has come to be a necessity in a large number of investigations, in order as well to give them the greatest generality as to preserve in them the intuitive character of geometry. But it has been noted that in such use of geometric language we are no longer constructing truly a geometry, for the forms that we have been considering are essentially analytic, and that, for example, the general projective geometry constructed in this way is in substance nothing more than the algebra of linear transformations." (Corradi Segre, "Rivista di Matematica" Vol. I, 1891)

"Analytic functions are those that can be represented by a power series, convergent within a certain region bounded by the so-called circle of convergence. Outside of this region the analytic function is not regarded as given a priori ; its continuation into wider regions remains a matter of special investigation and may give very different results, according to the particular case considered." (Felix Klein, "Sophus Lie", [lecture] 1893)

"The atomic theory plays a part in physics similar to that of certain auxiliary concepts in mathematics: it is a mathematical model for facilitating the mental reproduction of facts. Although we represent vibrations by the harmonic formula, the phenomena of cooling by exponentials, falls by squares of time, etc, no one would fancy that vibrations in themselves have anything to do with circular functions, or the motion of falling bodies with squares." (Ernst Mach, "The Science of Mechanic", 1893)

"Those skilled in mathematical analysis know that its object is not simply to calculate numbers, but that it is also employed to find the relations between magnitudes which cannot be expressed in numbers and between functions whose law is not capable of algebraic expression." (Antoine-Augustin Cournot,"Mathematical Theory of the Principles of Wealth", 1897)

"Logic sometimes makes monsters. For half a century we have seen a mass of bizarre functions which appear to be forced to resemble as little as possible honest functions which serve some purpose. More of continuity, or less of continuity, more derivatives, and so forth. Indeed, from the point of view of logic, these strange functions are the most general; on the other hand those which one meets without searching for them, and which follow simple laws appear as a particular case which does not amount to more than a small corner. In former times when one invented a new function it was for a practical purpose; today one invents them purposely to show up defects in the reasoning of our fathers and one will deduce from them only that. If logic were the sole guide of the teacher, it would be necessary to begin with the most general functions, that is to say with the most bizarre. It is the beginner that would have to be set grappling with this teratologic museum." (Henri Poincaré, 1899)

On Functions (1980-1989)

"At the most elemental level, reality evanesces into something called Schröedinger's Wave Function: a mathematical abstraction which is best represented as a pattern in an infinite-dimensional space, Hilbert Space. Each point of the Hilbert Space represents a possible state of affairs. The wave function for some one physical or mental system takes the form of, let us say, a coloring in of Hilbert Space. The brightly colored parts represent likely states for the system, the dim parts represent less probable states of affairs." (Rudy Rucker, "The Sex Sphere", 1983)

"Combinatorics can be classified into three types: enumerative, existential, and constructive. Enumerative combinatorics deals with the counting of combinatorial objects. Existential combinatorics studies the existence or nonexistence of combinatorial configurations. Constructive combinatorics deals with methods for actually finding specific configurations (as opposed to merely demonstrating their existence theoretically). [...] In constructive combinatorics, the problem is usually one of finding a solution efficiently, [...] using a reasonable length of time." (George Pólya, Robert E Tarjan & Donald R Woods, "Notes on Introductory Combinatorics", 1983)

"The progress of mathematics can be viewed as a movement from the infinite to the finite. At the start, the possibilities of a theory, for example, the theory of enumeration appear to be boundless. Rules for the enumeration of sets subject to various conditions, or combinatorial objects as they are often called, appear to obey an indefinite variety of and seem to lead to a welter of generating functions. We are at first led to suspect that the class of objects with a common property that may be enumerated is indeed infinite and unclassifiable." (Gian-Carlo Rota, [Preface to Combinatorial Enumeration by I.P. Goulden and D.M. Jackson], 1983)

"Much combinatorics of our day came out of an extraordinary coincidence. Disparate problems in combinatorics. ranging from problems in statistical mechanics to the problem of coloring a map, seem to bear no common features. However, they do have at least one common feature: their solution can be reduced to the problem of finding the roots of some polynomial or analytic function. The minimum number of colors required to properly color a map is given by the roots of a polynomial, called the chromatic polynomial; its value at N tells you in how many ways you can color the map with N colors. Similarly, the singularities of some complicated analytic function tell you the temperature at which a phase transition occurs in matter. The great insight, which is a long way from being understood, was to realize that the roots of the polynomials and analytic functions arising in a lot of combinatorial problems are the Betti numbers of certain surfaces related to the problem, Roughly speaking, the Betti numbers of a surface describe the number of different ways you can go around it. We are now trying to understand how this extraordinary coincidence comes about. If we do, we will have found a notable unification in mathematics." (Gian-Carlo Rota, "Mathematics, Philosophy and Artificial Intelligence", Los Alamos Science No. 12, 1985)

"Threshold functions (are described) which facilitate the careful study of the structure of a graph as it grows and specifically reveal the mysterious circumstances surrounding the abrupt appearance of the Unique Giant Component which systematically absorbs its neighbours, devouring the larger first and ruthlessly continuing until the last Isolated Nodes have been swallowed up, whereupon the Giant is suddenly brought under control by a Spanning Cycle." (Edgar Palmer, "Graphical Evolution", 1985)

"Longitudinal data sets are comprised of repeated observations of an outcome and a set of covariates for each of many subjects. One objective of statistical analysis is to describe the marginal expectation of the outcome variable as a function of the covariates while accounting for the correlation among the repeated observations for a given subject." (Scott L Zeger & Kung-Yee Liang, "Longitudinal Data Analysis for Discrete and Continuous Outcomes", Biometrics Vol. 42(1), 1986)

"Elementary functions, such as trigonometric functions and rational functions, have their roots in Euclidean geometry. They share the feature that when their graphs are 'magnified' sufficiently, locally they 'look like' straight lines. That is, the tangent line approximation can be used effectively in the vicinity of most points. Moreover, the fractal dimension of the graphs of these functions is always one. These elementary 'Euclidean' functions are useful not only because of their geometrical content, but because they can be expressed by simple formulas. We can use them to pass information easily from one person to another. They provide a common language for our scientific work. Moreover, elementary functions are used extensively in scientific computation, computer-aided design, and data analysis because they can be stored in small files and computed by fast algorithms." (Michael Barnsley, "Fractals Everwhere", 1988)

"In essence, a basic assumption in classical mathematics is that a concept must admit of precise definition which partitions the class of all objects into two classes: (i) those objects which are instances of the concept; and (ii) those which are not, with no borderline cases allowed. For example, a function is either continuous or discontinuous; it cannot be continuous to a degree. Similarly, a matrix is either symmetric or not symmetric; it cannot be somewhat symmetric or more or asymmetric or symmetric to a degree." (Lotfi A Zadeh, "The Birth and Evolution of Fuzzy Logic", 1989)

On Functions (1990-1999)

"[…] a pink (or white, or brown) noise is the very paradigm of a statistically self-similar process. Phenomena whose power spectra are homogeneous power functions lack inherent time and frequency scales; they are scale-free. There is no characteristic time or frequency -whatever happens in one time or frequency range happens on all time or frequency scales. If such noises are recorded on magnetic tape and played back at various speeds, they sound the same […]" (Manfred Schroeder, "Fractals, Chaos, Power Laws Minutes from an Infinite Paradise", 1990)

"All physical objects that are 'self-similar' have limited self-similarity - just as there are no perfectly periodic functions, in the mathematical sense, in the real world: most oscillations have a beginning and an end (with the possible exception of our universe, if it is closed and begins a new life cycle after every 'big crunch' […]. Nevertheless, self-similarity is a useful  abstraction, just as periodicity is one of the most useful concepts in the sciences, any finite extent notwithstanding." (Manfred Schroeder, "Fractals, Chaos, Power Laws Minutes from an Infinite Paradise", 1990)

"[…] homogeneous functions have an interesting scaling property: they reproduce themselves upon rescaling. This scaling invariance can shed light into some of the darker corners of physics, biology, and other sciences, and even illuminate our appreciation of music." (Manfred Schroeder, "Fractals, Chaos, Power Laws Minutes from an Infinite Paradise", 1990)

"The zeta function is probably the most challenging and mysterious object of modern mathematics, in spite of its utter simplicity. [...] The main interest comes from trying to improve the Prime Number Theorem, i.e., getting better estimates for the distribution of the prime numbers. The secret to the success is assumed to lie in proving a conjecture which Riemann stated in 1859 without much fare, and whose proof has since then become the single most desirable achievement for a mathematician." (Martin C Gutzwiller, "Chaos in Classical and Quantum Mechanics", 1990)

"I am firmly convinced that the most important unsolved problem in mathematics today is the truth or falsity of a conjecture about the zeros of the zeta function, which was fi rst made by Riemann himself. [...] Even a single exception to Riemann’s conjecture would have enormous ly strange consequences for the distribution of prime numbers [...] If the Riemann hypothesis turns out to be false, there will be huge oscillations in the distribution of primes. In an orchestra, that would be like one loud instrument that drowns out the others - an aesthetically distasteful situation." (Enrico Bombieri, "Prime Territory: Exploring the Infinite Landscape at the Base of the Number System", The Sciences, 1992)

"Regarding stability, the state trajectories of a system tend to equilibrium. In the simplest case they converge to one point (or different points from different initial states), more commonly to one (or several, according to initial state) fixed point or limit cycle(s) or even torus(es) of characteristic equilibrial behaviour. All this is, in a rigorous sense, contingent upon describing a potential, as a special summation of the multitude of forces acting upon the state in question, and finding the fixed points, cycles, etc., to be minima of the potential function. It is often more convenient to use the equivalent jargon of 'attractors' so that the state of a system is 'attracted' to an equilibrial behaviour. In any case, once in equilibrial conditions, the system returns to its limit, equilibrial behaviour after small, arbitrary, and random perturbations." (Gordon Pask, "Different Kinds of Cybernetics", 1992)

"A homeomorphism may be thought of as the best possible type of continuous function, and homeomorphic spaces are considered the same in topology. [...] A complex has two structures: that of the topological space underlying the complex, and the subdivision of the complex into cells. The corresponding functions will have to preserve this dual nature. In particular, it would be nice if these functions, yet to be defined, would also induce nice functions on the homology of the complex. Since homology has an algebraic group structure, we want the functions to induce homomorphisms on the homology groups. The best of all functions would be homeomorphisms on the underlying topological space and also isomorphisms on the homology groups." (L Christine Kinsey. "Topology of Surfaces", 1993)

"In any mathematical study, the first thing to do is specify the type or category of objects to be investigated. In topology, the most general possible objects of study are sets of points with just enough structure to be able to define continuous functions." (L Christine Kinsey. "Topology of Surfaces", 1993)

"In mathematics, a function is a sort of converter: It converts a value to some other value. […] the mathematical definition of a continuous function requires that any small change in the input will result in a small change to the output." (Alexander Humez et al, "Zero to Lazy Eight: The romance of numbers", 1993)

"In most fields of mathematics, we study some class of objects and also the functions appropriate to the objects of study. In linear algebra, the objects studied are vector spaces and the corresponding functions, called linear transformations and usually represented by matrices, are those which preserve the vector space structure. In geometry, we study isometries, such as rotations: functions that do not change the geometric properties of length, angle measure, area, and volume. In abstract algebra, the objects of study are groups and the appropriate functions are homomorphisms, which preserve the algebraic properties of the groups. The best possible homomorphism is an isomorphism; isomorphic groups are essentially identical algebraically." (L Christine Kinsey. "Topology of Surfaces", 1993)

"Determination of transition functions makes it possible to restore the whole manifold if individual charts and coordinate maps are already given. Glueing functions may belong to different functional classes,which makes it possible to specify within a certain class of topological manifolds more narrow classes of smooth, analytic, etc. manifolds." (Anatolij Fomenko, "Visual Geometry and Topology", 1994)

"Geometry and topology most often deal with geometrical figures, objects realized as a set of points in a Euclidean space (maybe of many dimensions). It is useful to view these objects not as rigid (solid) bodies, but as figures that admit continuous deformation preserving some qualitative properties of the object. Recall that the mapping of one object onto another is called continuous if it can be determined by means of continuous functions in a Cartesian coordinate system in space. The mapping of one figure onto another is called homeomorphism if it is continuous and one-to-one, i.e. establishes a one-to-one correspondence between points of both figures." (Anatolij Fomenko, "Visual Geometry and Topology", 1994)

"Such a close connection between trigonometric functions, the mathematical constant 'e', and the square root of -1 is already quite startling. Surely, such an identity cannot be a mere accident; rather, we must be catching a glimpse of a rich, complicated, and highly abstract mathematical pattern that for the most part lies hidden from our view." (Keith Devlin, "Mathematics: the Science of Patterns", 1994)

"The acceptance of complex numbers into the realm of algebra had an impact on analysis as well. The great success of the differential and integral calculus raised the possibility of extending it to functions of complex variables. Formally, we can extend Euler's definition of a function to complex variables without changing a single word; we merely allow the constants and variables to assume complex values. But from a geometric point of view, such a function cannot be plotted as a graph in a two-dimensional coordinate system because each of the variables now requires for its representation a two-dimensional coordinate system, that is, a plane. To interpret such a function geometrically, we must think of it as a mapping, or transformation, from one plane to another." (Eli Maor, "e: The Story of a Number", 1994)

"The concept of homeomorphism appears to be convenient for establishing those important properties of figures which remain unchanged under such deformations. These properties are sometimes referred to as topological, as distinguished from metrical, which are customarily associated with distances between points, angles between lines, edges of a figure, etc." (Anatolij Fomenko, "Visual Geometry and Topology", 1994)

"Catastrophe theory is a local theory, telling us what a function looks like in a small neighborhood of a critical point; it says nothing about what the function may be doing far away from the singularity. Yet most of the applications of the theory [...] involve extrapolating these rock-solid, local results to regions that may well be distant in time and space from the singularity. " (John L Casti, "Five Golden Rules", 1995)

"If you start with a number and form its square root, you get another number. The term for such an 'object' is function. You can think of a function as a mathematical rule that starts with a mathematical object-usually a number-and associates to it another object in a specific manner. Functions are often defined using algebraic formulas, which are just shorthand ways to explain what the rule is, but they can be defined by any convenient method. Another term with the same meaning as 'function' is transformation: the rule transforms the first object into the second. […] Operations and functions are very similar concepts. Indeed, on a suitable level of generality there is not much to distinguish them. Both of them are processes rather than things." (Ian Stewart, "Nature's Numbers: The unreal reality of mathematics", 1995)

"The goal of catastrophe theory is to classify smooth functions with degenerate critical points, just as Morse's Theorem gives us a complete classification for Morse functions. The difficulty, of course, is that there are a lot more ways for critical points to 'go bad' than there are for them to stay 'nice'. Thus, the classification problem is much harder for functions having degenerate critical points, and has not yet been fully carried out for all possible types of degeneracies. Fortunately, though, we can obtain a partial classification for those functions having critical points that are not too bad. And this classification turns out to be sufficient to apply the results to a wide range of phenomena like the predator-prey situation sketched above, in which 'jumps' in the system's biomass can occur when parameters describing the process change only slightly." (John L Casti, "Five Golden Rules", 1995)

"Topology studies the properties of geometrical objects that remain unchanged under transformations called homeomorphisms and deformations." (Victor V Prasolov, "Intuitive Topology", 1995)

"[...] a manifold is a set M on which 'nearness' is introduced" (a topological space), and this nearness can be described at each point in M by using coordinates. It also requires that in an overlapping region, where two coordinate systems intersect, the coordinate transformation is given by differentiable transition functions." (Kenji Ueno & Toshikazu Sunada, "A Mathematical Gift, III: The Interplay Between Topology, Functions, Geometry, and Algebra", Mathematical World Vol. 23, 1996)"

"An essential difference between continuity and differentiability is whether numbers are involved or not. The concept of continuity is characterized by the qualitative property that nearby objects are mapped to nearby objects. However, the concept of differentiation is obtained by using the ratio of infinitesimal increments. Therefore, we see that differentiability essentially involves numbers." (Kenji Ueno & Toshikazu Sunada, "A Mathematical Gift, III: The Interplay Between Topology, Functions, Geometry, and Algebra", Mathematical World Vol. 23, 1996)

"Analyticity is the property of a differentiable function y = f(x) that can be represented by the infinite series for all x near each point x0." (Kenji Ueno & Toshikazu Sunada, "A Mathematical Gift, III: The Interplay Between Topology, Functions, Geometry, and Algebra", Mathematical World Vol. 23, 1996)

"And of course the space the wave function live in, and (therefore) the space we live in, the space in which any realistic understanding of quantum mechanics is necessarily going to depict the history of the world as playing itself out […] is configuration-space. And whatever impression we have to the contrary (whatever impression we have, say, of living in a three-dimensional space, or in a four dimensional spacetime) is somehow flatly illusory." (David Albert, "Elementary Quantum Metaphysics", 1996)

"By studying analytic functions using power series, the algebra of the Middle Ages was connected to infinite operations (various algebraic operations with infinite series). The relation of algebra with infinite operations was later merged with the newly developed differential and integral calculus. These developments gave impetus to early stages of the development of analysis. In a way, we can say that analyticity is the notion that first crossed the boundary from finite to infinite by passing from polynomials to infinite series. However, algebraic properties of polynomial functions still are strongly present in analytic functions." (Kenji Ueno & Toshikazu Sunada, "A Mathematical Gift, III: The Interplay Between Topology, Functions, Geometry, and Algebra", Mathematical World Vol. 23, 1996)

"Continuous functions can change freely, while analytic functions are rigid. In this sense, we can say that continuous and analytic functions are antipodal." (Kenji Ueno & Toshikazu Sunada, "A Mathematical Gift, III: The Interplay Between Topology, Functions, Geometry, and Algebra", Mathematical World Vol. 23, 1996)

"Continuous functions can move freely. Graphs of continuous functions can freely branch off at any place, whereas analytic functions coinciding in some neighborhood of a point P cannot branch outside of this neighborhood. Because of this property, continuous functions can mathematically represent wildly changing wind inside a typhoon or a gentle breeze." (Kenji Ueno & Toshikazu Sunada, "A Mathematical Gift, III: The Interplay Between Topology, Functions, Geometry, and Algebra", Mathematical World Vol. 23, 1996)

"Differentiability of a function can be established by examining the behavior of the function in the immediate neighborhood of a single point a in its domain. Thus, all we need is coordinates in the vicinity of the point a. From this point of view, one might say that local coordinates have more essential qualities. However, if are not looking at individual surfaces, we cannot find a more general and universal notion than smoothness." (Kenji Ueno & Toshikazu Sunada, "A Mathematical Gift, III: The Interplay Between Topology, Functions, Geometry, and Algebra", Mathematical World Vol. 23, 1996)

"Even though there are no methods to represent each differentiable function by an 'equation', we can still investigate differentiable functions by various analytic methods. Because of this, we can say that differentiable functions have more mathematical reality than continuous functions." (Kenji Ueno & Toshikazu Sunada, "A Mathematical Gift, III: The Interplay Between Topology, Functions, Geometry, and Algebra", Mathematical World Vol. 23, 1996)

"Fuzzy systems are excellent tools for representing heuristic, commonsense rules. Fuzzy inference methods apply these rules to data and infer a solution. Neural networks are very efficient at learning heuristics from data. They are 'good problem solvers' when past data are available. Both fuzzy systems and neural networks are universal approximators in a sense, that is, for a given continuous objective function there will be a fuzzy system and a neural network which approximate it to any degree of accuracy." (Nikola K Kasabov, "Foundations of Neural Networks, Fuzzy Systems, and Knowledge Engineering", 1996)

"Graphic scales are not only the most helpful means of communicating map scale but also the safest. An alternative to blind trust in the user's sense of distance and skill in mental arithmetic, the simple bar scale typically portrays a series of conveniently rounded distances appropriate to the map's function and the area covered." (Mark S Monmonier, "How to Lie with Maps" 2nd Ed., 1996)

"If each change of a certain quantity results in a corresponding change of another quantity, we can say that there exists a functional relationship between those two quantities. Viewed in this manner, the idea of functions expands endlessly. The concept of functions is truly comprehensive, but while it is all encompassing, it is not fathomless; at least, not with respect to our current subject of manifolds. You might feel that linear functions or quadratic functions are far too specific and that you are sinking into the depths of the ocean called functions. However, you will be rescued from the ocean depths by understanding of the functions that are needed to describe manifolds. These functions are continuous, analytic, and differentiable functions." (Kenji Ueno & Toshikazu Sunada, "A Mathematical Gift, III: The Interplay Between Topology, Functions, Geometry, and Algebra", Mathematical World Vol. 23, 1996)

"[...] moving from the concept of continuity to differentiability, and then to analyticity, we are moving from weaker properties to stronger ones. Therefore, the relations between the corresponding properties of functions can be expressed as follows: {continuous functions} > {differentiate functions} > {analytic functions}." (Kenji Ueno & Toshikazu Sunada, "A Mathematical Gift, III: The Interplay Between Topology, Functions, Geometry, and Algebra", Mathematical World Vol. 23, 1996)

"Similarly to the graphs of continuous functions, graphs of differentiable" (smooth) functions which coincide in a neighborhood of a point P can branch off outside of the neighborhood. Because of this property, differentiable functions can represent smoothly changing natural phenomena." (Kenji Ueno & Toshikazu Sunada, "A Mathematical Gift, III: The Interplay Between Topology, Functions, Geometry, and Algebra", Mathematical World Vol. 23, 1996)

"[...] the only characteristic property that continuous functions have is that near objects are sent to corresponding near objects, that is, a convergent sequence is mapped to the corresponding convergent sequence. It is reasonable to say that we cannot expect to extract from that property neither numerical consequences, nor a method to extensively study continuity. On the contrary, analytic functions can be represented by equations" (precisely speaking, by infinite series). Compared to analytic functions, continuous functions, in general, are difficult to represent explicitly, although they exist as a concept." (Kenji Ueno & Toshikazu Sunada, "A Mathematical Gift, III: The Interplay Between Topology, Functions, Geometry, and Algebra", Mathematical World Vol. 23, 1996

"To describe the property of smoothness, differentiable functions should be specified first. To do so, coordinates need to be introduced on the topological space. Those coordinates can be local coordinates such as the ones used by Gauss. Once coordinates are introduced around a point a in a topological space, differentiable functions near the point a are distinguished from the continuous functions in the region near a. If different coordinates are chosen, then a different set of differentiable functions is distinguished. In other words, the choice of local coordinates determines the notion of smoothness in a topological space." (Kenji Ueno & Toshikazu Sunada, "A Mathematical Gift, III: The Interplay Between Topology, Functions, Geometry, and Algebra", Mathematical World Vol. 23, 1996)

"Mathematical programming (or optimization theory) is that branch of mathematics dealing with techniques for maximizing or minimizing an objective function subject to linear, nonlinear, and integer constraints on the variables." (George B Dantzig & Mukund N Thapa, "Linear Programming" Vol I, 1997)

"In fact the complex numbers form a field. [...] So however strange you may feel the very notion of a complex number to be, it does turn out to provide a 'normal' type of arithmetic. In fact it gives you a tremendous bonus not available with any of the other number systems. [...] The fundamental theorem of algebra is just one of several reasons why the complex-number system is such a 'nice' one. Another important reason is that the field of complex numbers supports the development of a powerful differential calculus, leading to the rich theory of functions of a complex variable." (Keith Devlin, "Mathematics: The New Golden Age", 1998)

"It is a major statistical sin to show a graph displaying a variable as a function of time with the vertical (left-hand) scale cut short so that it does not go down to zero, without drawing attention to this fact. This sin can create a seriously misleading impression, and, as they do with most sins, sinners commit it again and again." (Herbert F Spirer et al, "Misused Statistics" 2nd Ed, 1998)

"Algebraic topology studies properties of a narrower class of spaces, - basically the classical objects of mathematics: spaces given by systems of algebraic and functional equations, surfaces lying in Euclidean space, and other sets which in mathematics are called manifolds. Examining the narrower class of spaces permits deeper penetration into their structure." (Michael I Monastyrsky, "Riemann, Topology, and Physics", 1999)

"[...] fuzzy logic [FL] has many distinct facets - facets which overlap and have unsharp boundaries. Among these facets there are four that stand out in importance. They are" (i) the logical facet;" (ii) the set-theoretic facet:" (iii) the relational facet, and" (iv) the epistemic facet. […] The logical facet of FL, FL/L, is a logical system or, more accurately, a collection of logical systems which includes as a special case both two-valued and multiple-valued systems. […] The set-theoretic facet of FL, FL/S, is concerned with classes or sets whose boundaries are not sharply defined. […] The relational facet of FL, FL/R, is concerned in the main with representation and manipulation of imprecisely defined functions and relations. […] The epistemic facet of FL, FL/E, is linked to its logical facet and is centered on applications of FL to knowledge representation, information systems, fuzzy databases and the theories of possibility imprecise probabilities." (Lotfi A Zadeh, "The Birth and Evolution of Fuzzy Logic: A personal perspective", 1999)

"One of the basic tasks of topology is to learn to distinguish nonhomeomorphic figures. To this end one introduces the class of invariant quantities that do not change under homeomorphic transformations of a given figure. The study of the invariance of topological spaces is connected with the solution of a whole series of complex questions: Can one describe a class of invariants of a given manifold? Is there a set of integral invariants that fully characterizes the topological type of a manifold? and so forth." (Michael I Monastyrsky, "Riemann, Topology, and Physics", 1999)

"These so-called stochastic processes show up everywhere randomness is applied to the output of another random function. They provide, for instance, a method for describing the chance component of financial markets: not every value of the Dow is possible every day; the range of chance fluctuation centers on the opening price. Similarly, shuffling takes the output of the previous shuffle as its input. So, if you’re handed a deck in a given order, how much shuffling does it need to be truly random?" (John Haigh," Taking Chances: Winning With Probability", 1999)

"Two figures which can be transformed into one other by continuous deformations without cutting and pasting are called homeomorphic. […] The definition of a homeomorphism includes two conditions: continuous and one- to-one correspondence between the points of two figures. The relation between the two properties has fundamental significance for defining such a paramount concept as the dimension of space." (Michael I Monastyrsky, "Riemann, Topology, and Physics", 1999)

On Functions (1800-1824)

"I am convinced that the motion of the vibrating string is as exactly represented in all possible cases by trigonometric developments as by the integration which contains the arbitrary functions [...]" (Jean-Baptiste-Joseph Fourier, 1807)

"The function just found cannot, it is true, express rigorously the probabilities of the errors: for since the possible errors are in all cases confined within certain limits, the probability of errors exceeding those limits ought always to be zero, while our formula always gives some value. However, this defect, which every analytical function must, from its nature, labor under, is of no importance in practice, because the value of our function decreases so rapidly […] that it can safely be considered as vanishing. Besides, the nature of the subject never admits of assigning with absolute rigor the limits of error." (Carl F Gauss, "Theoria motus corporum coelestium in sectionibus conicis solem ambientum", 1809)

"At the beginning I would ask anyone who wants to introduce a new function in analysis to clarify whether he intends to confine it to real magnitudes" (real values of the argument) and regard the imaginary values as just vestigial –or whether he subscribes to my fundamental proposition that in the realm of magnitudes the imaginary ones a+b√−1 = a+bi have to be regarded as enjoying equal rights with the real ones. We are not talking about practical utility here; rather analysis is, to my mind, a self-sufficient science. It would lose immeasurably in beauty and symmetry from the rejection of any fictive magnitudes. At each stage truths, which otherwise are quite generally valid, would have to be encumbered with all sorts of qualifications." (Carl F Gauss, [letter to Bessel,] 1811)

"In order to indicate that a quantity depends on one or several others, either by operations of any kind, or by other relations, which it is impossible to assign algebraically, but whose existence is determined by certain conditions, we call the first quantity a function of the others." (Sylvestre-François Lacroix, "An elementary treatise on the differential and integral calculus", 1816)

"If variable quantities are so joined between themselves that, the value of one of these being given, one can conclude the values of all the others, one ordinarily conceives these diverse quantities expressed by means of the one of them, which then takes the name independent variable; and the other quantities expressed by means of the independent variable are those which one calls functions of this variable." (Augustin-Louis Cauchy, "Cours d'analyse", 1821) 

"Right away, if somebody wishes to introduce a new function into analysis, I will ask himto make clear if he simply wishes to use it for real quantities (real values of the argument of the function), and at the same time will regard the imaginary values of the argument as an appendage [Gauss here spoke of a ganglion, Uberbein], or if he accedes to my principle ¨that in the domain of quantities the imaginary a + b √−1 = a + bi must be regarded as enjoying equal rights with the real. This is not a matter of utility, rather to me analysis is an independent science which, by slighting each imaginary quantity, loses exceptionally in beauty and roundness, and in a moment all truths that otherwise would hold generally, must necessarily suffer highly tiresome restrictions." (Carl FriedrichGauss, [letter to Bessel] 1821)

"The integral ∫ϕx.dx will always have the same value along two different paths if it is never the case that ϕx = ∞ in the space between the curves representing the paths. This is abeautiful theorem whose not-too-difficult proof I will give at a suitable opportunity [. . . ]. In any case this makes it immediately clear why a function arising from an integral ϕx.dx can have many values for a single value of x, for one can go round a point where ϕx = ∞ either not at all, or once, or several times. For example, if one defines logx by  dx x , starting from x = 1, one comes to logx either without enclosing the point x = 0 or by going around it once or several times; each time the constant +2πi or −2πi enters; so the multiple of logarithms of any number are quite clear." (Carl FriedrichGauss, [letter to Bessel] 1821) 

"When variable quantities are so tied to each other that, given the values of some of them, we can deduce the values of all the others, we usually conceive these various quantities expressed in terms of several of them, which then bear the name independent variables; and the remaining quantities expressed in terms of the independent variables, are what we call functions of these same variables." (Augustin-Louis Cauchy, "Cours d’analyse de l’École Royale Polytechnique", 1821)

"In general, the function f(x) represents a succession of values or ordinates each of which is arbitrary. An infinity of values being given of the abscissa x, there are an equal number of ordinates f(x). All have actual numerical values, either positive or negative or nul. We do not suppose these ordinates to be subject to a common law; they succeed each other in any manner whatever, and each of them is given as it were a single quantity." (Joseph Fourier, "Théorie analytique de la Chaleur", 1822)

On Functions (1850-1874)

"[Algebra] has for its object the resolution of equations; taking this expression in its full logical meaning, which signifies the transformation of implicit functions into equivalent explicit ones. In the same way arithmetic may be defined as destined to the determination of the values of functions. […] We will briefly say that Algebra is the Calculus of functions, and Arithmetic is the Calculus of Values." (Auguste Comte, "Philosophy of Mathematics", 1851)

"If we designate by z a variable magnitude, which may take successively all possible real values, then, if to each of these values corresponds a unique value of the indeterminate magnitude w, we say that w is a function of z. […] This definition does not stipulate any law between the isolated values of the function, this is evident, because after this function has been dealt with for a given interval, the way it is extended outside this interval remains quite arbitrary." (Bernhard Riemann, 1851)

"[…] let us take a continuous function of position within the given the given manifoldness, which, moreover, is not constant throughout any part of that manifoldness. Every system of points where the function has a constant value, forms then a continuous manifoldness of fewer dimensions than the given one. These manifoldnesses pass over continuously into one another as the function changes; we may therefore assume that out of one of them the others proceed, and speaking generally this may occur in such a way that each point passes over into a definite point of the other; the cases of exception" (the study of which is important) may here be left unconsidered. […] By repeating then this operation n times, the determination of position in an n-ply extended manifoldness is reduced to n determinations of quantity […]. " (Bernhard Riemann, "On the hypotheses which lie at the foundation of geometry", 1854)

"Nearly fifty years had passed without any progress on the question of analytic representation of an arbitrary function, when an assertion of Fourier threw new light on the subject. Thus a new era began for the development of this part of Mathematics and this was heralded in a stunning way by major developments in mathematical Physics." (Bernhard Riemann, 1854)

"A theory of those functions [algebraic, circular or exponential, elliptical and Abelian] on the basis of the foundations here established would determine the configuration of the function (i.e., its value for each value of the argument) independently of any definition by means of operations [analytical expressions]. Therefore one would add, to the general notion of a function of a complex variable, only those characteristics that are necessary for determining the function, and only then would one go over to the different expressions that the function can be given." (Bernhard Riemann, "Theorie der Abel'schen Functionen", Journal für die reine und angewandte Mathematik 54, 1857)

"It will be seen that matrices (attending only to those of the same order) comport themselves as single quantities; they may be added, multiplied or compounded together, etc: the law of the addition of matrices is precisely similar to that for the addition of algebraical quantities; as regards their multiplication (or composition), there is the peculiarity that matrices are not in general convertible [commutative]; it is nevertheless possible to form powers (positive or negative, integral or fractional) of a matrix, and hence to arrive at the notion of a rational and integral function, or generally any algebraical function, of a matrix. I obtain the remarkable theorem that any matrix whatever satisfies an algebraical equation of its own order, the coefficient of the highest power being unity, and those of the other powers functions of the terms of the matrix, the last coefficient being in fact the determinant." (Arthur Cayley, "A memoir on the theory of matrices", 1858)

"Mathematics is the science of the functional laws and transformations which enable us to convert figured extension and rated motion into number." (George H Howison, "The Departments of Mathematics, and their Mutual Relations", Journal of Speculative Philosophy Vol. 5, No. 2, 1871)

"The invention of the calculus of quaternions is a step towards the knowledge of quantities related to space which can only be compared, for its importance, with the invention of triple coordinates by Descartes. The ideas of this calculus, as distinguished from its operations and symbols, are fitted to be of the greatest use in all parts of science." (James Clerk-Maxwell, "Remarks on the Mathematical Classification of Physical Quantities", 1871)

"Even if a curve is not drawn nor it is assumed to be tracked by the eye, but we have a 'perception' of it, it has in any case a limited precision and does not therefore correspond to the exact concept of a function of precision mathematics but rather to the idea of a function stripe." (Felix Klein, 1873)

"Can a surface (perhaps a square including its boundary) be put into one-to-one correspondence with a line (perhaps a straight line segment including its endpoints) so that to each point of the surface there corresponds a point of the line and conversely to each point of the line there corresponds a point of the surface?" (Georg Cantor, [leter to Richard Dedekind] 1874)

On Functions (1970-1979)

"The two problems of tangent construction and area evaluation, which previously bore a relation to each other no closer than that of a similarity of type, were now twins, linked by an 'inversion principle'; the powerful algebraic calculus allowed the mathematician to move easily along a whole chain of integrations and differentiations of a function according to his needs. But with power there is always responsibility; and in this case the limitation was that every operation must take place on a function which obeyed a 'law of continuity' (that is, of differentiability). Thus the calculus was understood to operate validly only on those functions which fulfilled these conditions, and they were the differentiable functions: polynomials, trigonometric and exponential functions, and all such algebraic expressions which yielded a definite result from each operation of the calculus." (Ivor Grattan-Guinness, "The Development of the Foundations of Mathematical Analysis from Euler to Riemann", 1970)

"Broadly speaking combinatorial analysis is now taught in two parts which I will label: The first classical, the second important. Classical combinatorics is concerned with counting problems. [...] As a mathematician, I like classical combinatorics. It is full of interesting devices: permutations, combinations, generating functions, amusing identities, etc. Relevant, it is not, except as a possible supplement to a basic course in probability. [...] Classical combinatorics is sometimes useful in preventing people from using an exhaustive procedure on the computer such as listing all combinations or examining all the cases. [...] The part of combinatorial analysis which I have labeled ‘important’ is concerned with selecting the best combination out of all the combinations. This is what linear programming is all about." (George B Dantzig, "On the relation of operations research to mathematics", [panel talk before AMS], 1971)

"You should call it entropy, for two reasons. In the first place your uncertainty function has been used in statistical mechanics under that name, so it already has a name. In the second place, and more important, no one really knows what entropy really is, so in a debate you will always have the advantage." (John von Neumann) [Suggesting to Claude Shannon a name for his new uncertainty function, see Scientific American Vol. 225 (3), 1971)

"[...] gradually and unwittingly mathematicians began to introduce concepts that had little or no direct physical meaning. Of these, negative and complex numbers were most troublesome. It was because these two types of numbers had no 'reality' in nature that they were still suspect at the beginning of the nineteenth century, even though freely utilized by then. The geometrical representation of negative numbers as points or vectors in the complex plane, which, as Gauss remarked of the latter, gave them intuitive meaning and so made them admissible, may have delayed the realization that mathematics deals with man-made concepts. But then the introduction of quaternions, non-Euclidean geometry, complex elements in geometry, n-dimensional geometry, bizarre functions, and transfinite numbers forced the recognition of the artificiality of mathematics." (Morris Kline, "Mathematical Thought from Ancient to Modern Times", 1972)

"[A] system is represented by a mathematical model which may take many forms, such as algebraic equations, finite state machines, difference equations, ordinary differential equations, partial differential equations, and functional equations. The system model may be uncertain, as the mathematical model may not be known completely." (Fred C Scweppe, "Uncertain dynamic systems", 1973)

"A diffeomorphism is a differentiable function between manifolds with a differentiable inverse. In particular Φ is one-to-one and onto; thus for example an allocation has a unique supporting price system, and this association is smooth over all optimal allocations." (Steven Smale, "Global Analysis and Economics VI: Geometrical analysis of Pareto Optima and price equilibria under classical hypotheses", 1974)

"But if we conceive a function, not as a formula, but as a more general relation associating the elements of one set of numbers with the elements of another set, it is obvious that functions in that sense abound throughout the Almagest." (O Petersen, "Logistics and the theory of functions", Arch. Internat. d'Hist. d. Sciences 24, 1974)

"A system may be specified in either of two ways. In the first, which we shall call a state description, sets of abstract inputs, outputs and states are given, together with the action of the inputs on the states and the assignments of outputs to states. In the second, which we shall call a coordinate description, certain input, output and state variables are given, together with a system of dynamical equations describing the relations among the variables as functions of time. Modern mathematical system theory is formulated in terms of state descriptions, whereas the classical formulation is typically a coordinate description, for example a system of differential equations." (E S Bainbridge, "The Fundamental Duality of System Theory", 1975)

"For the mathematician, the physical way of thinking is merely the starting point in a process of abstraction or idealization. Instead of being a dot on a piece of paper or a particle of dust suspended in space, a point becomes, in the mathematician's ideal way of thinking, a set of numbers or coordinates. In applied mathematics we must go much further with this process because the physical problems under consideration are more complex. We first view a phenomenon in the physical way, of course, but we must then go through a process of idealization to arrive at a more abstract representation of the phenomenon which will be amenable to mathematical analysis." (Peter Lancaster, "Mathematics: Models of the Real World", 1976)

"In decision theory, mathematical analysis shows that once the sampling distribution, loss function, and sample are specified, the only remaining basis for a choice among different admissible decisions lies in the prior probabilities. Therefore, the logical foundations of decision theory cannot be put in fully satisfactory form until the old problem of arbitrariness (sometimes called 'subjectiveness') in assigning prior probabilities is resolved." (Edwin T Jaynes, "Prior Probabilities", 1978)

"A surface is a topological space in which each point has a neighbourhood homeomorphic to the plane, ad for which any two distinct points possess disjoint neighbourhoods. […] The requirement that each point of the space should have a neighbourhood which is homeomorphic to the plane fits exactly our intuitive idea of what a surface should be. If we stand in it at some point (imagining a giant version of the surface in question) and look at the points very close to our feet we should be able to imagine that we are standing on a plane. The surface of the earth is a good example. Unless you belong to the Flat Earth Society you believe it to,be (topologically) a sphere, yet locally it looks distinctly planar. Think more carefully about this requirement: we ask that some neighbourhood of each point of our space be homeomorphic to the plane. We have then to treat this neighbourhood as a topological space in its own right. But this presents no difficulty; the neighbourhood is after all a subset of the given space and we can therefore supply it with the subspace topology." (Mark A Armstrong, "Basic Topology", 1979)

"The 'complete description' that quantum theory claims the wave function to be is a description of physical reality (as in physics). No matter what we are feeling, or thinking about, or looking at, the wave function describes as completely as possible where and when we are doing it. [...] Since the wave function is thought to be a complete description of physical reality and since that which the wave function describes is idea-like as well as matter-like, then physical reality must be both idea-like and matter-like. In other words, the world cannot be as it appears. Incredible as it sounds, this is the conclusion of the orthodox view of quantum mechanics." (Gary Zukav, "The Dancing Wu Li Masters", 1979)

"It is now generally recognized that the field of combinatorics has, over the past years, evolved into a fully-fledged branch of discrete mathematics whose potential with respect to computers and the natural sciences is only beginning to be realized. Still, two points seem to bother most authors: The apparent difficulty in defining the scope of combinatorics and the fact that combinatorics seems to consist of a vast variety of more or less unrelated methods and results. As to the scope of the field, there appears to be a growing consensus that combinatorics should be divided into three large parts: (i) Enumeration, including generating functions, inversion, and calculus of finite differences; (ii) Order Theory, including finite sets and lattices, matroids, and existence results such as Hall's and Ramsey's; (iii) Configurations, including designs, permutation groups, and coding theory." (Martin Aigner, "Combinatorial Theory", 1979)

"Showing that two spaces are homeomorphic is a geometrical problem, involving the construction of a specific homeomorphism between them. The techniques used vary with the problem. […] Attempting to prove that two spaces are not homeomorphic to one another is a problem of an entirely different nature. We cannot possibly examine each function between the two spaces individually and check that it is not a homeomorphism. Instead we look for 'topological invariants' of spaces: an invariant may be a geometrical property of the space, a number like the Euler number defined for the space, or an algebraic system such as a group or a ring constructed from the space. The important thing is that the invariant be preserved by a homeomorphism- hence its name. If we suspect that two spaces are not homeomorphic, we may be able to confirm our suspicion by computing some suitable invariant and showing that we obtain different answers." (Mark A Armstrong, "Basic Topology", 1979)

"Topology has to do with those properties of a space which are left unchanged by the kind of transformation that we have called a topological equivalence or homeomorphism. But what sort of spaces interest us and what exactly do we mean by a 'space? The idea of a homeomorphism involves very strongly the notion of continuity [...]"  (Mark A Armstrong, "Basic Topology", 1979)

On Functions (2010-)

"All forms of complex causation, and especially nonlinear transformations, admittedly stack the deck against prediction. Linear describes an outcome produced by one or more variables where the effect is additive. Any other interaction is nonlinear. This would include outcomes that involve step functions or phase transitions. The hard sciences routinely describe nonlinear phenomena. Making predictions about them becomes increasingly problematic when multiple variables are involved that have complex interactions. Some simple nonlinear systems can quickly become unpredictable when small variations in their inputs are introduced." (Richard N Lebow, "Forbidden Fruit: Counterfactuals and International Relations", 2010)

"First, what are the 'graphs' studied in graph theory? They are not graphs of functions as studied in calculus and analytic geometry. They are" (usually finite) structures consisting of vertices and edges. As in geometry, we can think of vertices as points" (but they are denoted by thick dots in diagrams) and of edges as arcs connecting pairs of distinct vertices. The positions of the vertices and the shapes of the edges are irrelevant: the graph is completely specified by saying which vertices are connected by edges. A common convention is that at most one edge connects a given pair of vertices, so a graph is essentially just a pair of sets: a set of objects." (John Stillwell, "Mathematics and Its History", 2010)

"Roughly speaking, a function defined on an open set of Euclidean space is differentiable at a point if we can approximate it in a neighborhood of this point by a linear map, which is called its differential" (or total derivative). This differential can be of course expressed by partial derivatives, but it is the differential and not the partial derivatives that plays the central role." (Jacques Lafontaine, "An Introduction to Differential Manifolds", 2010)

"Today, most mathematicians have embraced the axiom of choice because of the order and simplicity it brings to mathematics in general. For example, the theorems that every vector space has a basis and every field has an algebraic closure hold only by virtue of the axiom of choice. Likewise, for the theorem that every sequentially continuous function is continuous. However, there are special places where the axiom of choice actually brings disorder. One is the theory of measure." (John Stillwell, "Roads to Infinity: The mathematics of truth and proof", 2010)

"A topological property is, therefore, any property that is preserved under the set of all homeomorphisms. […] Homeomorphisms generally fail to preserve distances between points, and they may even fail to preserve shapes." (John Tabak, "Beyond Geometry: A new mathematics of space and form", 2011)

"In each branch of mathematics it is essential to recognize when two structures are equivalent. For example two sets are equivalent, as far as set theory is concerned, if there exists a bijective function which maps one set onto the other. Two groups are equivalent, known as isomorphic, if there exists a a homomorphism of one to the other which is one-to-one and onto. Two topological spaces are equivalent, known as homeomorphic, if there exists a homeomorphism of one onto the other." (Sydney A Morris, "Topology without Tears", 2011)

"Continuity is the rigorous formulation of the intuitive concept of a function that varies with no abrupt breaks or jumps. A function is a relationship in which every value of an independent variable - say x - is associated with a value of a dependent variable - say y. Continuity of a function is sometimes expressed by saying that if the x-values are close together, then the y-values of the function will also be close. But if the question 'How close?' is asked, difficulties arise." (Erik Gregersen [Ed.], "Math Eplained: The Britannica Guide to Analysis and Calculus", 2011)

"These days the term 'central limit theorem' is associated with a multitude of statements having to do with the convergence of probability distributions of functions of an increasing number of one- or multi-dimensional random variables or even more general random elements (with values in Banach spaces or more general spaces) to a normal distribution3 (or related distributions). In an effort to reduce ambiguity - and in view of historic developments - the denotation “central limit theorem” in the present examination will usually refer only to the 'classical' case, which deals with the asymptotic equality of distributions of sums of independent or weakly dependent random variables and of a normal distribution." (Hans Fischer, "A History of the Central Limit Theorem: From Classical to Modern Probability Theory", 2011)

"A catastrophe is a universal unfolding of a singular function germ. The singular function germs are called organization centers of the catastrophes. [...] Catastrophe theory is concerned with the mathematical modeling of sudden changes - so called 'catastrophes' - in the behavior of natural systems, which can appear as a consequence of continuous changes of the system parameters. While in common speech the word catastrophe has a negative connotation, in mathematics it is neutral." (Werner Sanns, "Catastrophe Theory" [Mathematics of Complexity and Dynamical Systems, 2012])

"A function acts like a set of rules for turning some numbers into others, a machine with parts that we can manipulate to accomplish anything we can imagine." (David Perkins, "Calculus and Its Origins", 2012)

"A function is also sometimes referred to as a map or a mapping. This terminology is common in mathematics, but less so in physics or other scientific fields. The idea of a mapping is useful if one wants to think of a function as acting on an entire set of input values." (David P Feldman,"Chaos and Fractals: An Elementary Introduction", 2012)

"Analyticity can often be exploited to advantage in the study of problems of approximation, even when the objects to be approximated are functions of a real variable." (Peter D Lax & Lawrence Zalcman, "Complex proofs of real theorems", 2012)

"Classification is only one of the mathematical aspects of catastrophe theory. Another is stability. The stable states of natural systems are the ones that we can observe over a longer period of time. But the stable states of a system, which can be described by potential functions and their singularities, can become unstable if the potentials are changed by perturbations. So stability problems in nature lead to mathematical questions concerning the stability of the potential functions." (Werner Sanns, "Catastrophe Theory" [Mathematics of Complexity and Dynamical Systems, 2012])

"Functions are the most basic way of mathematically representing a relationship. [...] In mathematics, it is useful to think of a function as an action; a function takes a number as input, does something to it, and outputs a new number. [...] We are now in a position to refine our definition of a function. A function is a rule that assigns an output value f(x) to every input x. This is consistent with the everyday use of the word function: the output f(x) is a function of the input x. The output depends on the input [...]" (David P Feldman,"Chaos and Fractals: An Elementary Introduction", 2012)

"If we wish the word ‘continuous’ to prohibit jumps in a function, its definition must somehow control the vertical change of the function at a sort of microscopic level. That is, at any point on a ‘continuous’ function, the nearby points ought to be as ‘close’ as possible." (David Perkins, "Calculus and Its Origins", 2012)

"Nothing illustrates the extraordinary power of complex function theory better than the ease and elegance with which it yields results which challenged and often baffled the very greatest mathematicians of an earlier age." (Peter D Lax & Lawrence Zalcman, "Complex proofs of real theorems", 2012)

"The good news is that, as Leibniz suggested, we appear to live in the best of all possible worlds, where the computable functions make life predictable enough to be survivable, while the noncomputable functions make life (and mathematical truth) unpredictable enough to remain interesting, no matter how far computers continue to advance."  (George B Dyson, "Turing's Cathedral: The Origins of the Digital Universe", 2012)

"Thus, much of physics can be seen as a iterative process: an object or a bunch of objects have some initial condition or seed. [...] Iterated functions are an example of what mathematicians call dynamical systems. A dynamical system is just a generic name for some variable or set of variables that change over time. There are many different types of dynamical systems - the iterated functions introduced above are just one type among many. Dynamical systems is now generally recognized as a branch of applied mathematics that studies properties of how systems change over time." (David P Feldman,"Chaos and Fractals: An Elementary Introduction", 2012)

"To mathematicians who study them, moduli schemes are just as real as the regular objects in the world. […] The key idea is that an ordinary object can be studied using the set of functions on the object. […] Secondly, you can do algebra with these functions - that is, you can add or multiply two such functions and get a third function. This step makes the set of these functions into a ring. […] Then the big leap comes: If you start with any ring - that is, any set of entities that can be added and multiplied subject to the usual rules, you simply and brashly declare that this creates a new kind of geometric object. The points of the object can be given by maps from the ring to the real numbers, as in the example of the pot. But they may also be given by maps to other fields. A field is a special sort of ring in which division is possible." (David Mumford, ["The Best Writing of Mathematics: 2012"] 2012)

"When confronted with multiple models, I find it revealing to pose the resulting uncertainty as a two-stage lottery. For the purposes of my discussion, there is no reason to distinguish unknown models from unknown parameters of a given model. I will view each parameter configuration as a distinct model. Thus a model, inclusive of its parameter values, assigns probabilities to all events or outcomes within the model’s domain. The probabilities are often expressed by shocks with known distributions and outcomes are functions of these shocks. This assignment of probabilities is what I will call risk. By contrast there may be many such potential models. Consider a two-stage lottery where in stage one we select a model and in stage two we draw an outcome using the model probabilities. Call stage one model ambiguity and stage two risk that is internal to a model." (Lars P Hansen, "Uncertainty Outside and Inside Economic Models", [Nobel lecture] 2013)

"There are many roads to statistical significance; if data are gathered with no preconceptions at all, statistical significance can obviously be obtained even from pure noise by the simple means of repeatedly performing comparisons, excluding data in different ways, examining different interactions, controlling for different predictors, and so forth. Realistically, though, a researcher will come into a study with strong substantive hypotheses, to the extent that, for any given data set, the appropriate analysis can seem evidently clear. But even if the chosen data analysis is a deterministic function of the observed data, this does not eliminate the problem posed by multiple comparisons." (Andrew Gelman & Eric Loken, "The Statistical Crisis in Science", American Scientist Vol. 102(6), 2014)

"Typical symbols used in mathematics are operationals, groupings, relations, constants, variables, functions, matrices, vectors, and symbols used in set theory, logic, number theory, probability, and statistics. Individual symbols may not have much effect on a mathematician’s creative thinking, but in groups they acquire powerful connections through similarity, association, identity, resemblance and repeated imagery. ¿ey may even create thoughts that are below awareness." (Joseph Mazur. "Enlightening symbols: a short history of mathematical notation and its hidden powers", 2014)

"Typical symbols used in mathematics are operationals, groupings, relations, constants, variables, functions, matrices, vectors, and symbols used in set theory, logic, number theory, probability, and statistics. Individual symbols may not have much effect on a mathematician’s creative thinking, but in groups they acquire powerful connections through similarity, association, identity, resemblance and repeated imagery. ¿ey may even create thoughts that are below awareness." (Joseph Mazur. "Enlightening symbols: a short history of mathematical notation and its hidden powers", 2014)

"Functions are ambiguous creatures - they come with multiple representations. [...] These representations break down into two categories: those that see the function as a static object - a graph or list - versus those that see it as a process - the calculator button, the input-output machine." (William Byers, "Deep Thinking: What Mathematics Can Teach Us About the Mind", 2015)

"Ironically, conventional quantum mechanics itself involves a vast expansion of physical reality, which may be enough to avoid Einstein Insanity. The equations of quantum dynamics allow physicists to predict the future values of the wave function, given its present value. According to the Schrödinger equation, the wave function evolves in a completely predictable way. But in practice we never have access to the full wave function, either at present or in the future, so this 'predictability' is unattainable. If the wave function provides the ultimate description of reality - a controversial issue!" (Frank Wilczek, "Einstein’s Parable of Quantum Insanity", 2015)

"That’s where boundary conditions come in. A boundary condition 'ties down' a function or its derivative to a specified value at a specified location in space or time. By constraining the solution of a differential equation top satisfy the boundary condition(s), you may be able to determine the value of the function or its derivatives at other locations. We say “may” because boundary conditions that are not well-posed may provide insufficient or contradictory information." (Daniel Fleisch & Laura Kinnaman, "A Student’s Guide to Waves", 2015)

"Why are boundary conditions important in wave theory? One reason is this: Differential equations, by their very nature, tell you about the change in a function (or, if the equation involves second derivatives, about the change in the change of the function). Knowing how a function changes is very useful, and may be all you need in certain problems. But in many problems you wish to know not only how the function changes, but also what value the function takes on at certain locations or times." (Daniel Fleisch & Laura Kinnaman, "A Student’s Guide to Waves", 2015)

"A mathematical model is a mathematical description (often by means of a function or an equation) of a real-world phenomenon such as the size of a population, the demand for a product, the speed of a falling object, the concentration of a product in a chemical reaction, the life expectancy of a person at birth, or the cost of emission reductions. The purpose of the model is to understand the phenomenon and perhaps to make predictions about future behavior. [...] A mathematical model is never a completely accurate representation of a physical situation - it is an idealization." (James Stewart, "Calculus: Early Transcedentals" 8th Ed., 2016)

"Quantum theory can be thought of as the science of constructing wavefunctions and extracting predictions of measurable outcomes from them. […] The wavefunction is a little bit like a map - the best possible kind of map. It encodes all that can be said about a quantum system." (Hans C von Baeyer, "QBism: The future of quantum physics", 2016)

"But e’s greatest claim to fame is that when dressed up with a variable exponent, it becomes a very special function." (See box.) This function is usually written as ex, that is e raised to the x power." (David Stipp, "A Most Elegant Equation: Euler's Formula and the Beauty of Mathematics", 2017)

"Computational systems are machines that can be described apriori and systematically, and implemented on every substrate that elicits the causal properties that are necessary to capture the respective states and transition functions." (Joscha Bach, "The Cortical Conductor Theory: Towards Addressing Consciousness in AI Models", 2017)

"Estimators are functions of the observed values that can be used to estimate specific parameters. Good estimators are those that are consistent and have minimum variance. These properties are guaranteed if the estimator maximizes the likelihood of the observations." (David S Salsburg, "Errors, Blunders, and Lies: How to Tell the Difference", 2017)

"Mathematics is the domain of all formal languages, and allows the expression of arbitrary statements" (most of which are uncomputable). Computation may be understood in terms of computational systems, for instance via defining states" (which are sets of discernible differences, i.e. bits), and transition functions that let us derive new states." (Joscha Bach, "The Cortical Conductor Theory: Towards Addressing Consciousness in AI Models", 2017)

"The elements of this cloud of uncertainty (the set of all possible errors) can be described in terms of probability. The center of the cloud is the number zero, and elements of the cloud that are close to zero are more probable than elements that are far away from that center. We can be more precise in this definition by defining the cloud of uncertainty in terms of a mathematical function, called the probability distribution." (David S Salsburg, "Errors, Blunders, and Lies: How to Tell the Difference", 2017)

"The primary aspects of the theory of complex manifolds are the geometric structure itself, its topological structure, coordinate systems, etc., and holomorphic functions and mappings and their properties. Algebraic geometry over the complex number field uses polynomial and rational functions of complex variables as the primary tools, but the underlying topological structures are similar to those that appear in complex manifold theory, and the nature of singularities in both the analytic and algebraic settings is also structurally very similar." (Raymond O Wells Jr, "Differential and Complex Geometry: Origins, Abstractions and Embeddings", 2017)

"The trig functions’ input consists of the sizes of angles inside right triangles. Their output consists of the ratios of the lengths of the triangles’ sides. Thus, they act as if they contained phone-directory-like groups of paired entries, one of which is an angle, and the other is a ratio of triangle-side lengths associated with the angle. That makes them very useful for figuring out the dimensions of triangles based on limited information." (David Stipp, "A Most Elegant Equation: Euler's Formula and the Beauty of Mathematics", 2017)

"The important point about e is that an exponential function with this base grows at a rate precisely equal to the function itself. Let me say that again. The rate of growth of ex is ex itself. This marvelous property simplifies all calculations about exponential functions when they are expressed in base e. No other base enjoys this simplicity. Whether we are working with derivatives, integrals, differential equations, or any of the other tools of calculus, exponential functions expressed in base e are always the cleanest, most elegant, and most beautiful." (Steven H Strogatz, "Infinite Powers: The Story of Calculus - The Most Important Discovery in Mathematics", 2019)

"What is essentially different in quantum mechanics is that it deals with complex quantities" (e.g. wave functions and quantum state vectors) of a special kind, which cannot be split up into pure real and imaginary parts that can be treated independently. Furthermore, physical meaning is not attached directly to the complex quantities themselves, but to some other operation that produces real numbers" (e.g. the square modulus of the wave function or of the inner product between state vectors)." (Ricardo Karam, "Why are complex numbers needed in quantum mechanics? Some answers for the introductory level", American Journal of Physics Vol. 88 (1), 2020)