28 December 2025

On Uniformity (2000-)

"There is no ‘scientific worldview’ just as there is no uniform enterprise ‘science’- except in the minds of metaphysicians, school masters, and scientists blinded by the achievements of their own particular niche." (Paul Feyerabend, "Conquest of Abundance", 2001)

"When natural frequencies are transformed into conditional probabilities, the base rate information is taken out (this is called normalization). The benefit of this normalization is that the resulting values fall within the uniform range of 0 and 1. The cost, however, is that when drawing inferences from probabilities (as opposed to natural frequencies), one has to put the base rates back in by multiplying the conditional probabilities by their respective base rates." (Gerd Gigerenzer, "Calculated Risks: How to know when numbers deceive you", 2002

"Limiting factors in population dynamics play the role in ecology that friction does in physics. They stop exponential growth, not unlike the way in which friction stops uniform motion. Whether or not ecology is more like physics in a viscous liquid, when the growth-rate-based traditional view is sufficient, is an open question. We argue that this limit is an oversimplification, that populations do exhibit inertial properties that are noticeable. Note that the inclusion of inertia is a generalization - it does not exclude the regular rate-based, first-order theories. They may still be widely applicable under a strong immediate density dependence, acting like friction in physics." (Lev Ginzburg & Mark Colyvan, "Ecological Orbits: How Planets Move and Populations Grow", 2004)

"Statistical tests are just a way of working out the probability of obtaining the observed, or an even more extreme, difference among samples (or between an observed and expected value) if a specific hypothesis (usually the null of no difference) is true. Once the probability is known, the experimenter can make a decision about the difference, using criteria that are uniformly used and understood." (Steve McKillup, "Statistics Explained: An Introductory Guide for Life Scientists", 2005) 

"One of the apparent paradoxes in probability is that, while the outcome of the next roll of a die or toss of a coin may be unpredictable, there are nevertheless underlying patterns in the outcomes overall. Specifically, when a fair die is rolled many times, there is a 'settling down' effect as the proportion of each outcome (1, 2, 3, …, 6) gradually approaches 1/6. In the limiting case, as the number of rolls reaches infinity, the shape of the probability distribution becomes uniform." (Alan Graham, "Developing Thinking in Statistics", 2006)

"Let's face it, the universe is messy. It is nonlinear, turbulent, and chaotic. It is dynamic. It spends its time in transient behavior on its way to somewhere else, not in mathematically neat equilibria. It self-organizes and evolves. It creates diversity, not uniformity. That's what makes the world interesting, that's what makes it beautiful, and that's what makes it work." (Donella H Meadow, "Thinking in Systems: A Primer", 2008)

"[…] topology is the study of those properties of geometric objects which remain unchanged under bi-uniform and bi-continuous transformations. Such transformations can be thought of as bending, stretching, twisting or compressing or any combination of these." (Lokenath Debnath, "The Legacy of Leonhard Euler - A Tricentennial Tribute", 2010)

"The invariance of physical laws with respect to position or orientation (i.e., the symmetry of space) gives rise to conservation laws for linear and angular momentum. Sometimes the implications of symmetry invariance are far more complicated or sophisticated than might at first be supposed; the invariance of the forces predicted by electromagnetic theory when measurements are made in observation frames moving uniformly at different speeds (inertial frames) was an important clue leading Einstein to the discovery of special relativity. With the advent of quantum mechanics, considerations of angular momentum and spin introduced new symmetry concepts into physics. These ideas have since catalyzed the modern development of particle theory." (George B Arfken et al, "Mathematical Methods for Physicists: A comprehensive guide", 2013)

"The No Free Lunch theorems prove that under a uniform distribution over induction problems" (search problems or learning problems), all induction algorithms perform equally.  […] the importance of the theorems arises by using them to analyze scenarios involving non-uniform distributions, and to compare different algorithms, without any assumption about the distribution over problems at all. In particular, the theorems prove that anti-cross-validation" (choosing among a set of candidate algorithms based on which has worst out-of-sample behavior) performs as well as cross-validation, unless one makes an assumption - which has never been formalized - about how the distribution over induction problems, on the one hand, is related to the set of algorithms one is choosing among using" (anti-)cross validation, on the other. In addition, they establish strong caveats concerning the significance of the many results in the literature which establish the strength of a particular algorithm without assuming a particular distribution." (David H Wolpert,What is important about the No Free Lunch theorems?", 2020)

No comments:

Post a Comment

Related Posts Plugin for WordPress, Blogger...

On Invariance (1990-1999)

"Axiomatic theories of choice introduce preference as a primitive relation, which is interpreted through specific empirical procedures ...