On Research (-1899)

"Nothing proves more clearly that the mind seeks truth, and nothing reflects more glory upon it, than the delight it takes, sometimes in spite of itself, in the driest and thorniest researches of algebra." (Bernard de Fontenelle, "Histoire du Renouvellement de l'Académie des Sciences", 1708)

"The theory of which we have just given an overview may be considered from a point of view apt to set aside the obscure in what it presents, and which seems to be the primary aim, namely: to establish new notions on imaginary quantities. Indeed, putting to one side the question of whether these notions are true or false, we may restrict ourselves to viewing this theory as a means of research, to adopt the lines in direction only as signs of the real or imaginary quantities, and to see, in the usage to which we have put them, only the simple employment of a particular notation. For that, it suffices to start by demonstrating, through the first theorems of trigonometry, the rules of multiplication and addition given above; the applications will follow, and all that will remain is to examine the question of didactics. And if the employment of this notation were to be advantageous? And if it were to open up shorter and easier paths to demonstrate certain truths? That is what fact alone can decide." (Jean-Robert Argand, "Essai sur une manière de représenter les quantités imaginaires, dans les constructions géométriques", Annales Tome IV, 1813)

"The effects of heat are subject to constant laws which cannot be discovered without the aid of mathematical analysis. The object of the theory is to demonstrate these laws; it reduces all physical researches on the propagation of heat, to problems of the integral calculus, whose elements are given by experiment. No subject has more extensive relations with the progress of industry and the natural sciences; for the action of heat is always present, it influences the processes of the arts, and occurs in all the phenomena of the universe." (Jean-Baptiste-Joseph Fourier, "The Analytical Theory of Heat", 1822)

"'Natural system' - a contradiction in terms. Nature has no system; she has, she is life and its progress from an unknown center toward an unknowable goal. Scientific research is therefore endless, whether one proceed analytically into minutiae or follow the trail as a whole, in all its breadth and height." (Johann Wolfgang von Goethe, 1823)

"But a thousand unconnected observations have no more value, as a demonstrative proof, than a single one. If we do not succeed in discovering causes by our researches, we have no right to create them by the imagination; we must not allow mere fancy to proceed beyond the bounds of our knowledge." (Justus von Liebig, "The Lancet", 1844)

"The aim of research is the discovery of the equations which subsist between the elements of phenomena." (Ernst Mach, 1898)

"Physical research by experimental methods is both a broadening and a narrowing field. There are many gaps yet to be filled, data to be accumulated, measurements to be made with great precision, but the limits within which we must work are becoming, at the same time, more and more defined." (Elihu Thomson, "Annual Report of the Board of Regents of the Smithsonian Institution", 1899)

On Research (2000-2019)

"Statisticians can calculate the probability that such random samples represent the population; this is usually expressed in terms of sampling error [...]. The real problem is that few samples are random. Even when researchers know the nature of the population, it can be time-consuming and expensive to draw a random sample; all too often, it is impossible to draw a true random sample because the population cannot be defined. This is particularly true for studies of social problems. [...] The best samples are those that come as close as possible to being random." (Joel Best, "Damned Lies and Statistics: Untangling Numbers from the Media, Politicians, and Activists", 2001)

"[...] it is while doing mathematical research that one truly comes to see the beauty of mathematics. It faces you in those moments when the underlying simplicity of a question appears and its meaningless complications can be forgotten. In those moments a piece of a colossal logical structure is illumi￾nated, and some of the meaning hidden in the nature of things is finally revealed." (David Ruelle, "The Mathematician's Brain", 2007)

"Under normal conditions the research scientist is not an innovator but a solver of puzzles, and the puzzles upon which he concentrates are just those which he believes can be both stated and solved within the existing scientific tradition." (Thomas S Kuhn, "The Essential Tension: Selected Studies in Scientific Tradition and Change", 2011)

"Meta-analytic thinking is the consideration of any result in relation to previous results on the same or similar questions, and awareness that combination with future results is likely to be valuable. Meta-analytic thinking is the application of estimation thinking to more than a single study. It prompts us to seek meta-analysis of previous related studies at the planning stage of research, then to report our results in a way that makes it easy to include them in future meta-analyses. Meta-analytic thinking is a type of estimation thinking, because it, too, focuses on estimates and uncertainty." (Geoff Cumming, "Understanding the New Statistics", 2012)

"Statistical cognition is concerned with obtaining cognitive evidence about various statistical techniques and ways to present data. It’s certainly important to choose an appropriate statistical model, use the correct formulas, and carry out accurate calculations. It’s also important, however, to focus on understanding, and to consider statistics as communication between researchers and readers." (Geoff Cumming, "Understanding the New Statistics", 2012)

"Another way to secure statistical significance is to use the data to discover a theory. Statistical tests assume that the researcher starts with a theory, collects data to test the theory, and reports the results - whether statistically significant or not. Many people work in the other direction, scrutinizing the data until they find a pattern and then making up a theory that fits the pattern." (Gary Smith, "Standard Deviations", 2014)

"How can we tell the difference between a good theory and quackery? There are two effective antidotes: common sense and fresh data. If it is a ridiculous theory, we shouldn’t be persuaded by anything less than overwhelming evidence, and even then be skeptical. Extraordinary claims require extraordinary evidence. Unfortunately, common sense is an uncommon commodity these days, and many silly theories have been seriously promoted by honest researchers." (Gary Smith, "Standard Deviations", 2014)

"These practices - selective reporting and data pillaging - are known as data grubbing. The discovery of statistical significance by data grubbing shows little other than the researcher’s endurance. We cannot tell whether a data grubbing marathon demonstrates the validity of a useful theory or the perseverance of a determined researcher until independent tests confirm or refute the finding. But more often than not, the tests stop there. After all, you won’t become a star by confirming other people’s research, so why not spend your time discovering new theories? The data-grubbed theory consequently sits out there, untested and unchallenged." (Gary Smith, "Standard Deviations", 2014)

"A conceptual model is a framework that is initially used in research to outline the possible courses of action or to present an idea or thought. When a conceptual model is developed in a logical manner, it will provide a rigor to the research process." (N Elangovan & R Rajendran, "Conceptual Model: A Framework for Institutionalizing the Vigor in Business Research", 2015)

"Even properly done statistics can’t be trusted. The plethora of available statistical techniques and analyses grants researchers an enormous amount of freedom when analyzing their data, and it is trivially easy to ‘torture the data until it confesses’." (Alex Reinhart, "Statistics Done Wrong: The Woefully Complete Guide", 2015)

"The correlational technique known as multiple regression is used frequently in medical and social science research. This technique essentially correlates many independent (or predictor) variables simultaneously with a given dependent variable (outcome or output). It asks, 'Net of the effects of all the other variables, what is the effect of variable A on the dependent variable?' Despite its popularity, the technique is inherently weak and often yields misleading results. The problem is due to self-selection. If we don’t assign cases to a particular treatment, the cases may differ in any number of ways that could be causing them to differ along some dimension related to the dependent variable. We can know that the answer given by a multiple regression analysis is wrong because randomized control experiments, frequently referred to as the gold standard of research techniques, may give answers that are quite different from those obtained by multiple regression analysis." (Richard E Nisbett, "Mindware: Tools for Smart Thinking", 2015)

"Collecting data through sampling therefore becomes a never-ending battle to avoid sources of bias. [...] While trying to obtain a random sample, researchers sometimes make errors in judgment about whether every person or thing is equally likely to be sampled." (Daniel J Levitin, "Weaponized Lies", 2017)

"Samples give us estimates of something, and they will almost always deviate from the true number by some amount, large or small, and that is the margin of error. […] The margin of error does not address underlying flaws in the research, only the degree of error in the sampling procedure. But ignoring those deeper possible flaws for the moment, there is another measurement or statistic that accompanies any rigorously defined sample: the confidence interval." (Daniel J Levitin, "Weaponized Lies", 2017)

"The job of the statistician is to formulate an inventory of all those things that matter in order to obtain a representative sample. Researchers have to avoid the tendency to capture variables that are easy to identify or collect data on - sometimes the things that matter are not obvious or are difficult to measure." (Daniel J Levitin, "Weaponized Lies", 2017)

On Research (1950-1999)

"The hypothesis is the principal intellectual instrument in research. Its function is to indicate new experiments and observations and it therefore sometimes leads to discoveries even when not correct itself. We must resist the temptation to become too attached to our hypothesis, and strive to judge it objectively and modify it or discard it as soon as contrary evidence is brought to light. Vigilance is needed to prevent our observations and interpretations being biased in favor of the hypothesis. Suppositions can be used without being believed." (William I B Beveridge, "The Art of Scientific Investigation", 1950)

"Mathematical models for empirical phenomena aid the development of a science when a sufficient body of quantitative information has been accumulated. This accumulation can be used to point the direction in which models should be constructed and to test the adequacy of such models in their interim states. Models, in turn, frequently are useful in organizing and interpreting experimental data and in suggesting new directions for experimental research." (Robert R. Bush & Frederick Mosteller, "A Mathematical Model for Simple Learning", Psychological Review 58, 1951)

"Statistics is the fundamental and most important part of inductive logic. It is both an art and a science, and it deals with the collection, the tabulation, the analysis and interpretation of quantitative and qualitative measurements. It is concerned with the classifying and determining of actual attributes as well as the making of estimates and the testing of various hypotheses by which probable, or expected, values are obtained. It is one of the means of carrying on scientific research in order to ascertain the laws of behavior of things - be they animate or inanimate. Statistics is the technique of the Scientific Method." (Bruce D Greenschields & Frank M Weida, "Statistics with Applications to Highway Traffic Analyses", 1952)

"In a general way it may be said that to think in terms of systems seems the most appropriate conceptual response so far available when the phenomena under study - at any level and in any domain - display the character of being organized, and when understanding the nature of the interdependencies constitutes the research task. In the behavioral sciences, the first steps in building a systems theory were taken in connection with the analysis of internal processes in organisms, or organizations, when the parts had to be related to the whole." (Fred Emery, "The Causal Texture of Organizational Environments", 1963)

"Most scientific theories, however, are ephemeral. Exceptions will likely be found that invalidate a theory in one or more of its tenets. These can then stimulate a new round of research leading either to a more comprehensive theory or perhaps to a more restrictive (i.e., more precisely defined) theory. Nothing is ever completely finished in science; the search for better theories is endless. The interpretation of a scientific experiment should not be extended beyond the limits of the available data. In the building of theories, however, scientists propose general principles by extrapolation beyond available data. When former theories have been shown to be inadequate, scientists should be prepared to relinquish the old and embrace the new in their never-ending search for better solutions. It is unscientific, therefore, to claim to have 'proof of the truth' when all that scientific methodology can provide is evidence in support of a theory." (William D Stansfield, "The Science of Evolution", 1977)

"In the initial stages of research, mathematicians do not seem to function like theorem-proving machines. Instead, they use some sort of mathematical intuition to ‘see’ the universe of mathematics and determine by a sort of empirical process what is true. This alone is not enough, of course. Once one has discovered a mathematical truth, one tries to find a proof for it." (Rudy Rucker, "Infinity and the Mind: The science and philosophy of the infinite", 1982)

"Mathematical research should be as broad and as original as possible, with very long range-goals. We expect history to repeat itself: we expect that the most profound and useful future applications of mathematics cannot be predicted today, since they will arise from mathematics yet to be discovered." (Arthur Jaffe, "Ordering the universe: the role of mathematics", SIAM Review Vol 26. No 4, 1984)

"Basic research is like shooting an arrow into the air and, where it lands, painting a target." (Homer B Adkins, 1984)

"The sole thing that constitutes the true inventiveness and imagination of the researcher is the quality of his attention as he listens to the voices of things." (Alexander Grothendieck, "Récoltes et semailles –Rélexions et témoignage sur un passé de mathématicien", 1985)

"Thus my advice to model builders in the social sciences is to think in terms of social processes that might require algebraic structures that could yield catastrophe potential. Build models from an intimate knowledge of these processes while remaining aware of the algebraic requirements for catastrophes. The art of nonlinear model building is a delicate dance with two partners, algebraic forms that produce known effects and a substantive understanding of the complexities of social phenomena. Coordinating the two by mixing structure to match complexity is the job of the theorist, and it is the single greatest creative challenge of any researcher." (Courtney Brown, "Chaos and Catastrophe Theories", 1995)

"If the null hypothesis is not rejected, [Sir Ronald] Fisher's position was that nothing could be concluded. But researchers find it hard to go to all the trouble of conducting a study only to conclude that nothing can be concluded." (Frank L Schmidt, "Statistical Significance Testing and Cumulative Knowledge", "Psychology: Implications for Training of Researchers, Psychological Methods" Vol. 1 (2), 1996)

On Research (1900-1949)

"Scientific facts are of little value in themselves. Their significance is their bearing upon other facts, enabling us to generalize and so to discover principles, just as the accurate measurement of the position of a star may be without value in itself, but in relation to other similar measurement of other stars may become the means of discovering their proper motions. We refine our instruments; we render more trustworthy our means of observation we extend our range of experimental inquiry, and thus lay the foundation for the future work, with the full knowledge that, although our researches can not extend beyond certain limits, the field itself is, even within those limits, inexhaustible." (Elihu Thompson, "The Field of Experimental Research", 1901)

"[…] scientific research is somewhat like unraveling complicated tangles of strings, in which luck is almost as vital as skill and accurate observation." (Ernst Mach, "Knowledge and Error: Sketches on the Psychology of Enquiry", 1905)

"At bottom each 'exact' science is, and must be speculative, and its chief tool of research, too rarely used with both courage and judgement, is the regulated imagination." (Reginald A Daly, "Igneous Rocks and their Origin", 1914)

"Physics has progressed because, in the first place, she accepted the uniformity of nature; because, in the next place, she early discovered the value of exact measurements; because, in the third place, she concentrated her attention on the regularities that underlie the complexities of phenomena as they appear to us; and lastly, and not the least significant, because she emphasized the importance of the experimental method of research. An ideal or crucial experiment is a study of an event, controlled so as to give a definite and measurable answer to a question - an answer in terms of specific theoretical ideas, or better still an answer in terms of better understood relations." (Thomas H Morgan, "The Relation of Biology to Physics", Science Vol. LXV (1679),  1927)

"Research is fundamentally a state of mind involving continual re­examination of doctrines and axioms upon which current thought and action are based. It is, therefore, critical of existing practices." (Theobald Smith, "The Influence of Research in Bringing into Closer Relationship the Practice of Medicine and Public Health Activities", American Journal of Medical Sciences, 1929)

"In every important advance the physicist finds that the fundamental laws are simplified more and more as experimental research advances. He is astonished to notice how sublime order emerges from what appeared to be chaos. And this cannot be traced back to the workings of his own mind but is due to a quality that is inherent in the world of perception." (Albert Einstein, 1932)

"Statistics is a scientific discipline concerned with collection, analysis, and interpretation of data obtained from observation or experiment. The subject has a coherent structure based on the theory of Probability and includes many different procedures which contribute to research and development throughout the whole of Science and Technology." (Egon Pearson, 1936)

"The researcher worker, in his efforts to express the fundamental laws of Nature in mathematical form, should strive mainly for mathematical beauty. He should still take simplicity into consideration in a subordinate way to beauty. […] It often happens that the requirements of simplicity and beauty are the same, but where they clash the latter must take precedence." (Paul A M Dirac, "The Relation Between Mathematics and Physics", Proceedings of the Royal Society , Volume LIX, 1939)

"While practical benefits often result from pure academic research […], such benefits are not guaranteed and cannot be predicted; nor need they be seen as the ultimate goal." (Abraham Flexner, 1939)

"[…] the major mathematical research acquires an organization and orientation similar to the poetical function which, adjusting by means of metaphor disjunctive elements, displays a structure identical to the sensitive universe. Similarly, by means of its axiomatic or theoretical foundation, mathematics assimilates various doctrines and serves the instructive purpose, the one set up by the unifying moral universe of concepts. " (Dan Barbilian, "The Autobiography of the Scientist", 1940)

"Mathematical research can lend its organisational characteristics to poetry, whereby disjointed metaphors take on a universal sense. Similarly, the axiomatic foundations of group theory can be assimilated into a larger moral concept of a unified universe. Without this, mathematics would be a laborious Barbary." (Dan Barbilian, "The Autobiography of the Scientist", 1940)

"Unlike art, science is genuinely progressive. Achievement in the fields of research and technology is cumulative; each generation begins at the point where its predecessor left off." (Aldous Huxley, "Science, Liberty and Peace", 1946)

"A successful hypothesis is not necessarily a permanent hypothesis, but it is one which stimulates additional research, opens up new fields, or explains and coordinates previously unrelated facts." (Farrington Daniels, "Outlines of Physical Chemistry", 1948)