10 June 2012

🏷️Knowledge Representation: On Theories (Quotes)

“Reason may be employed in two ways to establish a point: first for the purpose of furnishing sufficient proof of some principle, as in natural science, where sufficient proof can be brought to show that the movement of the heavens is always of uniform velocity. Reason is employed in another way, not as furnishing a sufficient proof of a principle, but as confirming an already established principle, by showing the congruity of its results […]” (Saint Thomas Aquinas, “Summa Theologica”, cca. 1266-1273)

“No one has yet been found so firm of mind and purpose as resolutely to compel himself to sweep away all theories and common notions, and to apply the understanding, thus made fair and even, to a fresh examination of particulars. Thus it happens that human knowledge, as we have it, is a mere medley and ill-digested mass, made up of much credulity and much accident, and also of the childish notions which we at first imbibed.” (Sir Francis Bacon, “Novum Organum” Book 2, 1620)

“We are under obligation to the ancients for having exhausted all the false theories that could be formed.” (Bernard le Bovier de Fontenelle, “Digression sur les Anciens et les Modernes", 1688)

“The moment a person forms a theory, his imagination sees, in every object, only the traits which favor that theory.” (Thomas Jefferson, [letter to Charles Thompson] 1787)

“It is not possible to feel satisfied at having said the last word about some theory as long as it cannot be explained in a few words to any passerby encountered in the street.” (Joseph D Gergonne, [letter] 1825)

“[…] in order to observe, our mind has need of some theory or other. If in contemplating phenomena we did not immediately connect them with principles, not only would it be impossible for us to combine these isolated observations, and therefore to derive profit from them, but we should even be entirely incapable of remembering facts, which would for the most remain unnoted by us.” (Auguste Comte, “Cours de Philosophie Positive”, 1830-1842)

“[Precision] is the very soul of science; and its attainment afford the only criterion, or at least the best, of the truth of theories, and the correctness of experiments.” (John F W Herschel, “A Preliminary Discourse on the Study of Natural Philosophy”, 1830)

“Theories are always very thin and unsubstantial; experience only is tangible.” (Hosea Ballou, ”Universalist Expositor”, 1831)

"The function of theory is to put all this in systematic order, clearly and comprehensively, and to trace each action to an adequate, compelling cause. […] Theory should cast a steady light on all phenomena so that we can more easily recognize and eliminate the weeds that always spring from ignorance; it should show how one thing is related to another, and keep the important and the unimportant separate. If concepts combine of their own accord to form that nucleus of truth we call a principle, if they spontaneously compose a pattern that becomes a rule, it is the task of the theorist to make this clear." (Carl von Clausewitz, "On War", 1832)

"The insights gained and garnered by the mind in its wanderings among basic concepts are benefits that theory can provide. Theory cannot equip the mind with formulas for solving problems, nor can it mark the narrow path on which the sole solution is supposed to lie by planting a hedge of principles on either side. But it can give the mind insight into the great mass of phenomena and of their relationships, then leave it free to rise into the higher realms of action."(Carl von Clausewitz, "On War", 1832)

"Theories usually result from the precipitate reasoning of an impatient mind which would like to be rid of phenomena and replace them with images, concepts, indeed often with mere words." (Johann Wolfgang von Goethe, "Maxims and Reflections", 1833)

“How wonderful it is to me the simplicity of nature when we rightly interpret her laws and how different the convictions which they produce on the mind in comparison with the uncertain conclusions which hypothesis or even theory present.” (Michael Faraday, [letter to Svanberg] 1850)

“Every detection of what is false directs us towards what is true: every trial exhausts some tempting form of error. Not only so; but scarcely any attempt is entirely a failure; scarcely any theory, the result of steady thought, is altogether false; no tempting form of error is without some latent charm derived from truth.” (William Whewell, “Lectures on the History of Moral Philosophy in England”, 1852)

“The dimmed outlines of phenomenal things all merge into one another unless we put on the focusing-glass of theory, and screw it up sometimes to one pitch of definition and sometimes to another, so as to see down into different depths through the great millstone of the world.” (James C Maxwell, “Are There Real Analogies in Nature?”, 1856) 

“[…] ideas may be both novel and important, and yet, if they are incorrect – if they lack the very essential support of incontrovertible fact, they are unworthy of credence. Without this, a theory may be both beautiful and grand, but must be as evanescent as it is beautiful, and as unsubstantial as it is grand.” (George Brewster, “A New Philosophy of Matter”, 1858)
“The world little knows how many of the thoughts and theories which have passed through the mind of a scientific investigator have been crushed in silence and secrecy; that in the most successful instances not a tenth of the suggestions, the hopes, the wishes, the preliminary conclusions have been realized.” (Michael Faraday, “The Forces of Matter”, 1860)

“Observation is so wide awake, and facts are being so rapidly added to the sum of human experience, that it appears as if the theorizer would always be in arrears, and were doomed forever to arrive at imperfect conclusion; but the power to perceive a law is equally rare in all ages of the world, and depends but little on the number of facts observed.” (Henry Thoreau, “A Week on the Concord and Merrimack Rivers”, 1862) 

“If an idea presents itself to us, we must not reject it simply because it does not agree with the logical deductions of a reigning theory.” (Claude Bernard, "An Introduction to the Study of Experimental Medicine", 1865)

"Science asks no questions about the ontological pedigree or a priori character of a theory, but is content to judge it by its performance; and it is thus that a knowledge of nature, having all the certainty which the senses are competent to inspire, has been attained - a knowledge which maintains a strict neutrality toward all philosophical systems and concerns itself not with the genesis or a priori grounds of ideas." (Chauncey Wright, "The Philosophy of Herbert Spencer", North American Review, 1865)

 “Step by step we cross great eras in the development of thought: there is no sudden gigantic stride; a theory proceeds by slow evolution until it dominates or is destroyed.” (George F Rodwell, “Theory of Phlogiston”, ‘The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science’ 35, 1868)

"Isolated facts and experiments have in themselves no value, however great their number may be. They only become valuable in a theoretical or practical point of view when they make us acquainted with the law of a series of uniformly recurring phenomena, or, it may be, only give a negative result showing an incompleteness in our knowledge of such a law, till then held to be perfect." (Hermann von Helmholtz, "The Aim and Progress of Physical Science", 1869)

 “The triumph of a theory is to embrace the greatest number and the greatest variety of facts.” (Charles A Wurtz, “A History of Chemical Theory from the Age of Lavoisier to the Present Time”, 1869)

“The aim of natural science is to obtain connections among phenomena. Theories, however, are like withered leaves, which drop off after having enabled the organism of science to breathe for a time." (Ernst Mach, “Die Geschichte und die Wurzel des Satzes von der Erhaltung der Arbeit”, 1871)
“The possession of an original theory which has not yet been assailed must certainly sweeten the temper of a man who is not beforehand ill-natured.” (George Eliot, “Theophrastus Such”, 1879)

"Mathematics is not the discoverer of laws, for it is not induction; neither is it the framer of theories, for it is not hypothesis; but it is the judge over both, and it is the arbiter to which each must refer its claims; and neither law can rule nor theory explain without the sanction of mathematics.” (Benjamin Peirce, “Linear Associative Algebra”, American Journal of Mathematics, Vol. 4, 1881)

"As for everything else, so for a mathematical theory: beauty can be perceived but not explained." (Arthur Cayley, [president's address] 1883)

"It would be an error to suppose that the great discoverer seizes at once upon the truth, or has any unerring method of divining it. In all probability the errors of the great mind exceed in number those of the less vigorous one. Fertility of imagination and abundance of guesses at truth are among the first requisites of discovery; but the erroneous guesses must be many times as numerous as those that prove well founded. The weakest analogies, the most whimsical notions, the most apparently absurd theories, may pass through the teeming brain, and no record remain of more than the hundredth part. […] The truest theories involve suppositions which are inconceivable, and no limit can really be placed to the freedom of hypotheses." (W Stanley Jevons, "The Principles of Science: A Treatise on Logic and Scientific Method", 1877)

“Perfect readiness to reject a theory inconsistent with fact is a primary requisite of the philosophic mind. But it, would be a mistake to suppose that this candour has anything akin to fickleness; on the contrary, readiness to reject a false theory may be combined with a peculiar pertinacity and courage in maintaining an hypothesis as long as its falsity is not actually apparent.” (William S Jevons, “The Principles of Science”, 1887)

“The history of thought should warn us against concluding that because the scientific theory of the world is the best that has yet been formulated, it is necessarily complete and final. We must remember that at bottom the generalizations of science or, in common parlance, the laws of nature are merely hypotheses devised to explain that ever-shifting phantasmagoria of thought which we dignify with the high-sounding names of the world and the universe.” (Sir James G Frazer, “The Golden Bough: A Study in Magic and Religion”, 1890) 

“One is almost tempted to assert that quite apart from its intellectual mission, theory is the most practical thing conceivable, the quintessence of practice as it were, since the precision of its conclusions cannot be reached by any routine of estimating or trial and error; although given the hidden ways of theory, this will hold only for those who walk them with complete confidence.” (Ludwig E Boltzmann, “On the Significance of Theories”, 1890) 

“Facts are not much use, considered as facts. They bewilder by their number and their apparent incoherency. Let them be digested into theory, however, and brought into mutual harmony, and it is another matter. Theory is of the essence of facts. Without theory scientific knowledge would be only worthy of the mad house.” (Oliver Heaviside, “Electromagnetic Theory”, 1893)

”Scientific facts accumulate rapidly, and give rise to theories with almost equal rapidity. These theories are often wonderfully enticing, and one is apt to pass from one to another, from theory to theory, without taking care to establish each before passing on to the next, without assuring oneself that the foundation on which one is building is secure. Then comes the crash; the last theory breaks down utterly, and on attempting to retrace our steps to firm ground and start anew, we may find too late that one of the cards, possibly at the very foundation of the pagoda, is either faultily placed or in itself defective, and that this blemish easily remedied if detected in time has, neglected, caused the collapse of the whole structure on whose erection so much skill and perseverance have been spent.” (Arthur M Marshall, 1894)

"A mathematical theory is not to be considered complete until you have made it so clear that you can explain it to the first man whom you meet on the street." (David Hilbert [paraphrasing Joseph D Gergonne], "Mathematical Problems", 1900)

“One does not ask whether a scientific theory is true, but only whether it is convenient.” (Henri Poincaré, “La Science et l'Hypothèse”, 1902) 

“With the extension of mathematical knowledge will it not finally become impossible for the single investigator to embrace all departments of this knowledge? In answer let me point out how thoroughly it is ingrained in mathematical science that every real advance goes hand in hand with the invention of sharper tools and simpler methods which at the same time assist in understanding earlier theories and to cast aside some more complicated developments. It is therefore possible for the individual investigator, when he makes these sharper tools and simpler methods his own, to find his way more easily in the various branches of mathematics than is possible in any other science.” (David Hilbert. “Mathematical Problems”, Bulletin of the American Mathematical Society Vol. 8, 1902)

"But surely it is self-evident that every theory is merely a framework or scheme of concepts together with their necessary relations to one another, and that the basic elements can be constructed as one pleases." (Gottlob Frege, "On the Foundations of Geometry and Formal Theories of Arithmetic" , cca. 1903-1909)

“It [a theory] ought to furnish a compass which, if followed, will lead the observer further and further into previously unexplored regions. Whether these regions will be barren or fertile experience alone will decide; but, at any rate, one who is guided in this way will travel onward in a definite direction, and will not wander aimlessly to and fro.” (Sir Joseph J Thomson, “The Corpuscular Theory of Matter”, 1907)

"Things and events explain themselves, and the business of thought is to brush aside the verbal and conceptual impediments which prevent them from doing so. Start with the notion that it is you who explain the Object, and not the Object that explains itself, and you are bound to end in explaining it away. It ceases to exist, its place being taken by a parcel of concepts, a string of symbols, a form of words, and you find yourself contemplating, not the thing, but your theory of the thing." (Lawrence P Jacks, "The Usurpation Of Language", 1910)

“The existence of analogies between central features of various theories implies the existence of a general theory which underlies the particular theories and unifies them with respect to those central features." (Eliakim H Moore, “Introduction to a Form of General Analysis”, 1910)

“The discovery which has been pointed to by theory is always one of profound interest and importance, but it is usually the close and crown of a long and fruitful period, whereas the discovery which comes as a puzzle and surprise usually marks a fresh epoch and opens a new chapter in science.” (Sir Oliver J Lodge, [Becquerel Memorial Lecture] Journal of the Chemical Society, Transactions 101 (2), 1912) 

"There is no great harm in the theorist who makes up a new theory to fit a new event. But the theorist who starts with a false theory and then sees everything as making it come true is the most dangerous enemy of human reason." (Gilbert K Chesterton, "The Flying Inn", 1914)

"Theory is the best guide for experiment - that were it not for theory and the problems and hypotheses that come out of it, we would not know the points we wanted to verify, and hence would experiment aimlessly" (Henry Hazlitt,  “Thinking as a Science”, 1916)

“As soon as science has emerged from its initial stages, theoretical advances are no longer achieved merely by a process of arrangement. Guided by empirical data, the investigator rather develops a system of thought which, in general, is built up logically from a small number of fundamental assumptions, the so-called axioms. We call such a system of thought a theory. The theory finds the justification for its existence in the fact that it correlates a large number of single observations, and it is just here that the 'truth' of the theory lies. “ (Albert Einstein: “Relativity: The Special and General Theory”, 1916)

 “No fairer destiny could be allotted to any physical theory, than that it should of itself point out the way to the introduction of a more comprehensive theory, in which it lives on as a limiting case.” (Albert Einstein: “Relativity, The Special and General Theory”, 1916)

“To come very near to a true theory, and to grasp its precise application, are two very different things, as the history of a science teaches us. Everything of importance has been said before by somebody who did not discover it.” (Alfred N Whitehead, “The Organization of Thought”, 1917)

”Facts are carpet-tacks under the pneumatic tires of theory.” (Austin O’Malley, “Keystones of Thought”, 1918)

"Philosophy, like science, consists of theories or insights arrived at as a result of systemic reflection or reasoning in regard to the data of experience. It involves, therefore, the analysis of experience and the synthesis of the results of analysis into a comprehensive or unitary conception. Philosophy seeks a totality and harmony of reasoned insight into the nature and meaning of all the principal aspects of reality." (Joseph A Leighton, "The Field of Philosophy: An outline of lectures on introduction to philosophy", 1919)

“[…] analogies are not ‘aids’ to the establishment of theories; they are an utterly essential part of theories, without which theories would be completely valueless and unworthy of the name. It is often suggested that the analogy leads to the formulation of the theory, but that once the theory is formulated the analogy has served its purpose and may be removed or forgotten. Such a suggestion is absolutely false and perniciously misleading.” (Norman R Campbell, “Physics, the Elements”, 1920) 

“Nothing is more interesting to the true theorist than a fact which directly contradicts a theory generally accepted up to that time, for this is his particular work.” (Max Planck, “A Survey of Physics”, 1925)

“[…] the mere collection of facts, without some basis of theory for guidance and elucidation, is foolish and profitless.” (Gamaliel Bradford, “Darwin”, 1926)

"It is characteristic of a good scientific theory that it makes no more assumptions than are needed to explain the facts under consideration and predict a few more." (John B S Haldane, "Possible Worlds and Other Essays", 1928)

“Often a liberal antidote of experience supplies a sovereign cure for a paralyzing abstraction built upon a theory.” (Benjamin N Cardozo, “Paradoxes of Legal Science”, 1928)

“[…] facts are too bulky to be lugged about conveniently except on the wheels of theory.” (Julian Huxley, “Essays of a Biologist”, 1929)

 “We can invent as many theories we like, and any one of them can be made to fit the facts. But that theory is always preferred which makes the fewest number of assumptions.” (Albert Einstein [interview] 1929)

"Every theory of the course of events in nature is necessarily based on some process of simplification and is to some extent, therefore, a fairy tale." (Sir Napier Shaw, “Manual of Meteorology”, 1932)

“[…] the process of scientific discovery may be regarded as a form of art. This is best seen in the theoretical aspects of Physical Science. The mathematical theorist builds up on certain assumptions and according to well understood logical rules, step by step, a stately edifice, while his imaginative power brings out clearly the hidden relations between its parts. A well-constructed theory is in some respects undoubtedly an artistic production.” (Ernest Rutherford, 1932)

"It can scarcely be denied that the supreme goal of all theory is to make the irreducible basic elements as simple and as few as possible without having to surrender the adequate representation of a single datum of experience." (Albert Einstein, [lecture] 1933)

“All the theories and hypotheses of empirical science share this provisional character of being established and accepted ‘until further notice’ [...]” (Carl G Hempel, "Geometry and Empirical Science”, 1935)

”[while] the traditional way is to regard the facts of science as something like the parts of a jig-saw puzzle, which can be fitted together in one and only one way, I regard them rather as the tiny pieces of a mosaic, which can be fitted together in many ways. A new theory in an old subject is, for me, a new mosaic pattern made with the pieces taken from an older pattern. [...] Theories come into fashion and theories go out of fashion, but the facts connected with them stay.” (William H George, “The Scientist in Action”, 1936)

“Every new theory as it arises believes in the flush of youth that it has the long sought goal; it sees no limits to its applicability, and believes that at last it is the fortunate theory to achieve the 'right' answer.” (Percy W Bridgman, “The Nature of Physical Theory”, 1936)

"When an active individual of sound common sense perceives the sordid state of the world, desire to change it becomes the guiding principle by which he organizes given facts and shapes them into a theory. The methods and categories as well as the transformation of the theory can be understood only in connection with his taking of sides. This, in turn, discloses both his sound common sense and the character of the world. Right thinking depends as much on right willing as right willing on right thinking." (Max Horkheimer, "The Latest Attack on Metaphysics", 1937)

“Creating a new theory is not like destroying an old barn and erecting a skyscraper in its place. It is rather like climbing a mountain, gaining new and wider views, discovering unexpected connections between our starting point and its rich environment. But the point from which we started out still exists and can be seen, although it appears smaller and forms a tiny part of our broad view gained by the mastery of the obstacles on our adventurous way up.” (Albert Einstein & Leopold Infeld, ”The Evolution of Physics”, 1938)

“With the help of physical theories we try to find our way through the maze of observed facts, to order and understand the world of our sense impressions.” (Albert Einstein & Leopold Infeld, ”The Evolution of Physics”, 1938)
"There is nothing as practical as a good theory” (Kurt Z Lewin, "Psychology and the process of group living", Journal of Social Psychology 17, 1943)

“To a scientist a theory is something to be tested. He seeks not to defend his beliefs, but to improve them. He is, above everything else, an expert at ‘changing his mind’.” (Wendell Johnson, 1946)

"But, despite their remoteness from sense experience, we do have something like a perception of the objects of set theory, as is seen from the fact that the axioms force themselves upon us as being true. I don't see any reason why we should have less confidence in this kind of perception, i.e., in mathematical intuition, than in sense perception, which induces us to build up physical theories and to expect that future sense perception will agree with them and, moreover, to believe that a question not decidable now has meaning and may be decided in future." (Kurt Gödel, "What is Cantor’s Continuum problem?", American Mathematical Monthly 54, 1947)

“One expects a mathematical theorem or a mathematical theory not only to describe and to classify in a simple and elegant way numerous and a priori disparate special cases. One also expects ‘elegance’ in its ‘architectural’ structural makeup.” (John von Neumann, "The Mathematician" [in "Works of the Mind" Vol. I (1), 1947]) 

”We can put it down as one of the principles learned from the history of science that a theory is only overthrown by a better theory, never merely by contradictory facts.” (James B Conant, “On Understanding Science”, 1947)

"A theory is the more impressive the greater the simplicity of its premises is, the more different kinds of things it relates, and the more extended its area of applicability." (Albert Einstein, "Autobiographical Notes", 1949)

“When a scientific theory is firmly established and confirmed, it changes its character and becomes a part of the metaphysical background of the age: a doctrine is transformed into a dogma.” (Max Born, “Natural Philosophy of Cause and Chance”, 1949)
"As every mathematician knows, nothing is more fruitful than these obscure analogies, these indistinct reflections of one theory into another, these furtive caresses, these inexplicable disagreements; also nothing gives the researcher greater pleasure." (André Weil, "De la Métaphysique aux Mathématiques", 1960)

”In imagination there exists the perfect mystery story. Such a story presents all the essential clews, and compels us to form our own theory of the case. If we follow the plot carefully we arrive at the complete solution for ourselves just before the author’s disclosure at the end of the book. The solution itself, contrary to those of inferior mysteries, does not disappoint us; moreover, it appears at the very moment we expect it.” (Leopold Infeld, “The Evolution of Physics”, 1961)

"It seems to be one of the fundamental features of nature the fundamental physical laws are described in terms of a mathematical theory of great beauty and power, needing quite a high standard of mathematics for one to understand it. You may wonder: Why is nature constructed along these lines? One can only answer that our present knowledge seems to show that nature is so constructed. We simply have to accept it. " (Paul A M Dirac , “The Evolution of the Physicist’s Picture of Nature”, Scientific American, 1963)

“A theory with mathematical beauty is more likely to be correct than an ugly one that fits some experimental data. ” (Paul A M Dirac, Scientific American, 1963)

"The final test of a theory is its capacity to solve the problems which originated it." (George Dantzig, "Linear Programming and Extensions", 1963)

“It is easy to obtain confirmations, or verifications, for nearly every theory - if we look for confirmations. Confirmations should count only if they are the result of risky predictions. […] A theory which is not refutable by any conceivable event is non-scientific. Irrefutability is not a virtue of a theory (as people often think) but a vice. Every genuine test of a theory is an attempt to falsify it, or refute it.” (Karl R Popper, “Conjectures and Refutations: The Growth of Scientific Knowledge”, 1963)

"One of the endlessly alluring aspects of mathematics is that its thorniest paradoxes have a way of blooming into beautiful theories.” (Philip J Davis, "Number", Scientific American, No 211 (3), 1964)

“Another thing I must point out is that you cannot prove a vague theory wrong. If the guess that you make is poorly expressed and rather vague, and the method that you use for figuring out the consequences is a little vague - you are not sure, and you say, 'I think everything's right because it's all due to so and so, and such and such do this and that more or less, and I can sort of explain how this works' […] then you see that this theory is good, because it cannot be proved wrong! Also if the process of computing the consequences is indefinite, then with a little skill any experimental results can be made to look like the expected consequences.” (Richard P Feynman, “The Character of Physical Law”, 1965)

“This is the key of modern science and it was the beginning of the true understanding of Nature - this idea to look at the thing, to record the details, and to hope that in the information thus obtained might lie a clue to one or another theoretical interpretation.” (Richard P Feynman, “The Character of Physical Law”, 1965)

"Theories are usually introduced when previous study of a class of phenomena has revealed a system of uniformities. […] Theories then seek to explain those regularities and, generally, to afford a deeper and more accurate understanding of the phenomena in question. To this end, a theory construes those phenomena as manifestations of entities and processes that lie behind or beneath them, as it were." (Carl G Hempel, "Philosophy of Natural Science", 1966)

“A theory is scientific only if it can be disproved. But the moment you try to cover absolutely everything the chances are that you cover nothing. “ (Sir Hermann Bondi, “Assumption and Myth in Physical Theory”, 1967) 

 ”As soon as we inquire into the reasons for the phenomena, we enter the domain of theory, which connects the observed phenomena and traces them back to a single ‘pure’ phenomena, thus bringing about a logical arrangement of an enormous amount of observational material.” (Georg Joos, “Theoretical Physics”, 1968)

"It makes no sense to say what the objects of a theory are, beyond saying how to interpret or reinterpret that theory in another." (Willard v O Quine, "Ontological Relativity and Other Essays", 1969)

“One often hears that successive theories grow ever closer to, or approximate more and more closely to, the truth. Apparently, generalizations like that refer not to the puzzle-solutions and the concrete predictions derived from a theory but rather to its ontology, to the match, that is, between the entities with which the theory populates nature and what is ‘really there’.” (Thomas S Kuhn, “The Structure of Scientific Revolutions”, 1970)

“Blind commitment to a theory is not an intellectual virtue: it is an intellectual crime.” (Imre Lakatos, [radio Lecture] 1973) 

“For hundreds of pages the closely-reasoned arguments unroll, axioms and theorems interlock. And what remains with us in the end? A general sense that the world can be expressed in closely-reasoned arguments, in interlocking axioms and theorems.” (Michael Frayn, “Constructions”, 1974)

“No theory ever agrees with all the facts in its domain, yet it is not always the theory that is to blame. Facts are constituted by older ideologies, and a clash between facts and theories may be proof of progress. It is also a first step in our attempt to find the principles implicit in familiar observational notions.” (Paul K Feyerabend, “Against Method: Outline of an Anarchistic Theory of Knowledge”, 1975) 

“A physical theory remains an empty shell until we have found a reasonable physical interpretation.” (Peter Bergmann, [conference] 1976)

“Owing to his lack of knowledge, the ordinary man cannot attempt to resolve conflicting theories of conflicting advice into a single organized structure. He is likely to assume the information available to him is on the order of what we might think of as a few pieces of an enormous jigsaw puzzle. If a given piece fails to fit, it is not because it is fraudulent; more likely the contradictions and inconsistencies within his information are due to his lack of understanding and to the fact that he possesses only a few pieces of the puzzle. Differing statements about the nature of things […] are to be collected eagerly and be made a part of the individual's collection of puzzle pieces. Ultimately, after many lifetimes, the pieces will fit together and the individual will attain clear and certain knowledge.” (Alan R Beals, “Strategies of Resort to Curers in South India” [contributed in Charles M. Leslie (ed.), “Asian Medical Systems: A Comparative Study”, 1976]) 

 “A good scientific law or theory is falsifiable just because it makes definite claims about the world. For the falsificationist, If follows fairly readily from this that the more falsifiable a theory is the better, in some loose sense of more. The more a theory claims, the more potential opportunities there will be for showing that the world does not in fact behave in the way laid down by the theory. A very good theory will be one that makes very wide-ranging claims about the world, and which is consequently highly falsifiable, and is one that resists falsification whenever it is put to the test.” (Alan F Chalmers,  “What Is This Thing Called Science?”, 1976)

”Facts do not ‘speak for themselves’; they are read in the light of theory. Creative thought, in science as much as in the arts, is the motor of changing opinion. Science is a quintessentially human activity, not a mechanized, robot-like accumulation of objective information, leading by laws of logic to inescapable interpretation.” (Stephen J Gould, “Ever Since Darwin”, 1977)

“Our mistake is not that we take our theories too seriously, but that we do not take them seriously enough. It is always hard to realize that these numbers and equations we play with at our desks have something to do with the real world.” (Steven Weinberg, “The First Three Minutes”, 1977)

"The theory of our modern technic shows that nothing is as practical as the theory." (J Robert Oppenheimer, "Reflex", 1977)

“Science has so accustomed us to devising and accepting theories to account for the facts we observe, however fantastic, that our minds must begin their manufacture before we are aware of it.” (Gene Wolfe, “Seven American Nights”, 1978) 

"For mathematicians, only one test was necessary: once the elements of any mathematical theory were seen to be consistent, then they were mathematically acceptable. Nothing more was required." (Joseph W  Dauben, "Georg Cantor: His Mathematics and Philosophy of the Infinite", 1979)

"Science, since people must do it, is a socially embedded activity. It progresses by hunch, vision, and intuition. Much of its change through time does not record a closer approach to absolute truth, but the alteration of cultural contexts that influence it so strongly. Facts are not pure and unsullied bits of information; culture also influences what we see and how we see it. Theories, moreover, are not inexorable inductions from facts. The most creative theories are often imaginative visions imposed upon facts; the source of imagination is also strongly cultural.” (Stephen J Gould, “The Mismeasure of Man”, 1980)

"Facts and theories are different things, not rungs in a hierarchy of increasing certainty. Facts are the world's data. Theories are structures of ideas that explain and interpret facts. Facts do not go away while scientists debate rival theories for explaining them." (Stephen J Gould "Evolution as Fact and Theory", 1981)

"A real change of theory is not a change of equations - it is a change of mathematical structure, and only fragments of competing theories, often not very important ones conceptually, admit comparison with each other within a limited range of phenomena." (Yuri I Manin, "Mathematics and Physics", 1981)

"The principal aim of physical theories is understanding. A theory's ability to find a number is merely a useful criterion for a correct understanding." (Yuri I Manin, "Mathematics and Physics", 1981)

“Data in isolation are meaningless, a collection of numbers. Only in context of a theory do they assume significance […]” (George Greenstein, “Frozen Star”, 1983)

“In all scientific fields, theory is frequently more important than experimental data. Scientists are generally reluctant to accept the existence of a phenomenon when they do not know how to explain it. On the other hand, they will often accept a theory that is especially plausible before there exists any data to support it.” (Richard Morris, 1983) 

"Physics is like that. It is important that the models we construct allow us to draw the right conclusions about the behaviour of the phenomena and their causes. But it is not essential that the models accurately describe everything that actually happens; and in general it will not be possible for them to do so, and for much the same reasons. The requirements of the theory constrain what can be literally represented. This does not mean that the right lessons cannot be drawn. Adjustments are made where literal correctness does not matter very much in order to get the correct effects where we want them; and very often, as in the staging example, one distortion is put right by another. That is why it often seems misleading to say that a particular aspect of a model is false to reality: given the other constraints that is just the way to restore the representation." (Nancy Cartwright, "How the Laws of Physics Lie", 1983)

"Scientific theories must tell us both what is true in nature, and how we are to explain it. […] Scientific theories are thought to explain by dint of the descriptions they give of reality." (Nancy Cartwright, "How the Laws of Physics Lie", 1983)

“The heart of mathematics consists of concrete examples and concrete problems. Big general theories are usually afterthoughts based on small but profound insights; the insights themselves come from concrete special cases.” (Paul Halmos, “Selecta: Expository writing”, 1983)

“Until now, physical theories have been regarded as merely models with approximately describe the reality of nature. As the models improve, so the fit between theory and reality gets closer. Some physicists are now claiming that supergravity is the reality, that the model and the real world are in mathematically perfect accord.” (Paul C W Davies, “Superforce”, 1984)

“Nature is disordered, powerful and chaotic, and through fear of the chaos we impose system on it. We abhor complexity, and seek to simplify things whenever we can by whatever means we have at hand. We need to have an overall explanation of what the universe is and how it functions. In order to achieve this overall view we develop explanatory theories which will give structure to natural phenomena: we classify nature into a coherent system which appears to do what we say it does.” (James Burke, “The Day the Universe Changed”, 1985) 

”Experience without theory teaches nothing.” (William E Deming, “Out of the Crisis”, 1986)

“All great theories are expansive, and all notions so rich in scope and implication are underpinned by visions about the nature of things. You may call these visions ‘philosophy’, or ‘metaphor’, or ‘organizing principle’, but one thing they are surely not - they are not simple inductions from observed facts of the natural world.” (Stephen J Gould, “Time’s Arrow, Time’s Cycle”, 1987)

"Facts do not 'speak for themselves'. They speak for or against competing theories. Facts divorced from theory or visions are mere isolated curiosities." (Thomas Sowell, "A Conflict of Visions: Ideological Origins of Political Struggles", 1987)

“[…] no good model ever accounted for all the facts, since some data was bound to be misleading if not plain wrong. A theory that did fit all the data would have been ‘carpentered’ to do this and would thus be open to suspicion.” (Francis H C Crick, “What Mad Pursuit: A Personal View of Scientific Discovery”, 1988)

“Any physical theory is always provisional, in the sense that it is only a hypothesis: you can never prove it. No matter how many times the results of experiments agree with some theory, you can never be sure that the next time the result will not contradict the theory.” (Stephen Hawking,  “A Brief History of Time”, 1988)

“Theories are not so much wrong as incomplete." (Isaac Asimov, "The Relativity of Wrong", 1988)

”A discovery in science, or a new theory, even where it appears most unitary and most all-embracing, deals with some immediate element of novelty or paradox within the framework of far vaster, unanalyzed, unarticulated reserves of knowledge, experience, faith, and presupposition. Our progress is narrow: it takes a vast world unchallenged and for granted.” (James R Oppenheimer, “Atom and Void”, 1989)

 “Model is used as a theory. It becomes theory when the purpose of building a model is to understand the mechanisms involved in the developmental process. Hence as theory, model does not carve up or change the world, but it explains how change takes place and in what way or manner. This leads to build change in the structures.” (Laxmi K Patnaik, “Model Building in Political Science”, The Indian Journal of Political Science Vol. 50 (2), 1989)
“A law explains a set of observations; a theory explains a set of laws. […] Unlike laws, theories often postulate unobservable objects as part of their explanatory mechanism.” (John L Casti, “Searching for Certainty”, 1990)

“It is in the nature of theoretical science that there can be no such thing as certainty. A theory is only ‘true’ for as long as the majority of the scientific community maintain the view that the theory is the one best able to explain the observations.” (Jim Baggott, “The Meaning of Quantum Theory”, 1992)

“Scientists use mathematics to build mental universes. They write down mathematical descriptions - models - that capture essential fragments of how they think the world behaves. Then they analyse their consequences. This is called 'theory'. They test their theories against observations: this is called 'experiment'. Depending on the result, they may modify the mathematical model and repeat the cycle until theory and experiment agree. Not that it's really that simple; but that's the general gist of it, the essence of the scientific method.” (Ian Stewart & Martin Golubitsky, “Fearful Symmetry: Is God a Geometer?”, 1992)

"Science is not about control. It is about cultivating a perpetual condition of wonder in the face of something that forever grows one step richer and subtler than our latest theory about it. It is about  reverence, not mastery." (Richard Power, “Gold Bug Variations”, 1993) 

“Clearly, science is not simply a matter of observing facts. Every scientific theory also expresses a worldview. Philosophical preconceptions determine where facts are sought, how experiments are designed, and which conclusions are drawn from them.” (Nancy R Pearcey & Charles B. Thaxton, “The Soul of Science: Christian Faith and Natural Philosophy”, 1994)

“The amount of understanding produced by a theory is determined by how well it meets the criteria of adequacy - testability, fruitfulness, scope, simplicity, conservatism - because these criteria indicate the extent to which a theory systematizes and unifies our knowledge.” (Theodore Schick Jr.,  “How to Think about Weird Things: Critical Thinking for a New Age”, 1995)

“Scientists, being as a rule more or less human beings, passionately stick up for their ideas, their pet theories. It's up to someone else to show you are wrong.” (Niles Eldredge, “Reinventing Darwin”, 1995)

"There is no sharp dividing line between scientific theories and models, and mathematics is used similarly in both. The important thing is to possess a delicate judgement of the accuracy of your model or theory. An apparently crude model can often be surprisingly effective, in which case its plain dress should not mislead. In contrast, some apparently very good models can be hiding dangerous weaknesses." (David Wells, "You Are a Mathematician: A wise and witty introduction to the joy of numbers", 1995)

"There are two kinds of mistakes. There are fatal mistakes that destroy a theory; but there are also contingent ones, which are useful in testing the stability of a theory." (Gian-Carlo Rota, [lecture] 1996)

"Paradigms are the most general-rather like a philosophical or ideological framework. Theories are more specific, based on the paradigm and designed to describe what happens in one of the many realms of events encompassed by the paradigm. Models are even more specific providing the mechanisms by which events occur in a particular part of the theory's realm. Of all three, models are most affected by empirical data - models come and go, theories only give way when evidence is overwhelmingly against them and paradigms stay put until a radically better idea comes along." (Lee R Beach, "The Psychology of Decision Making: People in Organizations", 1997)

"Ideas about organization are always based on implicit images or metaphors that persuade us to see, understand, and manage situations in a particular way. Metaphors create insight. But they also distort. They have strengths. But they also have limitations. In creating ways of seeing, they create ways of not seeing. There can be no single theory or metaphor that gives an all-purpose point of view, and there can be no simple 'correct theory' for structuring everything we do." (Gareth Morgan, ”Imaginization”, 1997)

“An individual understands a concept, skill, theory, or domain of knowledge to the extent that he or she can apply it appropriately in a new situation." (Howard Gardner, "The Disciplined Mind", 1999)

“[…] philosophical theories are structured by conceptual metaphors that constrain which inferences can be drawn within that philosophical theory. The (typically unconscious) conceptual metaphors that are constitutive of a philosophical theory have the causal effect of constraining how you can reason within that philosophical framework.” (George Lakoff, “Philosophy in the Flesh: The Embodied Mind and its Challenge to Western Thought”, 1999)
"All scientific theories, even those in the physical sciences, are developed in a particular cultural context. Although the context may help to explain the persistence of a theory in the face of apparently falsifying evidence, the fact that a theory arises from a particular context is not sufficient to condemn it. Theories and paradigms must be accepted, modified or rejected on the basis of evidence." (Richard P Bentall,  "Madness Explained: Psychosis and Human Nature", 2003)

“Do not be afraid of the word 'theory'. Yes, it can sound dauntingly abstract at times, and in the hands of some writers can appear to have precious little to do with the actual, visual world around us. Good theory however, is an awesome thing. [...] But unless we actually use it, it borders on the metaphysical and might as well not be used at all.” (Richard Howells,  Visual Culture, 2003)

"A scientific theory is a concise and coherent set of concepts, claims, and laws (frequently expressed mathematically) that can be used to precisely and accurately explain and predict natural phenomena." (Mordechai Ben-Ari, "Just a Theory: Exploring the Nature of Science", 2005)

“It seems that scientists are often attracted to beautiful theories in the way that insects are attracted to flowers - not by logical deduction, but by something like a sense of smell.” (Steven Weinberg, “Physics Today”, 2005)

 "In science, for a theory to be believed, it must make a prediction - different from those made by previous theories - for an experiment not yet done. For the experiment to be meaningful, we must be able to get an answer that disagrees with that prediction. When this is the case, we say that a theory is falsifiable - vulnerable to being shown false. The theory also has to be confirmable, it must be possible to verify a new prediction that only this theory makes. Only when a theory has been tested and the results agree with the theory do we advance the statement to the rank of a true scientific theory." (Lee Smolin, “The Trouble with Physics”, 2006)

"A theory appears to be beautiful or elegant (or simple, if you prefer) when it can be expressed concisely in terms of mathematics we already have." (Murray Gell-Mann, "Beauty and Truth in Physics", 2007)

"In science we try to explain reality by using models (theories). This is necessary because reality itself is too complex. So we need to come up with a model for that aspect of reality we want to understand – usually with the help of mathematics. Of course, these models or theories can only be simplifications of that part of reality we are looking at. A model can never be a perfect description of reality, and there can never be a part of reality perfectly mirroring a model." (Manfred Drosg, "Dealing with Uncertainties: A Guide to Error Analysis", 2007)

"It is also inevitable for any model or theory to have an uncertainty (a difference between model and reality). Such uncertainties apply both to the numerical parameters of the model and to the inadequacy of the model as well. Because it is much harder to get a grip on these types of uncertainties, they are disregarded, usually." (Manfred Drosg, "Dealing with Uncertainties: A Guide to Error Analysis", 2007)

"Mathematics is about truth: discovering the truth, knowing the truth, and communicating the truth to others. It would be a great mistake to discuss mathematics without talking about its relation to the truth, for truth is the essence of mathematics. In its search for the purity of truth, mathematics has developed its own language and methodologies - its own way of paring down reality to an inner essence and capturing that essence in subtle patterns of thought. Mathematics is a way of using the mind with the goal of knowing the truth, that is, of obtaining certainty.” (William Byers, “How Mathematicians Think”, 2007)

“A theory is a speculative explanation of a particular phenomenon which derives it legitimacy from conforming to the primary assumptions of the worldview of the culture in which it appears. There can be more than one theory for a particular phenomenon that conforms to a given worldview. […]  A new theory may seem to trigger a change in worldview, as in this case, but logically a change in worldview must precede a change in theory, otherwise the theory will not be viable. A change in worldview will necessitate a change in all theories in all branches of study.” (M G Jackson, “Transformative Learning for a New Worldview: Learning to Think Differently”, 2008)

“All scientific theories, even those in the physical sciences, are developed in a particular cultural context. Although the context may help to explain the persistence of a theory in the face of apparently falsifying evidence, the fact that a theory arises from a particular context is not sufficient to condemn it. Theories and paradigms must be accepted, modified or rejected on the basis of evidence.”  (Richard P Bentall,  “Madness Explained: Psychosis and Human Nature”, 2003)

“A theory is like medicine (or government): often useless, sometimes necessary, always self-serving, and on occasion lethal. So, it needs to be used with care, moderation and close adult supervision.” (Nassim N Taleb, “The Black Swan: The Impact of the Highly Improbable”, 2007)

“With each theory or model, our concepts of reality and of the fundamental constituents of the universe have changed.” (Stephen Hawking & Leonard Mlodinow, “The Grand Design”, 2010)

 “A theory is a set of deductively closed propositions that explain and predict empirical phenomena, and a model is a theory that is idealized.” (Jay Odenbaugh, “True Lies: Realism, Robustness, and Models”, Philosophy of Science, Vol. 78, No. 5, 2011)

"Science would be better understood if we called theories ‘misconceptions’ from the outset, instead of only after we have discovered their successors." (David Deutsch, "Beginning of Infinity", 2011)

"Complexity has the propensity to overload systems, making the relevance of a particular piece of information not statistically significant. And when an array of mind-numbing factors is added into the equation, theory and models rarely conform to reality." (Lawrence K Samuels, "Defense of Chaos: The Chaology of Politics, Economics and Human Action", 2013)

“[…] if one has a theory, one needs to be willing to try to prove it wrong as much as one tries to provide that it is right […]” (Lawrence M Krauss et al, A Universe from Nothing, 2013)

"Another way to secure statistical significance is to use the data to discover a theory. Statistical tests assume that the researcher starts with a theory, collects data to test the theory, and reports the results - whether statistically significant or not. Many people work in the other direction, scrutinizing the data until they find a pattern and then making up a theory that fits the pattern." (Gary Smith, "Standard Deviations", 2014)

"Data clusters are everywhere, even in random data. Someone who looks for an explanation will inevitably find one, but a theory that fits a data cluster is not persuasive evidence. The found explanation needs to make sense and it needs to be tested with uncontaminated data." (Gary Smith, "Standard Deviations", 2014)

"Data without theory can fuel a speculative stock market bubble or create the illusion of a bubble where there is none. How do we tell the difference between a real bubble and a false alarm? You know the answer: we need a theory. Data are not enough. […] Data without theory is alluring, but misleading." (Gary Smith, "Standard Deviations", 2014)

"We are hardwired to make sense of the world around us - to notice patterns and invent theories to explain these patterns. We underestimate how easily pat - terns can be created by inexplicable random events - by good luck and bad luck." (Gary Smith, "Standard Deviations", 2014)

"Mathematical modeling is the modern version of both applied mathematics and theoretical physics. In earlier times, one proposed not a model but a theory. By talking today of a model rather than a theory, one acknowledges that the way one studies the phenomenon is not unique; it could also be studied other ways. One's model need not claim to be unique or final. It merits consideration if it provides an insight that isn't better provided by some other model." (Reuben Hersh,"Mathematics as an Empirical Phenomenon, Subject to Modeling", 2017)

“Scientists generally agree that no theory is 100 percent correct. Thus, the real test of knowledge is not truth, but utility.” (Yuval N Harari, “Sapiens: A brief history of humankind”, 2017) 

"In mathematics, we often depend on the proof of a statement to offer not only a justification of its truth, but also a way of understanding its implications, its connections to other established truths - a way, in short of explaining the statement. But sometimes even though a proof does its job of showing the truth of a result it still leaves us with the nagging question of why.’ It may be elusive - given a specific proof - to describe in useful terms the type of explanation the proof actually offers. It would be good to have an adequate vocabulary to help us think about the explanatory features of mathematics (and, more generally, of science)." (Barry Mazur, "On the word ‘because’ in mathematics, and elsewhere", 2017)

“A theory is nothing but a tool to know the reality. If a theory contradicts reality, it must be discarded at the earliest.” (Awdhesh Singh, “Myths are Real, Reality is a Myth”, 2018)

19 May 2012

🏷️Knowledge Representation: On Data (Quotes)

"Mathematicians obtain the solution of a problem by the mere arrangement of data, and by reducing their reasoning to such simple steps, to conclusions so very obvious, as never to lose sight of the evidence which guides them." (Antoine Lavoisier, "Elements of Chemistry In a New Systematic Order". 1790)

"Before anything can be reasoned upon to a conclusion, certain facts, principles, or data, to reason from, must be established, admitted, or denied." (Thomas Paine, "Rights of Man", 1791)

"The modern age has a false sense of superiority because of the great mass of data at its disposal. But the valid criterion of distinction is rather the extent to which man knows how to form and master the material at his command." (Johann Wolfgang von Goethe, "On Theory of Color", 1810)

"The errors which arise from the absence of facts are far more numerous and more durable than those which result from unsound reasoning respecting true data." (Charles Babbage, "On the Economy of Machinery and Manufactures", 1832)

"In every branch of knowledge the progress is proportional to the amount of facts on which to build, and therefore to the facility of obtaining data." (James C Maxwell, [letter to Lewis Campbell] 1851)

"It usually happens in scientific progress, that when a great fact is at length discovered, it approves itself at once to all competent judges. It furnishes a solution to so many problems, and harmonizes with so many other facts, - that all the other data as it were crystallize at once about it." (Edward Everett, "The Uses of Astronomy", [An Oration Delivered at Albany] 1856)

"The ignoring of data is, in fact, the easiest and most popular mode of obtaining unity in one's thought." (William James, "The Sentiment of Rationality", Mind Vol. 4, 1879)

"It is a capital mistake to theorise before one has data." (Arthur C Doyle, "The Adventures of Sherlock Holmes", 1892)

"Physical research by experimental methods is both a broadening and a narrowing field. There are many gaps yet to be filled, data to be accumulated, measurements to be made with great precision, but the limits within which we must work are becoming, at the same time, more and more defined." (Elihu Thomson, "Annual Report of the Board of Regents of the Smithsonian Institution", 1899)

"The data with which any scientific inquiry has to do are trivialities in some other bearing than that one in which they are of account." (Thorstein Veblen, "The Place of Science in Modern Civilisation and Other Essays", 1906)

"The first step in beginning the scientific study of a problem is to collect the data, which are or ought to be 'facts'." (John A Thomson, "Introduction to Science", 1911)

"The man of science, by virtue of his training, is alone capable of realising the difficulties - often enormous - of obtaining accurate data upon which just judgment may be based." (Sir Richard Gregory, "Discovery; or, The Spirit and Service of Science", 1918)

"Philosophy, like science, consists of theories or insights arrived at as a result of systemic reflection or reasoning in regard to the data of experience. It involves, therefore, the analysis of experience and the synthesis of the results of analysis into a comprehensive or unitary conception. Philosophy seeks a totality and harmony of reasoned insight into the nature and meaning of all the principal aspects of reality." (Joseph A Leighton, "The Field of Philosophy: An outline of lectures on introduction to philosophy," 1919)

"A 'poor evaluation' of the probability of anything may reflect ignorance of relevant data which 'ought' to be known. (Clarence I Lewis, "Mind and the World-Order: Outline of a Theory of Knowledge", 1924)

"No human mind is capable of grasping in its entirety the meaning of any considerable quantity of numerical data." (Frank Yates & Ronald Fisher, "Statistical Methods for Research Workers", 1925)

"Take the situation of a scientist solving a problem, where he has certain data, which call for certain responses. Some of this set of data call for his applying such and such a law, while others call for another law." (George H Mead, "Mind, Self, and Society", 1934)

"The laws of science are the permanent contributions to knowledge - the individual pieces that are fitted together in an attempt to form a picture of the physical universe in action. As the pieces fall into place, we often catch glimpses of emerging patterns, called theories; they set us searching for the missing pieces that will fill in the gaps and complete the patterns. These theories, these provisional interpretations of the data in hand, are mere working hypotheses, and they are treated with scant respect until they can be tested by new pieces of the puzzle." (Edwin P Whipple, "Experiment and Experience", [Commencement Address, California Institute of Technology] 1938)

"Not even the most subtle and skilled analysis can overcome completely the unreliability of basic data." (Roy D G Allen, "Statistics for Economists", 1951)

"When evaluating the reliability and generality of data, it is often important to know the aims of the experimenter. When evaluating the importance of experimental results, however, science has a trick of disregarding the experimenter's rationale and finding a more appropriate context for the data than the one he proposed." (Murray Sidman, "Tactics of Scientific Research", 1960)

"Philosophers of science have repeatedly demonstrated that more than one theoretical construction can always be placed upon a given collection of data." (Thomas Kuhn, "The Structure of Scientific Revolutions", 1962) 

"We must include in any language with which we hope to describe complex data-processing situations the capability for describing data." (Grace Hopper, "Management and the Computer of the Future", 1962)

"Modern science is characterized by its ever-increasing specialization, necessitated by the enormous amount of data, the complexity of techniques and of theoretical structures within every field. Thus science is split into innumerable disciplines continually generating new subdisciplines. In consequence, the physicist, the biologist, the psychologist and the social scientist are, so to speak, encapusulated in their private universes, and it is difficult to get word from one cocoon to the other." (Ludwig von Bertalanffy, "General System Theory", 1968)

"At root what is needed for scientific inquiry is just receptivity to data, skill in reasoning, and yearning for truth. Admittedly, ingenuity can help too." (Willard v O Quine, "The Web of Belief", 1970)

"Statistical methods of analysis are intended to aid the interpretation of data that are subject to appreciable haphazard variability." (David V. Hinkley & David Cox, "Theoretical Statistics", 1974)

"In a way, science might be described as paranoid thinking applied to Nature: we are looking for natural conspiracies, for connections among apparently disparate data." (Carl Sagan, "The Dragons of Eden", 1977)

"If we gather more and more data and establish more and more associations, however, we will not finally find that we know something. We will simply end up having more and more data and larger sets of correlations." (Kenneth N Waltz, "Theory of International Politics Source: Theory of International Politics", 1979)

"There is a tendency to mistake data for wisdom, just as there has always been a tendency to confuse logic with values, intelligence with insight. Unobstructed access to facts can produce unlimited good only if it is matched by the desire and ability to find out what they mean and where they lead." (Norman Cousins, "Human Options : An Autobiographical Notebook", 1981) 

"Data in isolation are meaningless, a collection of numbers. Only in context of a theory do they assume significance […]" (George Greenstein, "Frozen Star", 1983)

"Data is raw. It simply exists and has no significance beyond its existence (in and of itself). It can exist in any form, usable or not. It does not have meaning of itself. In computer parlance, a spreadsheet generally starts out by holding data." (Russell L Ackoff, "Towards a Systems Theory of Organization, 1985)

"Information is data that has been given meaning by way of relational connection. This 'meaning' can be useful, but does not have to be. In computer parlance, a relational database makes information from the data stored within it." (Russell L Ackoff, "Towards a Systems Theory of Organization", 1985)

"Intuition becomes increasingly valuable in the new information society precisely because there is so much data." (John Naisbitt, "Re-Inventing the Corporation", 1985)

"The combination of some data and an aching desire for an answer does not ensure that a reasonable answer can be extracted from a given body of data." (John Tukey, "Sunset Salvo", The American Statistician Vol. 40 (1), 1986)

"Intuition is the art, peculiar to the human mind, of working out the correct answer from data that is, in itself, incomplete or even, perhaps, misleading." (Isaac Asimov, "Forward the Foundation", 1993)

"Now that knowledge is taking the place of capital as the driving force in organizations worldwide, it is all too easy to confuse data with knowledge and information technology with information." (Peter Drucker, "Managing in a Time of Great Change", 1995) 

"Paradigms are the most general-rather like a philosophical or ideological framework. Theories are more specific, based on the paradigm and designed to describe what happens in one of the many realms of events encompassed by the paradigm. Models are even more specific providing the mechanisms by which events occur in a particular part of the theory's realm. Of all three, models are most affected by empirical data - models come and go, theories only give way when evidence is overwhelmingly against them and paradigms stay put until a radically better idea comes along." (Lee R Beach, "The Psychology of Decision Making: People in Organizations", 1997)

"Data is discrimination between physical states of things (black, white, etc.) that may convey or not convey information to an agent. Whether it does so or not depends on the agent's prior stock of knowledge." (Max Boisot, "Knowledge Assets", 1998)

"The unit of coding is the most basic segment, or element, of the raw data or information that can be assessed in a meaningful way regarding the phenomenon." (Richard Boyatzis, "Transforming qualitative information", 1998)

"While hard data may inform the intellect, it is largely soft data that generates wisdom." (Henry Mintzberg, "Strategy Safari: A Guided Tour Through The Wilds of Strategic Management", 1998)

"The more data we have, the more likely we are to drown in it." (Nassim N Taleb, "Fooled by Randomness", 2001)

"Data is a fact of life. As time goes by, we collect more and more data, making our original reason for collecting the data harder to accomplish. We don't collect data just to waste time or keep busy; we collect data so that we can gain knowledge, which can be used to improve the efficiency of our organization, improve profit margins, and on and on. The problem is that as we collect more data, it becomes harder for us to use the data to derive this knowledge. We are being suffocated by this raw data, yet we need to find a way to use it." (Seth Paul et al. "Preparing and Mining Data with Microsoft SQL Server 2000 and Analysis", 2002)

"Good communication is not just data transfer. You need to show people something that addresses their anxieties, that accepts their anger, that is credible in a very gut-level sense, and that evokes faith in the vision." (John Kotter, "The Heart of Change: Real-Life Stories of How People Change Their Organizations", 2002) 

"Thought, without the data on which to structure that thought, leads nowhere." (Victor J Stenger, "Has Science Found God?: The Latest Results in the Search for Purpose in the Universe", 2003)

"The best scientists aren't the ones who know the most data; they're the ones who know what they're looking for." (Noam Chomsky, [Guardian] 2005)

"Perception requires imagination because the data people encounter in their lives are never complete and always equivocal. [...] We also use our imagination and take shortcuts to fill gaps in patterns of nonvisual data. As with visual input, we draw conclusions and make judgments based on uncertain and incomplete information, and we conclude, when we are done analyzing the patterns, that out picture is clear and accurate. But is it?" (Leonard Mlodinow, "The Drunkard’s Walk: How Randomness Rules Our Lives", 2008)

"Finding patterns is easy in any kind of data-rich environment; that's what mediocre gamblers do. The key is in determining whether the patterns represent signal or noise." (Nate Silver, "The Signal and the Noise: Why So Many Predictions Fail-but Some Don't", 2012)

"The inherent nature of complexity is to doubt certainty and any pretense to finite and flawless data. Put another way, under uncertainty principles, any attempt by political systems to 'impose order' has an equal chance to instead 'impose disorder'." (Lawrence K Samuels, "Defense of Chaos: The Chaology of Politics, Economics and Human Action", 2013)

"The value of having numbers - data - is that they aren't subject to someone else's interpretation. They are just the numbers. You can decide what they mean for you." (Emily Oster, "Expecting Better", 2013)

"A study that leaves out data is waving a big red flag. A decision to include orxclude data sometimes makes all the difference in the world. This decision should be based on the relevance and quality of the data, not on whether the data support or undermine a conclusion that is expected or desired." (Gary Smith, "Standard Deviations", 2014)

"Another way to secure statistical significance is to use the data to discover a theory. Statistical tests assume that the researcher starts with a theory, collects data to test the theory, and reports the results - whether statistically significant or not. Many people work in the other direction, scrutinizing the data until they find a pattern and then making up a theory that fits the pattern." (Gary Smith, "Standard Deviations", 2014)

"Data clusters are everywhere, even in random data. Someone who looks for an explanation will inevitably find one, but a theory that fits a data cluster is not persuasive evidence. The found explanation needs to make sense and it needs to be tested with uncontaminated data." (Gary Smith, "Standard Deviations", 2014)

"Data without theory can fuel a speculative stock market bubble or create the illusion of a bubble where there is none. How do we tell the difference between a real bubble and a false alarm? You know the answer: we need a theory. Data are not enough. […] Data without theory is alluring, but misleading." (Gary Smith, "Standard Deviations", 2014)

"If somebody ransacks data to find a pattern, we still need a theory that makes sense. On the other hand, a theory is just a theory until it is tested with persuasive data." (Gary Smith, "Standard Deviations", 2014)

"Self-selection bias occurs when people choose to be in the data - for example, when people choose to go to college, marry, or have children. […] Self-selection bias is pervasive in 'observational data', where we collect data by observing what people do. Because these people chose to do what they are doing, their choices may reflect who they are. This self-selection bias could be avoided with a controlled experiment in which people are randomly assigned to groups and told what to do." (Gary Smith, "Standard Deviations", 2014)

"These practices - selective reporting and data pillaging - are known as data grubbing. The discovery of statistical significance by data grubbing shows little other than the researcher’s endurance. We cannot tell whether a data grubbing marathon demonstrates the validity of a useful theory or the perseverance of a determined researcher until independent tests confirm or refute the finding. But more often than not, the tests stop there. After all, you won’t become a star by confirming other people’s research, so why not spend your time discovering new theories? The data-grubbed theory consequently sits out there, untested and unchallenged." (Gary Smith, "Standard Deviations", 2014)

"We naturally draw conclusions from what we see […]. We should also think about what we do not see […]. The unseen data may be just as important, or even more important, than the seen data. To avoid survivor bias, start in the past and look forward." (Gary Smith, "Standard Deviations", 2014)

"Any knowledge incapable of being revised with advances in data and human thinking does not deserve the name of knowledge." (Jerry Coyne, “Faith Versus Fact”, 2015)

"The term data, unlike the related terms facts and evidence, does not connote truth. Data is descriptive, but data can be erroneous. We tend to distinguish data from information. Data is a primitive or atomic state (as in ‘raw data’). It becomes information only when it is presented in context, in a way that informs. This progression from data to information is not the only direction in which the relationship flows, however; information can also be broken down into pieces, stripped of context, and stored as data. This is the case with most of the data that’s stored in computer systems. Data that’s collected and stored directly by machines, such as sensors, becomes information only when it’s reconnected to its context."  (Stephen Few, "Signal: Understanding What Matters in a World of Noise", 2015)

10 May 2012

🏷️Knowledge Representation: On Information (Quotes)

"Probability, however, is not something absolute, [it is] drawn from certain information which, although it does not suffice to resolve the problem, nevertheless ensures that we judge correctly which of the two opposites is the easiest given the conditions known to us." (Gottfried W Leibniz, "Forethoughts for an encyclopaedia or universal science", cca. 1679)

"Knowledge is of two kinds. We know a subject ourselves, or we know where we can find information upon it." (Samuel Johnson, 1775)

"What is called science today consists of a haphazard heap of information, united by nothing, often utterly unnecessary, and not only failing to present one unquestionable truth, but as often as not containing the grossest errors, today put forward as truths, and tomorrow overthrown." (Leo Tolstoy, "What Is Art?", 1897)

"There can be no unique probability attached to any event or behaviour: we can only speak of ‘probability in the light of certain given information’, and the probability alters according to the extent of the information." (Sir Arthur S Eddington, "The Nature of the Physical World" , 1928)

"As words are not the things we speak about, and structure is the only link between them, structure becomes the only content of knowledge. If we gamble on verbal structures that have no observable empirical structures, such gambling can never give us any structural information about the world. Therefore such verbal structures are structurally obsolete, and if we believe in them, they induce delusions or other semantic disturbances." (Alfred Korzybski, "Science and Sanity", 1933)

"Just as entropy is a measure of disorganization, the information carried by a set of messages is a measure of organization. In fact, it is possible to interpret the information carried by a message as essentially the negative of its entropy, and the negative logarithm of its probability. That is, the more probable the message, the less information it gives. Clichés, for example, are less illuminating than great poems." (Norbert Wiener, "The Human Use of Human Beings", 1950)

"Knowledge is not something which exists and grows in the abstract. It is a function of human organisms and of social organization. Knowledge, that is to say, is always what somebody knows: the most perfect transcript of knowledge in writing is not knowledge if nobody knows it. Knowledge however grows by the receipt of meaningful information - that is, by the intake of messages by a knower which are capable of reorganising his knowledge." (Kenneth E Boulding, "General Systems Theory - The Skeleton of Science", Management Science Vol. 2 (3), 1956)

"This is the key of modern science and it was the beginning of the true understanding of Nature - this idea to look at the thing, to record the details, and to hope that in the information thus obtained might lie a clue to one or another theoretical interpretation." (Richard P Feynman, "The Character of Physical Law", 1965)

"[...] 'information' is not a substance or concrete entity but rather a relationship between sets or ensembles of structured variety." (Walter F Buckley, "Sociology and modern systems theory", 1967)

"There are as many types of questions as components in the information." (Jacques Bertin, Semiology of graphics [Semiologie Graphique], 1967)

"The idea of knowledge as an improbable structure is still a good place to start. Knowledge, however, has a dimension which goes beyond that of mere information or improbability. This is a dimension of significance which is very hard to reduce to quantitative form. Two knowledge structures might be equally improbable but one might be much more significant than the other." (Kenneth E Boulding, "Beyond Economics: Essays on Society", 1968)

"When action grows unprofitable, gather information; when information grows unprofitable, sleep. (Ursula K Le Guin, "The Left Hand of Darkness", 1969)

"What information consumes is rather obvious: it consumes the attention of its recipients. Hence a wealth of information creates a poverty of attention, and a need to allocate that attention efficiently among the overabundance of information sources that might consume it." (Herbert Simon, "Computers, Communications and the Public Interest", 1971)

"What we mean by information - the elementary unit of information - is a difference which makes a difference, and it is able to make a difference because the neural pathways along which it travels and is continually transformed are themselves provided with energy. The pathways are ready to be triggered. We may even say that the question is already implicit in them." (Gregory Bateson, "Steps to an Ecology of Mind", 1972)

"Science gets most of its information by the process of reductionism, exploring the details, then the details of the details, until all the smallest bits of the structure, or the smallest parts of the mechanism, are laid out for counting and scrutiny. Only when this is done can the investigation be extended to encompass the whole organism or the entire system. So we say. Sometimes it seems that we take a loss, working this way." (Lewis Thomas, "The Medusa and the Snail: More Notes of a Biology Watcher", 1974)

"Science is not a heartless pursuit of objective information. It is a creative human activity, its geniuses acting more as artists than information processors. Changes in theory are not simply the derivative results of the new discoveries but the work of creative imagination influenced by contemporary social and political forces." (Stephen J Gould, "Ever Since Darwin: Reflections in Natural History", 1977)

"Data, seeming facts, apparent asso­ciations-these are not certain knowledge of something. They may be puzzles that can one day be explained; they may be trivia that need not be explained at all." (Kenneth Waltz, "Theory of International Politics", 1979)

"To a considerable degree science consists in originating the maximum amount of information with the minimum expenditure of energy. Beauty is the cleanness of line in such formulations along with symmetry, surprise, and congruence with other prevailing beliefs." (Edward O Wilson, "Biophilia", 1984)

"Knowledge is the appropriate collection of information, such that it's intent is to be useful. Knowledge is a deterministic process. When someone 'memorizes' information (as less-aspiring test-bound students often do), then they have amassed knowledge. This knowledge has useful meaning to them, but it does not provide for, in and of itself, an integration such as would infer further knowledge." (Russell L Ackoff, "Towards a Systems Theory of Organization", 1985)

"Information is data that has been given meaning by way of relational connection. This 'meaning' can be useful, but does not have to be. In computer parlance, a relational database makes information from the data stored within it." (Russell L Ackoff, "Towards a Systems Theory of Organization", 1985)

"Probability plays a central role in many fields, from quantum mechanics to information theory, and even older fields use probability now that the presence of 'noise' is officially admitted. The newer aspects of many fields start with the admission of uncertainty." (Richard W Hamming, "Methods of Mathematics Applied to Calculus, Probability, and Statistics", 1985)

"Probabilities are summaries of knowledge that is left behind when information is transferred to a higher level of abstraction." (Judea Pearl, "Probabilistic Reasoning in Intelligent Systems: Network of Plausible, Inference", 1988)

"Information exists. It does not need to be perceived to exist. It does not need to be understood to exist. It requires no intelligence to interpret it. It does not have to have meaning to exist. It exists." (Tom Stonier, Information and the Internal Structure of the Universe: An Exploration into Information Physics, 1990)

"What about confusing clutter? Information overload? Doesn't data have to be ‘boiled down’ and  ‘simplified’? These common questions miss the point, for the quantity of detail is an issue completely separate from the difficulty of reading. Clutter and confusion are failures of design, not attributes of information." (Edward R Tufte, "Envisioning Information", 1990)

"Knowledge is theory. We should be thankful if action of management is based on theory. Knowledge has temporal spread. Information is not knowledge. The world is drowning in information but is slow in acquisition of knowledge. There is no substitute for knowledge." (William E Deming, "The New Economics for Industry, Government, Education", 1993)

"The science of statistics may be described as exploring, analyzing and summarizing data; designing or choosing appropriate ways of collecting data and extracting information from them; and communicating that information. Statistics also involves constructing and testing models for describing chance phenomena. These models can be used as a basis for making inferences and drawing conclusions and, finally, perhaps for making decisions." (Fergus Daly et al, "Elements of Statistics", 1995)

"[Schemata are] knowledge structures that represent objects or events and provide default assumptions about their characteristics, relationships, and entailments under conditions of incomplete information." (Paul J DiMaggio, "Culture and Cognition", Annual Review of Sociology No. 23, 1997)

"Each element in the system is ignorant of the behavior of the system as a whole, it responds only to information that is available to it locally. This point is vitally important. If each element ‘knew’ what was happening to the system as a whole, all of the complexity would have to be present in that element." (Paul Cilliers, "Complexity and Postmodernism: Understanding Complex Systems" , 1998)

"Complexity is that property of a model which makes it difficult to formulate its overall behaviour in a given language, even when given reasonably complete information about its atomic components and their inter-relations." (Bruce Edmonds, "Syntactic Measures of Complexity", 1999)

"It [the Internet] is inherently destructive of memory. You think you’re getting lots more [information] until you’ve found out you’ve made a bargain with the Devil. You’ve slowly mutated, and have become an extension of the machine." (James Billington, [interview] 1999)

'It would be a serious intellectual mistake to confuse Information that functions as entertainment with actual, or knowledge-based, information. It would be a mistake as well to simply ignore the cognitive implications of information processing as entertainment." (Joseph Urgo, "In the Age of Distraction", 2000)

"There is a strong tendency today to narrow specialization. Because of the exponential growth of information, we can afford (in terms of both economics and time) preparation of specialists in extremely narrow fields, the various branches of science and engineering having their own particular realms. As the knowledge in these fields grows deeper and broader, the individual's field of expertise has necessarily become narrower. One result is that handling information has become more difficult and even ineffective." (Semyon D Savransky, "Engineering of Creativity", 2000)

"A model isolates one or a few causal connections, mechanisms, or processes, to the exclusion of other contributing or interfering factors - while in the actual world, those other factors make their effects felt in what actually happens. Models may seem true in the abstract, and are false in the concrete. The key issue is about whether there is a bridge between the two, the abstract and the concrete, such that a simple model can be relied on as a source of relevantly truthful information about the complex reality." (Uskali Mäki, "Fact and Fiction in Economics: Models, Realism and Social Construction", 2002)

"Information needs representation. The idea that it is possible to communicate information in a 'pure' form is fiction. Successful risk communication requires intuitively clear representations. Playing with representations can help us not only to understand numbers (describe phenomena) but also to draw conclusions from numbers (make inferences). There is no single best representation, because what is needed always depends on the minds that are doing the communicating." (Gerd Gigerenzer, "Calculated Risks: How to know when numbers deceive you", 2002)

"Entropy is not about speeds or positions of particles, the way temperature and pressure and volume are, but about our lack of information." (Hans C von Baeyer," Information, The New Language of Science", 2003)

"The use of computers shouldn't ignore the objectives of graphics, that are: 
 1) Treating data to get information. 
 2) Communicating, when necessary, the information obtained." (Jacques Bertin, [interview] 2003)

"While in theory randomness is an intrinsic property, in practice, randomness is incomplete information." (Nassim N Taleb, "The Black Swan", 2007)

"Put simply, statistics is a range of procedures for gathering, organizing, analyzing and presenting quantitative data. […] Essentially […], statistics is a scientific approach to analyzing numerical data in order to enable us to maximize our interpretation, understanding and use. This means that statistics helps us turn data into information; that is, data that have been interpreted, understood and are useful to the recipient. Put formally, for your project, statistics is the systematic collection and analysis of numerical data, in order to investigate or discover relationships among phenomena so as to explain, predict and control their occurrence." (Reva B Brown & Mark Saunders, "Dealing with Statistics: What You Need to Know", 2008)

"Complexity has the propensity to overload systems, making the relevance of a particular piece of information not statistically significant. And when an array of mind-numbing factors is added into the equation, theory and models rarely conform to reality." (Lawrence K Samuels, "Defense of Chaos: The Chaology of Politics, Economics and Human Action", 2013)

"Complexity scientists concluded that there are just too many factors - both concordant and contrarian - to understand. And with so many potential gaps in information, almost nobody can see the whole picture. Complex systems have severe limits, not only to predictability but also to measurability. Some complexity theorists argue that modelling, while useful for thinking and for studying the complexities of the world, is a particularly poor tool for predicting what will happen." (Lawrence K Samuels, "Defense of Chaos: The Chaology of Politics, Economics and Human Action", 2013)

"In a physical system, information is the opposite of entropy, as it involves uncommon and highly correlated configurations that are difficult to arrive at." (César A Hidalgo, "Why Information Grows: The Evolution of Order, from Atoms to Economies", 2015)

"One of the most powerful transformational catalysts is knowledge, new information, or logic that defies old mental models and ways of thinking" (Elizabeth Thornton, "The Objective Leader", 2015)

"The term data, unlike the related terms facts and evidence, does not connote truth. Data is descriptive, but data can be erroneous. We tend to distinguish data from information. Data is a primitive or atomic state (as in ‘raw data’). It becomes information only when it is presented in context, in a way that informs. This progression from data to information is not the only direction in which the relationship flows, however; information can also be broken down into pieces, stripped of context, and stored as data. This is the case with most of the data that’s stored in computer systems. Data that’s collected and stored directly by machines, such as sensors, becomes information only when it’s reconnected to its context."  (Stephen Few, "Signal: Understanding What Matters in a World of Noise", 2015)

13 April 2012

🦉Knowledge Management: On Information (Quotes)

"Probability, however, is not something absolute, [it is] drawn from certain information which, although it does not suffice to resolve the problem, nevertheless ensures that we judge correctly which of the two opposites is the easiest (facilius) given the conditions known to us." (Gottfried W Leibniz, "Forethoughts for an encyclopaedia or universal science", cca. 1679)

"Knowledge is of two kinds. We know a subject ourselves, or we know where we can find information upon it." (Samuel Johnson, 1775)

"It is almost as difficult to make a man unlearn his errors as his knowledge. Mal-information is more hopeless than non-information; for error is always more busy than ignorance. Ignorance is a blank sheet, on which we may write; but error is a scribbled one, on which we must first erase. Ignorance is contented to stand still with her back to the truth; but error is more presumptuous, and proceeds in the same direction. Ignorance has no light, but error follows a false one. The consequence is, that error, when she retraces her footsteps, has further to go, before she can arrive at the truth, than ignorance." (Charles C Colton, "Lacon", 1820)

"The aim of scientific thought, then, is to apply past experience to new circumstances; the instrument is an observed uniformity in the course of events. By the use of this instrument it gives us information transcending our experience, it enables us to infer things that we have not seen from things that we have seen; and the evidence for the truth of that information depends on our supposing that the uniformity holds good beyond our experience." (William K Clifford, "Lectures and Essays", 1879)

"As a general rule the most successful man in life is the man who has the best information." (Benjamin Disraeli, "Endymion", 1880)

"The object of statistical science is to discover methods of condensing information concerning large groups of allied facts into brief and compendious expressions suitable for discussion. The possibility of doing this is based on the constancy and continuity with which objects of the same species are found to vary." (Sir Francis Galton, "Inquiries into Human Faculty and Its Development, Statistical Methods", 1883)

"What is called science today consists of a haphazard heap of information, united by nothing, often utterly unnecessary, and not only failing to present one unquestionable truth, but as often as not containing the grossest errors, today put forward as truths, and tomorrow overthrown." (Leo Tolstoy, "What Is Art?", 1897)

"There can be no unique probability attached to any event or behaviour: we can only speak of ‘probability in the light of certain given information’, and the probability alters according to the extent of the information." (Sir Arthur S Eddington, "The Nature of the Physical World" , 1928)

"As words are not the things we speak about, and structure is the only link between them, structure becomes the only content of knowledge. If we gamble on verbal structures that have no observable empirical structures, such gambling can never give us any structural information about the world. Therefore such verbal structures are structurally obsolete, and if we believe in them, they induce delusions or other semantic disturbances." (Alfred Korzybski, "Science and Sanity", 1933)

"Education is habit-forming rather than information; illumination rather than indoctrination, inspiration rather than compulsion." (Edwin G Conklin, "Science in the World Crisis", 1939)

"The scientist, if he is to be more than a plodding gatherer of bits of information, needs to exercise an active imagination." (Linus Pauling, "Tomorrow", 1943)

"[…] there is something wonderful in the idea that man’s brain is the greatest machine of all, imitating within its tiny network events happening in the most distant stars, […] On our model theory neural or other mechanisms can imitate or parallel the behaviour and interaction of physical objects and so supply us with information on physical processes which are not directly observable to us." (Kenneth Craik, "The Nature of Explanation", 1943)

"Just as entropy is a measure of disorganization, the information carried by a set of messages is a measure of organization. In fact, it is possible to interpret the information carried by a message as essentially the negative of its entropy, and the negative logarithm of its probability. That is, the more probable the message, the less information it gives. Clichés, for example, are less illuminating than great poems." (Norbert Wiener, "The Human Use of Human Beings", 1950)

"The concepts and methods of cybernetics are by no means restricted to the problems of servo-mechanisms, or even neural physiology, though the impetus came from these areas. […] Cybernetics analyzes all purposive behavior and provides an exact notion of communication and the transmital of information." (C West Churchman & Russel L Ackoff, "Purposive Behavior and Cybernetics", Social Forces, Volume 29 (1), 1950)

"[…] observation is not enough, and it seems to me that in science, as in the arts, there is very little worth having that does not require the exercise of intuition as well as of intelligence, the use of imagination as well as of information." (Kathleen Lonsdale, "Facts About Crystals", American Scientist Vol. 39 (4), 1951)

"[…] the scientific picture of the real world around me is very deficient. It gives a lot of factual information, puts all our experience in a magnificently consistent order, but it is ghastly silent about all and sundry that is really near to our heart, that really matters to us. It cannot tell us a word about red and blue, bitter and sweet, physical pain and physical delight; it knows nothing of beautiful and ugly, good or bad, God and eternity. Science sometimes pretends to answer questions in these domains, but the answers are very often so silly that we are not inclined to take them seriously." (Erwin Schrödinger, "Nature and the Greeks", 1954)

"Knowledge is not something which exists and grows in the abstract. It is a function of human organisms and of social organization. Knowledge, that is to say, is always what somebody knows: the most perfect transcript of knowledge in writing is not knowledge if nobody knows it. Knowledge however grows by the receipt of meaningful information - that is, by the intake of messages by a knower which are capable of reorganising his knowledge." (Kenneth E Boulding, "General Systems Theory - The Skeleton of Science", Management Science Vol. 2 (3), 1956)

"There comes a stage, however, as the system becomes larger and larger, when the reception of all the information is impossible by reason of its sheer bulk. Either the recording channels cannot carry all the information, or the observer, presented with it all, is overwhelmed. When this occurs, what is he to do? The answer is clear: he must give up any ambition to know the whole system. His aim must be to achieve a partial knowledge that, though partial over the whole, is none the less complete within itself, and is sufficient for his ultimate practical purpose." (W Ross Ashby, "An Introduction to Cybernetics", 1956)

"Cybernetics is the science of the process of transmission, processing and storage of information." (Sergei Sobolew, Woprosy Psychology, 1958)

"Cybernetics is the general science of communication. But to refer to communication is consciously or otherwise to refer to distinguishable states of information inputs and outputs and /or to information being processed within some relatively isolated system." (Henryk Greniewski, "Cybernetics without Mathematics", 1960)

"The process of formulating and structuring a system are important and creative, since they provide and organize the information, which each system. "establishes the number of objectives and the balance between them which will be optimized". Furthermore, they help identify and define the system parts. Furthermore, they help identify and define the system parts which make up its 'diverse, specialized structures and subfunctions'." (Harold Chestnut, "Systems Engineering Tools", 1965)

"This is the key of modern science and it was the beginning of the true understanding of Nature - this idea to look at the thing, to record the details, and to hope that in the information thus obtained might lie a clue to one or another theoretical interpretation." (Richard P Feynman, "The Character of Physical Law", 1965)

"[…] cybernetics studies the flow of information round a system, and the way in which this information is used by the system as a means of controlling itself: it does this for animate and inanimate systems indifferently. For cybernetics is an interdisciplinary science, owing as much to biology as to physics, as much to the study of the brain as to the study of computers, and owing also a great deal to the formal languages of science for providing tools with which the behaviour of all these systems can be objectively described." (A Stafford Beer, 1966)

"[...] 'information' is not a substance or concrete entity but rather a relationship between sets or ensembles of structured variety." (Walter F Buckley, "Sociology and modern systems theory", 1967)

"There are as many types of questions as components in the information." (Jacques Bertin, Semiology of graphics [Semiologie Graphique], 1967)

"The idea of knowledge as an improbable structure is still a good place to start. Knowledge, however, has a dimension which goes beyond that of mere information or improbability. This is a dimension of significance which is very hard to reduce to quantitative form. Two knowledge structures might be equally improbable but one might be much more significant than the other." (Kenneth E Boulding, "Beyond Economics: Essays on Society", 1968)

"It is not enough to observe, experiment, theorize, calculate and communicate; we must also argue, criticize, debate, expound, summarize, and otherwise transform the information that we have obtained individually into reliable, well established, public knowledge." (John M Ziman, "Information, Communication, Knowledge", Nature Vol. 224 (5217), 1969)

"When action grows unprofitable, gather information; when information grows unprofitable, sleep. (Ursula K Le Guin, "The Left Hand of Darkness", 1969)

"What information consumes is rather obvious: it consumes the attention of its recipients. Hence a wealth of information creates a poverty of attention, and a need to allocate that attention efficiently among the overabundance of information sources that might consume it." (Herbert Simon, "Computers, Communications and the Public Interest", 1971)

"What we mean by information - the elementary unit of information - is a difference which makes a difference, and it is able to make a difference because the neural pathways along which it travels and is continually transformed are themselves provided with energy. The pathways are ready to be triggered. We may even say that the question is already implicit in them." (Gregory Bateson, "Steps to an Ecology of Mind", 1972)

"Science gets most of its information by the process of reductionism, exploring the details, then the details of the details, until all the smallest bits of the structure, or the smallest parts of the mechanism, are laid out for counting and scrutiny. Only when this is done can the investigation be extended to encompass the whole organism or the entire system. So we say. Sometimes it seems that we take a loss, working this way." (Lewis Thomas, "The Medusa and the Snail: More Notes of a Biology Watcher", 1974)

"Facts do not ‘speak for themselves’; they are read in the light of theory. Creative thought, in science as much as in the arts, is the motor of changing opinion. Science is a quintessentially human activity, not a mechanized, robot-like accumulation of objective information, leading by laws of logic to inescapable interpretation." (Stephen J Gould, "Ever Since Darwin: Reflections in Natural History", 1977)

"Science is not a heartless pursuit of objective information. It is a creative human activity, its geniuses acting more as artists than information processors. Changes in theory are not simply the derivative results of the new discoveries but the work of creative imagination influenced by contemporary social and political forces. " (Stephen J Gould, "Ever Since Darwin: Reflections in Natural History", 1977)

"Information is carried by physical entities, such as books or sound waves or brains, but it is not itself material. Information in a living system is a feature of the order and arrangement of its parts, which arrangement provides the signs that constitute a ‘code’ or ‘language’." (John Z Young, "Programs of the Brain", 1978)

"Data, seeming facts, apparent asso­ciations-these are not certain knowledge of something. They may be puzzles that can one day be explained; they may be trivia that need not be explained at all. (Kenneth Waltz, Theory of International Politics, 1979)

"Information is recorded in vast interconnecting networks. Each idea or image has hundreds, perhaps thousands, of associations and is connected to numerous other points in the mental network." (Peter Russell, "The Brain Book: Know Your Own Mind and How to Use it", 1979)

"Cybernetic information theory suggests the possibility of assuming that intelligence is a feature of any feedback system that manifests a capacity for learning." (Paul Hawken et al, "Seven Tomorrows", 1982)

"Vision is a process that produces from images of the external world a description that is useful to the viewer and not cluttered with irrelevant information." (David Marr, "Vision", 1982)

"We provisionally define statistics as the study of how information should be employed to reflect on, and give guidance for action in, a practical situation involving uncertainty." (Vic Barnett, "Comparative Statistical Inference" 2nd Ed., 1982)

"To a considerable degree science consists in originating the maximum amount of information with the minimum expenditure of energy. Beauty is the cleanness of line in such formulations along with symmetry, surprise, and congruence with other prevailing beliefs." (Edward O Wilson, "Biophilia", 1984)

"Knowledge is the appropriate collection of information, such that it's intent is to be useful. Knowledge is a deterministic process. When someone 'memorizes' information (as less-aspiring test-bound students often do), then they have amassed knowledge. This knowledge has useful meaning to them, but it does not provide for, in and of itself, an integration such as would infer further knowledge." (Russell L Ackoff, "Towards a Systems Theory of Organization", 1985)

"Information is data that has been given meaning by way of relational connection. This "meaning" can be useful, but does not have to be. In computer parlance, a relational database makes information from the data stored within it." (Russell L Ackoff, "Towards a Systems Theory of Organization", 1985)

"Probability plays a central role in many fields, from quantum mechanics to information theory, and even older fields use probability now that the presence of 'noise' is officially admitted. The newer aspects of many fields start with the admission of uncertainty." (Richard W Hamming, "Methods of Mathematics Applied to Calculus, Probability, and Statistics", 1985)

"There is no coherent knowledge, i.e. no uniform comprehensive account of the world and the events in it. There is no comprehensive truth that goes beyond an enumeration of details, but there are many pieces of information, obtained in different ways from different sources and collected for the benefit of the curious. The best way of presenting such knowledge is the list - and the oldest scientific works were indeed lists of facts, parts, coincidences, problems in several specialized domains." (Paul K Feyerabend, "Farewell to Reason", 1987)

"Probabilities are summaries of knowledge that is left behind when information is transferred to a higher level of abstraction." (Judea Pearl, Probabilistic Reasoning in Intelligent Systems: Network of Plausible, Inference, 1988)

"Information exists. It does not need to be perceived to exist. It does not need to be understood to exist. It requires no intelligence to interpret it. It does not have to have meaning to exist. It exists. (Tom Stonier, Information and the Internal Structure of the Universe: An Exploration into Information Physics, 1990)

"What about confusing clutter? Information overload? Doesn't data have to be ‘boiled down’ and  ‘simplified’? These common questions miss the point, for the quantity of detail is an issue completely separate from the difficulty of reading. Clutter and confusion are failures of design, not attributes of information." (Edward R Tufte, "Envisioning Information", 1990)

"Knowledge is theory. We should be thankful if action of management is based on theory. Knowledge has temporal spread. Information is not knowledge. The world is drowning in information but is slow in acquisition of knowledge. There is no substitute for knowledge." (William E Deming, "The New Economics for Industry, Government, Education", 1993)

"The science of statistics may be described as exploring, analyzing and summarizing data; designing or choosing appropriate ways of collecting data and extracting information from them; and communicating that information. Statistics also involves constructing and testing models for describing chance phenomena. These models can be used as a basis for making inferences and drawing conclusions and, finally, perhaps for making decisions." (Fergus Daly et al, "Elements of Statistics", 1995)

"[Schemata are] knowledge structures that represent objects or events and provide default assumptions about their characteristics, relationships, and entailments under conditions of incomplete information." (Paul J DiMaggio, "Culture and Cognition", Annual Review of Sociology No. 23, 1997)

"Each element in the system is ignorant of the behavior of the system as a whole, it responds only to information that is available to it locally. This point is vitally important. If each element ‘knew’ what was happening to the system as a whole, all of the complexity would have to be present in that element." (Paul Cilliers, "Complexity and Postmodernism: Understanding Complex Systems" , 1998)

"Complexity is that property of a model which makes it difficult to formulate its overall behaviour in a given language, even when given reasonably complete information about its atomic components and their inter-relations." (Bruce Edmonds, "Syntactic Measures of Complexity", 1999)

"Just as dynamics arise from feedback, so too all learning depends on feedback. We make decisions that alter the real world; we gather information feedback about the real world, and using the new information we revise our understanding of the world and the decisions we make to bring our perception of the state of the system closer to our goals."( John D Sterman, "Business dynamics: Systems thinking and modeling for a complex world", 2000)

"A mistake is not something to be determined after the fact, but in the light of the information until that point." (Nassim N Taleb, "Fooled by Randomness", 2001)

"A model isolates one or a few causal connections, mechanisms, or processes, to the exclusion of other contributing or interfering factors - while in the actual world, those other factors make their effects felt in what actually happens. Models may seem true in the abstract, and are false in the concrete. The key issue is about whether there is a bridge between the two, the abstract and the concrete, such that a simple model can be relied on as a source of relevantly truthful information about the complex reality." (Uskali Mäki, "Fact and Fiction in Economics: Models, Realism and Social Construction", 2002)

"Entropy is not about speeds or positions of particles, the way temperature and pressure and volume are, but about our lack of information." (Hans C von Baeyer," Information, The New Language of Science", 2003)

"The use of computers shouldn't ignore the objectives of graphics, that are: 
 1) Treating data to get information. 
 2) Communicating, when necessary, the information obtained." (Jacques Bertin, [interview] 2003)

"A mental model is conceived […] as a knowledge structure possessing slots that can be filled not only with empirically gained information but also with ‘default assumptions’ resulting from prior experience. These default assumptions can be substituted by updated information so that inferences based on the model can be corrected without abandoning the model as a whole. Information is assimilated to the slots of a mental model in the form of ‘frames’ which are understood here as ‘chunks’ of knowledge with a well-defined meaning anchored in a given body of shared knowledge." (Jürgen Renn, "Before the Riemann Tensor: The Emergence of Einstein’s Double Strategy", "The Universe of General Relativity" Ed. by A.J. Kox & Jean Eisenstaedt, 2005)

"Groups are only smart when there is a balance between the information that everyone in the group shares and the information that each of the members of the group holds privately. It's the combination of all those pieces of independent information, some of them right, some of the wrong, that keeps the group wise." (James Surowiecki, "The Wisdom of Crowds", 2005)

"Errors in individual judgment won’t wreck the group’s collective judgment as long as those errors aren’t systematically pointing in the same direction. One of the quickest ways to make people’s judgments systematically biased is to make them dependent on each other for information." (James Surowiecki, "The Wisdom of Crowds", 2005)

"Any new dominant communications medium leads to a new information ecology in society that inevitably changes the way ideas, feelings, wealth, power and influence are distributed and the way collective decisions are made." (Al Gore,"The Assault on Reason", 2007)

"While in theory randomness is an intrinsic property, in practice, randomness is incomplete information." (Nassim N Taleb, "The Black Swan", 2007)

"Put simply, statistics is a range of procedures for gathering, organizing, analyzing and presenting quantitative data. […] Essentially […], statistics is a scientific approach to analyzing numerical data in order to enable us to maximize our interpretation, understanding and use. This means that statistics helps us turn data into information; that is, data that have been interpreted, understood and are useful to the recipient. Put formally, for your project, statistics is the systematic collection and analysis of numerical data, in order to investigate or discover relationships among phenomena so as to explain, predict and control their occurrence." (Reva B Brown & Mark Saunders, "Dealing with Statistics: What You Need to Know", 2008)

"We also use our imagination and take shortcuts to fill gaps in patterns of nonvisual data. As with visual input, we draw conclusions and make judgments based on uncertain and incomplete information, and we conclude, when we are done analyzing the patterns, that out picture is clear and accurate. But is it?" (Leonard Mlodinow, "The Drunkard’s Walk: How Randomness Rules Our Lives", 2008)

"Complexity has the propensity to overload systems, making the relevance of a particular piece of information not statistically significant. And when an array of mind-numbing factors is added into the equation, theory and models rarely conform to reality." (Lawrence K Samuels, "Defense of Chaos: The Chaology of Politics, Economics and Human Action", 2013)

"Complexity scientists concluded that there are just too many factors - both concordant and contrarian - to understand. And with so many potential gaps in information, almost nobody can see the whole picture. Complex systems have severe limits, not only to predictability but also to measurability. Some complexity theorists argue that modelling, while useful for thinking and for studying the complexities of the world, is a particularly poor tool for predicting what will happen." (Lawrence K Samuels, "Defense of Chaos: The Chaology of Politics, Economics and Human Action", 2013)

"One of the most powerful transformational catalysts is knowledge, new information, or logic that defies old mental models and ways of thinking" (Elizabeth Thornton, "The Objective Leader", 2015)

"A mental representation is a mental structure that corresponds to an object, an idea, a collection of information, or anything else, concrete or abstract, that the brain is thinking about. […] Because the details of mental representations can differ dramatically from field to field, it’s hard to offer an overarching definition that is not too vague, but in essence these representations are preexisting patterns of information - facts, images, rules, relationships, and so on - that are held in long-term memory and that can be used to respond quickly and effectively in certain types of situations." (Anders Ericsson & Robert Pool," Peak: Secrets from  the  New  Science  of  Expertise", 2016)

05 November 2011

Technology x.0: Nowadays Frustrations of Software, Devices and Services – The PDF Editor for Tablets

    We are dreaming about a Semantic Web, about semantic, intelligent and multifunctional tools and devices, though the paradox is that most of the software and electronic devices out there don’t address basic needs! Frankly I don’t care if my device can talk with my refrigerator and can make a list of what I need to buy, or that my book reader recommends me other books, based on what I read or browse. Sure, this kind of functionality is nice to have, though I can live without it and sometimes I found it irrelevant or even annoying, as the recommendations are fuzzier than the techniques they use. The example of books reader is not random, because my recent frustrations are related to it.

    Two years ago or so I bought a Digital Book Reader from Sony (Sony PRS-700BC), I founded it great at those times especially because it allowed me to annotate, highlight, extract and review the extracted text from a document (See Finally the Digital Book Reader). Unfortunately the functionality was not scaling good with documents’ size, waiting sometimes for half a minute until the change was made and I could continue to read. In some cases, I was spending more time on waits than on reading. In addition the display of formulas and images was quite problematical, being almost impossible to read a technical book. And then appeared the tablet…

   I found iPad a little too expensive for my reading needs, so I waited until Toshiba’s Folio 100 appeared on the market, almost in anonymity. It was much cheaper than the iPad, was having a 10.1 inch  widescreen display, relatively a small weight, and thus ideal for reading. In addition, the future support for Flash made it a good candidate for watching video learning content, another of my request. In three words: I loved it (and I still do). When I started to use it, I was kind of disappointed, because in came only with FBReaderJ reader, too limited for my needs and useless for my small electronic library mainly composed of PDF, DJVU and DOC files. After a short visit in Toshiba Market Place available through my tablet’s application, I bought myself, for small money, Documents To Go from DataViz Inc, a Software for viewing and editing of Microsoft Office 2007 documents, and for viewing PDF documents. A few months later I discovered in the same store the Office Suite Pro from MobiSystems, which provided almost same functionality as Documents To Go, with a plus for PDF viewer because it kept track of the page I was last time viewing and the scrolling of pages was more stable. There were PDF documents I could read with one software and not the other, and vice-versa, so they were kind of complete each other, however I was having two problems:
- there were PDF books I couldn’t read correctly with any of the two applications.
- my reading experience was quite static as I was having no possibility to annotate or highlight the text. It’s true that Documents to Go allowed me to copy a chunk of text, though because it doesn’t remembered the page I was in, the feature was almost useless.

   A few months ago, during the summer more exactly, given the fact that both solutions deal pretty good with Word files, I thought of converting some of the important PDF files to Word. My first thought was to check first the Adobe site. As they have nice tools and even nicer prices, I ended by buying Nitro PDF Professional. It covered the functionality I needed, unfortunately the size of output files and the conversion of images and formulas was not functioning as expected. I managed to address the first issue by splitting the initial PDF files in smaller files, and then convert them to Word. It worked, though it remained the problem of formulas and images, and they were present in most of the books I read.

   This week, taking advantage of some free time I had, I tried to look more into this. Toshiba’s Market Place was not offering other software for PDF so I had to look somewhere else, and the best place seemed to be the Android Market, where a multitude of software products wait for mobile and tablet proud owners. I found several PDF readers and editors, and in the end I decided to go for RepliGo Reader from Cerience. What appealed to me was the fact that I could cross and underline text, or add sticky notes in PDF files. Its price, 3.99 was quite appealing so there I am proceeding to check out, and then the surprise – I can’t buy it! I tried to go around the message: “There are no Android phones associated with this account.”. I checked the help, the various functionality, of how I can register a device, though I kind of lost myself in there. Finally I arrived to Google Mobile and everything looked like it made sense, I thought… I was following my own tail. As it seems, you can buy a product only if you are having an Android device with a phone number, that passed Google’s compatibility requirements. In addition, “manufacturers must obtain a license from Google in order to install Android Market on their devices”, so if your device isn’t in the list of Supported Devices, then there is no way you can consider the Android Market! Folio 100 isn’t in there, so I can go and … anyway, there must be other way!

   Frustrated I searched on Google if RepliGo Reader is available from other sources. My first stop was on Amazon where RepliGo Reader was available for 4.99. Good! I’m progressing. I downloaded Amazon Appstore (Amazon_Appstore-release.apk) and installed it on my Folio. It works great but it doesn’t do anything no matter what button I click. I tried to install it several times, without success. Probably the application isn’t compatible with my device. Who knows?

    Even more frustrated I checked on Android Market several PDF readers, trying to see if I can buy them from other stores. Again, no luck! During my searches I observed that Adobe has finally a reader for mobile devices (iOS & Android), the Android version being available only through Android Market. WTF!!! (pardon my language) I continue to search and discover a few sites of file sharing, though that’s not a solution! Finally I find a blog post on Adobe site with a link to a FTP location where Acrobat Reader can be downloaded. I installed it and it seems it works. It has very basic reader functionality (more basic it can’t be), though it comes from Adobe and is supposed to render with high fidelity PDF documents. As far I tested it, I’m having problems with the scanned old books that come from Google Books. It seems Adobe has several other products for mobile market (e.g. CreatePDF, Photoshop Express), reflecting that they are moving onto this market too.

    I continued searching and thus I found the AppBrain site. I tried to download RepliGo Reader, though the installation doesn’t work neither on my built-in browser, nor on Opera. Then I fond out that I have to install the Fast Web Installer and AppBrain App Market. Great, they I can’t install them neither! I searched for them on Google and I discovered them on Handster (here and here). I installed them without problems, though it seems AppBrain App Market uses Android Market, and as I don’t have it I can’t go any further. In the end I found Android Market 3.2.0 from APKTOP. I tried to install it but it didn’t work. Later I found a post from TalkAndroid, where is specified that the device need to be rooted – getting root access to the file system. I found an “How to Root Toshiba Folio 100” article, though it hasn’t helped too much, Super One Click freezing each time I started to use it.

    Browsing through APKTOP website, I found out several downloadable PDF reader apps available also on Android Market: RepliGo Reader, Documents To Go, Go Book, Acrobat Reader 10.1, EBookDroid, Aldiko Book Reader, etc. They are quite cheap on Android Market and some even free, though as they aren’t available for devices as mine, I would expect users will go and downloaded from such more or less legal sites. Excepting the legal issues, there are also some security concerns, some of such applications could be tampered, so you are using them on your own risk!

    Looking back at this long story and the long hours I spent attempting to find a PDF reader with annotation capabilities, I have to highlight several points:
1. It’s incredible how un-intuitive are web sites like Android Market or AppBrain Market. Un-intuitive not necessarily from the perspective of navigability, but of not making visible aspects like: how, why, where, why not!
2. I wonder why Toshiba doesn’t comply to Google’s compatibility requirements? Maybe they tried to make a honest buck through their store, but then why haven’t tried to attract more apps vendors and have more applications ported on their device.
3. I observed that there are great apps out there, though because they are sold only through sites like Android Market reduces considerably vendor’s profits!
4. I don’t understand why even if some apps are Free, Goggle still imposes restrictions on who can download them. I would expect that they try to force vendors to comply to Google’s compatibility requirements. Is this the way to go?
5. It seems the speed with which smartphones and tablets entered the market has created some breaches in vendors’ strategy, breaches from which the customers will suffer, and indirectly the vendors themselves. Here I could put the lack of compatibility and adherence to standards, lack of documentation and tools.
6. I’m afraid apps vendors will arrive in media vendors position of blaming people for pirating software. Even if apps are cheap, the inexistence of an adequate infrastructure for making apps available, will lead more likely to such issues.
7. Frankly it sucks to spend so many hours in order to find, install and troubleshoot software! All I was looking for was an app that allows me to read and annotate or highlight text in a PDF document. It isn’t rocket science! I would even expect to have such a software coming by default with a tablet, given that’s one of the main purposes of such a device.
Related Posts Plugin for WordPress, Blogger...