Infinitesimal
In
Infinitesimals do not exist in the standard real number system, but they do exist in other number systems, such as the surreal number system and the hyperreal number system, which can be thought of as the real numbers augmented with both infinitesimal and infinite quantities; the augmentations are the reciprocals of one another.
Infinitesimal numbers were introduced in the development of calculus, in which the derivative was first conceived as a ratio of two infinitesimal quantities. This definition was not rigorously formalized. As calculus developed further, infinitesimals were replaced by limits, which can be calculated using the standard real numbers.
Infinitesimals regained popularity in the 20th century with
Vladimir Arnold wrote in 1990:
Nowadays, when teaching analysis, it is not very popular to talk about infinitesimal quantities. Consequently, present-day students are not fully in command of this language. Nevertheless, it is still necessary to have command of it.[1]
The crucial insight[
Infinitesimals are a basic ingredient in
The concept of infinitesimals was originally introduced around 1670 by either
The use of infinitesimals by Leibniz relied upon heuristic principles, such as the law of continuity: what succeeds for the finite numbers succeeds also for the infinite numbers and vice versa; and the transcendental law of homogeneity that specifies procedures for replacing expressions involving unassignable quantities, by expressions involving only assignable ones. The 18th century saw routine use of infinitesimals by mathematicians such as Leonhard Euler and Joseph-Louis Lagrange. Augustin-Louis Cauchy exploited infinitesimals both in defining continuity in his Cours d'Analyse, and in defining an early form of a Dirac delta function. As Cantor and Dedekind were developing more abstract versions of Stevin's continuum, Paul du Bois-Reymond wrote a series of papers on infinitesimal-enriched continua based on growth rates of functions. Du Bois-Reymond's work inspired both Émile Borel and Thoralf Skolem. Borel explicitly linked du Bois-Reymond's work to Cauchy's work on rates of growth of infinitesimals. Skolem developed the first non-standard models of arithmetic in 1934. A mathematical implementation of both the law of continuity and infinitesimals was achieved by Abraham Robinson in 1961, who developed nonstandard analysis based on earlier work by Edwin Hewitt in 1948 and Jerzy Łoś in 1955. The hyperreals implement an infinitesimal-enriched continuum and the transfer principle implements Leibniz's law of continuity. The standard part function implements Fermat's adequality.
History of the infinitesimal
The notion of infinitely small quantities was discussed by the
The English mathematician
Infinitesimals were the subject of political and religious controversies in 17th century Europe, including a ban on infinitesimals issued by clerics in Rome in 1632.[6]
Prior to the invention of calculus mathematicians were able to calculate tangent lines using
First-order properties
In extending the real numbers to include infinite and infinitesimal quantities, one typically wishes to be as conservative as possible by not changing any of their elementary properties. This guarantees that as many familiar results as possible are still available. Typically, elementary means that there is no
The resulting extended number system cannot agree with the reals on all properties that can be expressed by quantification over sets, because the goal is to construct a non-Archimedean system, and the Archimedean principle can be expressed by quantification over sets. One can conservatively extend any theory including reals, including set theory, to include infinitesimals, just by adding a countably infinite list of axioms that assert that a number is smaller than 1/2, 1/3, 1/4, and so on. Similarly, the completeness property cannot be expected to carry over, because the reals are the unique complete ordered field up to isomorphism.
We can distinguish three levels at which a non-Archimedean number system could have first-order properties compatible with those of the reals:
- An commutativityaxiom x + y = y + x holds.
- A real closed field has all the first-order properties of the real number system, regardless of whether they are usually taken as axiomatic, for statements involving the basic ordered-field relations +, ×, and ≤. This is a stronger condition than obeying the ordered-field axioms. More specifically, one includes additional first-order properties, such as the existence of a root for every odd-degree polynomial. For example, every number must have a cube root.
- The system could have all the first-order properties of the real number system for statements involving any relations (regardless of whether those relations can be expressed using +, ×, and ≤). For example, there would have to be a sinefunction that is well defined for infinite inputs; the same is true for every real function.
Systems in category 1, at the weak end of the spectrum, are relatively easy to construct but do not allow a full treatment of classical analysis using infinitesimals in the spirit of Newton and Leibniz. For example, the
Number systems that include infinitesimals
Formal series
Laurent series
An example from category 1 above is the field of
The Levi-Civita field
The Levi-Civita field is similar to the Laurent series, but is algebraically closed. For example, the basic infinitesimal x has a square root. This field is rich enough to allow a significant amount of analysis to be done, but its elements can still be represented on a computer in the same sense that real numbers can be represented in floating-point.[10]
Transseries
The field of transseries is larger than the Levi-Civita field.[11] An example of a transseries is:
where for purposes of ordering x is considered infinite.
Surreal numbers
Conway's
Hyperreals
The most widespread technique for handling infinitesimals is the hyperreals, developed by Abraham Robinson in the 1960s. They fall into category 3 above, having been designed that way so all of classical analysis can be carried over from the reals. This property of being able to carry over all relations in a natural way is known as the transfer principle, proved by Jerzy Łoś in 1955. For example, the transcendental function sin has a natural counterpart *sin that takes a hyperreal input and gives a hyperreal output, and similarly the set of natural numbers has a natural counterpart , which contains both finite and infinite integers. A proposition such as carries over to the hyperreals as .
Superreals
The superreal number system of Dales and Woodin is a generalization of the hyperreals. It is different from the super-real system defined by David Tall.
Dual numbers
In linear algebra, the dual numbers extend the reals by adjoining one infinitesimal, the new element ε with the property ε2 = 0 (that is, ε is nilpotent). Every dual number has the form z = a + bε with a and b being uniquely determined real numbers.
One application of dual numbers is automatic differentiation. This application can be generalized to polynomials in n variables, using the Exterior algebra of an n-dimensional vector space.
Smooth infinitesimal analysis
Synthetic differential geometry or smooth infinitesimal analysis have roots in category theory. This approach departs from the classical logic used in conventional mathematics by denying the general applicability of the law of excluded middle – i.e., not (a ≠ b) does not have to mean a = b. A nilsquare or nilpotent infinitesimal can then be defined. This is a number x where x2 = 0 is true, but x = 0 need not be true at the same time. Since the background logic is intuitionistic logic, it is not immediately clear how to classify this system with regard to classes 1, 2, and 3. Intuitionistic analogues of these classes would have to be developed first.
Infinitesimal delta functions
Modern set-theoretic approaches allow one to define infinitesimals via the
Logical properties
The method of constructing infinitesimals of the kind used in nonstandard analysis depends on the model and which collection of axioms are used. We consider here systems where infinitesimals can be shown to exist.
In 1936
There are in fact many ways to construct such a
- 1) Extend the number system so that it contains more numbers than the real numbers.
- 2) Extend the axioms (or extend the language) so that the distinction between the infinitesimals and non-infinitesimals can be made in the real numbers themselves.
In 1960, Abraham Robinson provided an answer following the first approach. The extended set is called the hyperreals and contains numbers less in absolute value than any positive real number. The method may be considered relatively complex but it does prove that infinitesimals exist in the universe of ZFC set theory. The real numbers are called standard numbers and the new non-real hyperreals are called nonstandard.
In 1977 Edward Nelson provided an answer following the second approach. The extended axioms are IST, which stands either for Internal set theory or for the initials of the three extra axioms: Idealization, Standardization, Transfer. In this system, we consider that the language is extended in such a way that we can express facts about infinitesimals. The real numbers are either standard or nonstandard. An infinitesimal is a nonstandard real number that is less, in absolute value, than any positive standard real number.
In 2006 Karel Hrbacek developed an extension of Nelson's approach in which the real numbers are stratified in (infinitely) many levels; i.e., in the coarsest level, there are no infinitesimals nor unlimited numbers. Infinitesimals are at a finer level and there are also infinitesimals with respect to this new level and so on.
Infinitesimals in teaching
Calculus textbooks based on infinitesimals include the classic Calculus Made Easy by Silvanus P. Thompson (bearing the motto "What one fool can do another can"[15]) and the German text Mathematik fur Mittlere Technische Fachschulen der Maschinenindustrie by R. Neuendorff.[16] Pioneering works based on Abraham Robinson's infinitesimals include texts by Stroyan (dating from 1972) and Howard Jerome Keisler (Elementary Calculus: An Infinitesimal Approach). Students easily relate to the intuitive notion of an infinitesimal difference 1-"0.999...", where "0.999..." differs from its standard meaning as the real number 1, and is reinterpreted as an infinite terminating extended decimal that is strictly less than 1.[17][18]
Another elementary calculus text that uses the theory of infinitesimals as developed by Robinson is Infinitesimal Calculus by Henle and Kleinberg, originally published in 1979.[19] The authors introduce the language of first-order logic, and demonstrate the construction of a first order model of the hyperreal numbers. The text provides an introduction to the basics of integral and differential calculus in one dimension, including sequences and series of functions. In an Appendix, they also treat the extension of their model to the hyperhyperreals, and demonstrate some applications for the extended model.
An elementary calculus text based on smooth infinitesimal analysis is Bell, John L. (2008). A Primer of Infinitesimal Analysis, 2nd Edition. Cambridge University Press. ISBN 9780521887182.
A more recent calculus text utilizing infinitesimals is Dawson, C. Bryan (2022), Calculus Set Free: Infinitesimals to the Rescue, Oxford University Press. ISBN 9780192895608.
Functions tending to zero
In a related but somewhat different sense, which evolved from the original definition of "infinitesimal" as an infinitely small quantity, the term has also been used to refer to a function tending to zero. More precisely, Loomis and Sternberg's Advanced Calculus defines the function class of infinitesimals, , as a subset of functions between normed vector spaces by
,
as well as two related classes (see Big-O notation) by
, and
.[20]
The set inclusions generally hold. That the inclusions are proper is demonstrated by the real-valued functions of a real variable , , and :
but and .
As an application of these definitions, a mapping between normed vector spaces is defined to be differentiable at if there is a [i.e, a bounded linear map ] such that
in a neighborhood of . If such a map exists, it is unique; this map is called the differential and is denoted by ,[21] coinciding with the traditional notation for the classical (though logically flawed) notion of a differential as an infinitely small "piece" of F. This definition represents a generalization of the usual definition of differentiability for vector-valued functions of (open subsets of) Euclidean spaces.
Array of random variables
Let be a probability space and let . An array of random variables is called infinitesimal if for every , we have:[22]
The notion of infinitesimal array is essential in some central limit theorems and it is easily seen by monotonicity of the expectation operator that any array satisfying Lindeberg's condition is infinitesimal, thus playing an important role in Lindeberg's Central Limit Theorem (a generalization of the central limit theorem).
See also
- Cantor function
- Differential (infinitesimal)
- Indeterminate form
- Infinitesimal calculus
- Infinitesimal transformation
- Instant
- Nonstandard calculus
- Model theory
Notes
- ^ Arnolʹd, V. I. Huygens and Barrow, Newton and Hooke. Pioneers in mathematical analysis and catastrophe theory from evolvents to quasicrystals. Translated from the Russian by Eric J. F. Primrose. Birkhäuser Verlag, Basel, 1990. p. 27
- ^ Bell, John L. (6 September 2013). "Continuity and Infinitesimals". Stanford Encyclopedia of Philosophy.
- S2CID 119329569
- ^ Reviel, Netz; Saito, Ken; Tchernetska, Natalie (2001). "A New Reading of Method Proposition 14: Preliminary Evidence from the Archimedes Palimpsest (Part 1)". Sciamvs. 2: 9–29.
- ^ Archimedes, The Method of Mechanical Theorems; see Archimedes Palimpsest
- ISBN 978-0-374-17681-5.
- ^ Berkeley, George (1734). The Analyst: A Discourse Addressed to an Infidel Mathematician. London.
- S2CID 119128707.
- ^ "Infinitesimals in Modern Mathematics". Jonhoyle.com. Archived from the original on 2011-07-13. Retrieved 2011-03-11.
- ^ Shamseddine, Khodr. "Analysis on the Levi-Civita Field, a Brief Overview" (PDF). Archived from the original (PDF) on 2011-06-08.
- S2CID 14290638.
- , retrieved 2019-03-05
- ISBN 9781461466369.
Theorem 24.29. The surreal number system is the largest ordered field
- ISBN 9780521312059.
- ^ Thompson, Silvanus P. (1914). Calculus Made Easy (Second ed.). New York: The Macmillan Company.
- ^ R Neuendorff (1912) Lehrbuch der Mathematik fur Mittlere Technische Fachschulen der Maschinenindustrie, Verlag Julius Springer, Berlin.
- (PDF) from the original on 2019-05-06.
- S2CID 11544878. Archived from the original(PDF) on 2012-12-07. Retrieved 2012-12-07.
- ISBN 978-0-262-08097-2.
- ISBN 978-981-4583-92-3.
- ^ This notation is not to be confused with the many other distinct usages of d in calculus that are all loosely related to the classical notion of the differential as "taking an infinitesimally small piece of something": (1) in the expression, indicates Riemann-Stieltjes integration with respect to the integrator function ; (2) in the expression , symbolizes Lebesgue integration with respect to a measure ; (3) in the expression , dV indicates integration with respect to volume; (4) in the expression , the letter d represents the exterior derivative operator, and so on....
- ^ Barczyk, Adam; Janssen, Arnold; Pauly, Markus (2011). "The Asymptotics of L-statistics for non-i.i.d. variables with heavy tails" (PDF). Probability and Mathematical Statistics. 31 (2): 285–299. Archived (PDF) from the original on 2019-08-21.
References
- B. Crowell, "Calculus" (2003)
- Dawson, C. Bryan, "Calculus Set Free: Infinitesimals to the Rescue" (2022) Oxford University Press
- Ehrlich, P. (2006) The rise of non-Archimedean mathematics and the roots of a misconception. I. The emergence of non-Archimedean systems of magnitudes. Arch. Hist. Exact Sci. 60, no. 1, 1–121.
- Malet, Antoni. "Barrow, Wallis, and the remaking of seventeenth-century indivisibles". Centaurus 39 (1997), no. 1, 67–92.
- J. Keisler, "Elementary Calculus" (2000) University of Wisconsin
- K. Stroyan "Foundations of Infinitesimal Calculus" (1993)
- Stroyan, K. D.; Luxemburg, W. A. J. Introduction to the theory of infinitesimals. Pure and Applied Mathematics, No. 72. Academic Press [Harcourt Brace Jovanovich, Publishers], New York-London, 1976.
- Robert Goldblatt (1998) "Lectures on the hyperreals" Springer.
- Cutland et al. "Nonstandard Methods and Applications in Mathematics" (2007) Lecture Notes in Logic 25, Association for Symbolic Logic.
- "The Strength of Nonstandard Analysis" (2007) Springer.
- S2CID 120890300.
- Yamashita, H.: Comment on: "Pointwise analysis of scalar Fields: a nonstandard approach" [J. Math. Phys. 47 (2006), no. 9, 092301; 16 pp.]. J. Math. Phys. 48 (2007), no. 8, 084101, 1 page.