Quantitative linguistics

Source: Wikipedia, the free encyclopedia.

Quantitative linguistics (QL) is a sub-discipline of

mathematical linguistics. Quantitative linguistics deals with language learning, language change, and application as well as structure of natural languages. QL investigates languages using statistical methods; its most demanding objective is the formulation of language laws and, ultimately, of a general theory of language in the sense of a set of interrelated languages laws.[1] Synergetic linguistics was from its very beginning specifically designed for this purpose.[2]
QL is empirically based on the results of language statistics, a field which can be interpreted as statistics of languages or as statistics of any linguistic object. This field is not necessarily connected to substantial theoretical ambitions. Corpus linguistics and computational linguistics are other fields which contribute important empirical evidence.

History

The earliest QL approaches date back to the ancient Indian world. One of the historical sources consists of applications of combinatorics to linguistic matters,[3] another one is based on elementary statistical studies, which can be found under the header colometry and stichometry.[4]

Language laws

Frequency of demonstratives in Serbo-Croatian

In QL, the concept of law is understood as the class of law hypotheses which have been deduced from theoretical assumptions, are mathematically formulated, are interrelated with other laws in the field, and have sufficiently and successfully been tested on empirical data, i.e. which could not be refuted in spite of much effort to do so. Köhler writes about QL laws: "Moreover, it can be shown that these properties of linguistic elements and of the relations among them abide by universal laws which can be formulated strictly mathematically in the same way as common in the natural sciences. One has to bear in mind in this context that these laws are of stochastic nature; they are not observed in every single case (this would be neither necessary nor possible); they rather determine the probabilities of the events or proportions under study. It is easy to find counterexamples to each of the above-mentioned examples; nevertheless, these cases do not violate the corresponding laws as variations around the statistical mean are not only admissible but even essential; they are themselves quantitatively exactly determined by the corresponding laws. This situation does not differ from that in the natural sciences, which have since long abandoned the old deterministic and causal views of the world and replaced them by statistical/probabilistic models."[5]

Linguistic laws

In quantitative linguistics, linguistic laws are statistical regularities emerging across different linguistic scales (i.e. phonemes, syllables, words or sentences) that can be formulated mathematically and that have been deduced from certain theoretical assumptions. They are also required to have been successfully tested through the use of data, that is, not to have been refuted by empirical evidence. Among the main linguistic laws proposed by various authors, the following can be highlighted: [6]

  • Zipf's law: The frequency of words is inversely proportional to their rank in frequency lists. Similar distribution between rank and frequency of sounds, phonemes, and letters can be observed.[7]
  • Heaps' law: It describes the number of distinct words in a document (or set of documents) as a function of the document length.
  • Brevity law or Zipf's law of abbreviation: It qualitatively states that the more frequently a word is used, the 'shorter' that word tends to be.[8]
  • Menzerath's law (also, Menzerath-Altmann law): This law states that the sizes of the constituents of a construction decrease with increasing size of the construction under study. The longer, e.g. a sentence (measured in terms of the number of clauses) the shorter the clauses (measured in terms of the number of words), or: the longer a word (in syllables or morphs) the shorter the syllables or words in sounds).
  • Law of diversification: If linguistic categories such as parts-of-speech or inflectional endings appear in various forms it can be shown that the frequencies of their occurrences in texts are controlled by laws.
  • Martin's law: This law concerns lexical chains which are obtained by looking up the definition of a word in a dictionary, then looking up the definition of the definition just obtained etc. Finally, all these definitions form a hierarchy of more and more general meanings, whereby the number of definitions decreases with increasing generality. Among the levels of this kind of hierarchy, there exists a number of lawful relations.
  • Law of language change: Growth processes in language such as vocabulary growth, the dispersion of foreign or loan words, changes in the inflectional system etc. abide by a law known in QL as Piotrowski law, and corresponds to growth models in other scientific disciplines. The Piotrowski law is a case of the so-called logistic model (cf. logistic equation). It was shown that it covers also language acquisition processes (cf. language acquisition law).
  • Text block law: Linguistic units (e.g. words, letters, syntactic functions and constructions) show a specific frequency distribution in equally large text blocks.

Stylistics

The study of poetic and also non-poetic styles can be based on statistical methods; moreover, it is possible to conduct corresponding investigations on the basis of the specific forms (parameters) language laws take in texts of different styles. In such cases, QL supports research into

stylometrics).[9]

Important authors

See also

Notes

  1. .
  2. .
  3. ^ N.L. Biggs: The Roots of Combinatorics. In: Historia Mathematica 6, 1979, pp. 109–136.
  4. ^ Adam Pawłowski: Prolegomena to the History of Corpus and Quantitative Linguistics. Greek Antiquity. In: Glottotheory 1, 2008, pp. 48–54.
  5. ^ cf. note 1, pp. 1–2.
  6. ^ cf. references: Köhler, Altmann, Piotrowski (eds.) (2005)
  7. .
  8. ^ Zipf GK. 1935The Psychobiology of language, an introduction to dynamic philology. Boston, MA: Houghton–Mifflin.
  9. .
  10. ^ Grzybek, Peter, & Köhler, Reinhard (eds.) (2007): Exact Methods in the Study of Language and Text. Dedicated to Gabriel Altmann on the Occasion of his 75th Birthday. Berlin/ New York: Mouton de Gruyter
  11. ^ de:Benutzer:Dr._Karl-Heinz_Best
  12. ^ index
  13. ^ de:Sergei Grigorjewitsch Tschebanow
  14. ^ Best, Karl-Heinz (2009): William Palin Elderton (1877-1962). Glottometrics 19, p. 99-101 (PDF ram-verlag.eu).
  15. ^ Homepage_Gertraud Fenk
  16. ^ de:Ernst Förstemann; Karl-Heinz Best: Ernst Wilhelm Förstemann (1822-1906). In: Glottometrics 12, 2006, pp. 77–86 (PDF ram-verlag.eu)
  17. ^ Peter Grzybek :: Homepage : Home / Kontakt Archived September 29, 2012, at the Wayback Machine
  18. ^ de:Gustav Herdan
  19. ^ "Herdan dimension - Laws in Quantitative Linguistics". Archived from the original on 2011-07-19. Retrieved 2010-05-22.
  20. ^ de:Luděk Hřebíček
  21. ^ de:Friedrich Wilhelm Kaeding
  22. ^ Universität Trier: Prof. Dr. Reinhard Köhler Archived 2015-04-07 at the Wayback Machine
  23. .
  24. ^ Georg-August-Universität Göttingen - Lehfeldt, Werner, Prof. em. Dr
  25. ^ Festschrift on the occasion of the 70. anniversary: Problems of General, Germanic and Slavic Linguistics. Papers for 70th Anniversary of Professor V. Levickij. Herausgegeben von Gabriel Altmann, Iryna Zadoroshna, Yuliya Matskulyak. Books, Chernivtsi 2008. (No ISBN.) Levickij dedicated: Glottometrics, Heft 16, 2008; Emmerich Kelih: Der Czernowitzer Beitrag zur Quantitativen Linguistik: Zum 70. Geburtstag von Prof. Dr. Habil. Viktor V. Levickij. In: Naukovyj Visnyk Černivec'koho Universytetu: Hermans'ka filolohija. Vypusk 407, 2008, pp. 3–10.
  26. ^ Human-Language-Computer - staff Homepage, ZJU
  27. ^ Karl-Heinz Best: Paul Menzerath (1883-1954). In: Glottometrics 14, 2007, pp. 86–98 (PDF ram-verlag.eu)
  28. ^ Shizuo Mizutani; Portrait on the occasion of his 80. anniversary in: Glottometrics 12, 2006 (PDF ram-verlag.eu); about Mizutani: Naoko Maruyama: Sizuo Mizutani (1926). The Founder of Japanese Quantitative Linguistics. In: Glottometrics 10, 2005, pp. 99-107 (PDF ram-verlag.eu).
  29. ^ Charles Muller: Initiation à la statistique linguistique. Paris: Larousse 1968; German: Einführung in die Sprachstatistik. Hueber, München 1972.
  30. ^ Rajmund G. Piotrowski, R.G. Piotrovskij; cf. Piotrowski's law: http://lql.uni-trier.de/index.php/Change_in_language Archived 2011-07-19 at the Wayback Machine
  31. ^ de:Piotrowski-Gesetz
  32. ^ Journal of Quantitative Linguistics 4, Nr. 1, 1997 (Festschrift in Honour of Juh. Tuldava)
  33. ^ Dr Andrew Wilson - Linguistics and English Language at Lancaster University
  34. ^ de:Albert Thumb
  35. ^ de:Eberhard Zwirner

References

External links