Computational linguistics

Source: Wikipedia, the free encyclopedia.

Computational linguistics is an

computational modelling of natural language, as well as the study of appropriate computational approaches to linguistic questions. In general, computational linguistics draws upon linguistics, computer science, artificial intelligence, mathematics, logic, philosophy, cognitive science, cognitive psychology, psycholinguistics, anthropology and neuroscience
, among others.

Origins

The field overlapped with artificial intelligence since the efforts in the United States in the 1950s to use computers to automatically translate texts from foreign languages, particularly Russian scientific journals, into English.[1] Since rule-based approaches were able to make arithmetic (systematic) calculations much faster and more accurately than humans, it was expected that lexicon, morphology, syntax and semantics can be learned using explicit rules, as well. After the failure of rule-based approaches, David Hays[2] coined the term in order to distinguish the field from AI and co-founded both the Association for Computational Linguistics (ACL) and the International Committee on Computational Linguistics (ICCL) in the 1970s and 1980s. What started as an effort to translate between languages evolved into a much wider field of natural language processing.[3][4]

Annotated corpora

In order to be able to meticulously study the

part-of-speech tagging and syntactic bracketing.[6]

Japanese sentence corpora were analyzed and a pattern of

log-normality was found in relation to sentence length.[7]

Modeling language acquisition

The fact that during language acquisition, children are largely only exposed to positive evidence,[8] meaning that the only evidence for what is a correct form is provided, and no evidence for what is not correct,[9] was a limitation for the models at the time because the now available deep learning models were not available in late 1980s.[10]

It has been shown that languages can be learned with a combination of simple input presented incrementally as the child develops better memory and longer attention span,[11] which explained the long period of language acquisition in human infants and children.[11]

Robots have been used to test linguistic theories.[12] Enabled to learn as children might, models were created based on an affordance model in which mappings between actions, perceptions, and effects were created and linked to spoken words. Crucially, these robots were able to acquire functioning word-to-meaning mappings without needing grammatical structure.

Using the

Pólya urn dynamics, researchers have created a system which not only predicts future linguistic evolution but also gives insight into the evolutionary history of modern-day languages.[13]

Chomsky's theories

Chomsky's theories have influenced computational linguistics, particularly in understanding how infants learn complex grammatical structures, such as those described in Chomsky normal form.[14] Attempts have been made to determine how an infant learns a "non-normal grammar" as theorized by Chomsky normal form.[9] Research in this area combines structural approaches with computational models to analyze large linguistic corpora like the Penn Treebank, helping to uncover patterns in language acquisition.[15]

See also

References

  1. ^ John Hutchins: Retrospect and prospect in computer-based translation. Archived 2008-04-14 at the Wayback Machine Proceedings of MT Summit VII, 1999, pp. 30–44.
  2. ^ "Deceased members". ICCL members. Archived from the original on 17 May 2017. Retrieved 15 November 2017.
  3. ^ Natural Language Processing by Liz Liddy, Eduard Hovy, Jimmy Lin, John Prager, Dragomir Radev, Lucy Vanderwende, Ralph Weischedel
  4. ^ Arnold B. Barach: Translating Machine 1975: And the Changes To Come.
  5. ^ Marcus, M. & Marcinkiewicz, M. (1993). "Building a large annotated corpus of English: The Penn Treebank" (PDF). Computational Linguistics. 19 (2): 313–330. Archived (PDF) from the original on 2022-10-09.
  6. ^ Taylor, Ann (2003). "1". Treebanks. Spring Netherlands. pp. 5–22.
  7. .
  8. ^ Bowerman, M. (1988). The "no negative evidence" problem: How do children avoid constructing an overly general grammar. Explaining language universals.
  9. ^ a b Braine, M.D.S. (1971). On two types of models of the internalization of grammars. In D.I. Slobin (Ed.), The ontogenesis of grammar: A theoretical perspective. New York: Academic Press.
  10. .
  11. ^ .
  12. .
  13. .
  14. ^ Yogita, Bansal (2016). "Insight to Computational Linguistics" (PDF). International Journal 4.10. p. 94. Retrieved September 22, 2024.
  15. ^ Yogita, Bansal (2016). "Insight to Computational Linguistics" (PDF). International Journal 4.10. p. 94. Retrieved September 22, 2024.

Further reading