Distributionalism

Distributionalism was a general theory of language and a discovery procedure for establishing elements and structures of language based on observed usage. The purpose of distributionalism was to provide a scientific basis for syntax as independent of meaning. Zellig Harris defined 'distribution' as follows.^[1]

“The DISTRIBUTION of an element is the total of all environments in which it occurs, i.e. the sum of all the (different) positions (or occurrences) of an element relative to the occurrence of other elements[.]”

Based on this idea, an analysis of immediate constituents could be based on observing the environments in which an element, such as a word, appears in corpora. Critics of distributionalism, such as Louis Hjelmslev, pointed out that the analysis of occurrence adds nothing to traditional structure analysis, which is based on the hierarchical, step-by-step categorization of elements. Hjelmslev proposed glossematics, which combines the analysis of meaning and form. However, in American linguistics in the 1960s, distributionalism became replaced by Noam Chomsky's proposal of transformational generative grammar. It proposed that the constituency structure is the manifestation of innate grammar, allowing the preservation of autonomous syntax.^[2]

Origins

Distributionalism can be said to have originated in the work of structuralist linguist Leonard Bloomfield and was more clearly formalised by Zellig S. Harris.^[1]^[3]

This theory emerged in the United States in the 1950s, as a variant of structuralism, which was the mainstream linguistic theory at the time, and dominated American linguistics for some time.^[4] Using "distribution" as a technical term for a component of discovery procedure is likely first to have been done by Morris Swadesh in 1934 ^[5] and then applied to principles of phonematics, to establish which observable various sounds of a language constitute the allophones of a phoneme and which should be kept as separate phonemes.^[6] According to Turenne and Pomerol, distributionalism was in fact a second phase in the history of linguistics, following that of structuralism, as distributionalism was mainly dominant since 1935 to 1960.^[7] It is considered one of the scientific grounds of Noam Chomsky's generative grammar and had considerable influence on language teaching.

Distributionalism has much in common with structuralism. However, both appear in the United States while the theses of Ferdinand de Saussure are only just beginning to be known in Europe: distributionism must be considered as an original theory in relation to Saussurianism.

Behaviorist psychological theories which allowed the birth of distributionalism are reminiscent of Pavlov's work on animals. According to these theories, human behaviour would be totally explainable, and its mechanics could be studied. The study of reflexes, for example, should have made it possible to predict certain attitudes. Leonard Bloomfield argues that language, like behaviour, could be analysed as a predictable mechanism, explicable by the external conditions of its appearance.

The notions of "mechanism", "inductive method" and "corpus" are key terms of distributionalism.

Mechanism vs Mentalism

Bloomfield calls his thesis mechanism, and he opposes it to mentalism: for him, in fact, speech cannot be explained as an effect of thoughts (intentions, beliefs, feelings). Thus, one must be able to account for linguistic behaviour and the hierarchical structure of the messages conveyed without any assumptions about the speakers' intentions and mental states.^[8]

From the behaviourist perspective, a given stimulus corresponds to a given response. However, meaning is an unstable thing for distributionists, depending on the situation, and is not observable. It must therefore be eliminated as an element of language analysis. The only regularity is of a morphosyntactic nature: it is the structural invariants of the morphosyntax that allow us to reconstruct the language system from an analysis of its observable elements, the words of a given corpus.

Salient features

The main idea of distributionalism is that linguistic units "are what they do",^[9] which means that the identity of linguistic units are defined by their distribution. Zellig Harris used to consider meaning as too intuitive to be a reliable ground for linguistic research. Language use has to be observed directly while looking at all the environments in which a unit can occur. Harris advocated for a distributional approach, since "difference of meaning correlates with difference of distribution.".^[10]

References

^ ^a ^b Zellig, Harris. 1951. Methods in Structural Linguistics. Chicago: University of Chicago Press, xvi, 384 pp. (Ms. title Methods in Descriptive Linguistics. Repr. as "Phoenix Books" P 52 with the title Structural Linguistics, 1960; 7th impression, 1966; 1984.) [Completed 1946, Preface signed "Philadelphia, January 1947".]
^ Shakeri, Mohammed Amin (2022). "Last Glossematic Conference: A Rich Source of Comparison with American Structural Linguistics" (PDF). nors.ku.dk. Institut for Nordiske Studier og Sprogvidenskab. Archived from the original (PDF) on 2023-06-15. Retrieved 2023-06-15.
^ Harris, Zellig. 1954. "Distributional Structure". Word 10:2/3.146-162. (Also in Linguistics Today: Published on the occasion of the Columbia University Bicentennial ed. by Andre Martinet & Uriel Weinreich, 26-42. New York: Linguistic Circle of New York, 1954. (Repr. in The Structure of Language: Readings in the philosophy of language ed. by Jerry A[lan] Fodor & Jerrold J[acob] Katz, 33-49. Englewood Cliffs, N.J.: Prentice-Hall, 1964, and also in Harris 1970a.775-794, and in 1981.3-22.)]
^ Peter Spyns, 2000, Natural Language Processing in Medicine: Design, Implementation and Evaluation of an Analyser for Dutch, Leuven University Press, ISBN 978-90-5867-069-4, p. 36.
^ Swadesh, Morris (1934). "The Phonemic Principle". Language. 10 (2): 117–129. doi:10.2307/409603. JSTOR 409603.
^ Diderichsen, Paul (1958). Sivertsen, Eva (ed.). "The Importance of Distribution versus Other Criteria in Linguistic Analysis". Proceedings of the VIII International Congress of Linguists. Oslo University Press: 156–182.
^ Turenne, Nicolas; Pomerol, Jean-Charles (2013). "Language Modeling". Knowledge Needs and Information Extraction. pp. 61–80. doi:10.1002/9781118574560.ch8. ISBN 978-1-84821-515-3.
^ Glottopedia, v. Mentalism
^ Dilley. 1999. The Problem of Context, Berghahn Books, p. 62
^ Harris, Zellig. 1954. "Distributional Structure". Word 10:2/3. p. 156)

Sources

Matthews, P. H.. 1993. Grammatical Theory in the United States from Bloomfield to Chomsky. Cambridge Studies in Linguistics: 67, ISBN 0-521-458471
John G. FOUGHT, Diamond BAR, "Distributionalism and Immediate Constituent Analysis in American Linguistics", in Auroux, Sylvain / Koerner, E.F.K. / Niederehe, Hans-Josef / Versteegh, Kees, Eds. 2001, History of the Language Sciences, vol. 2, coll. Handbücher zur Sprach- und Kommunikationswissenschaft / Handbooks of Linguistics and Communication Science (HSK) 18/2, DE GRUYTER MOUTON, 1986–97.
Geeraerts, Dirk. 2017. "Distributionalism, old and new", in Makarova, Anastasia, Dickey, Stephen M., Divjak, Dagmar Eds., Each Venture a New Beginning. Studies in Honor of Laura A. Janda, Slavica Publisher; Bloomington, IN, ISBN 978-0-89357-478-9, pp. 29 – 38