Word frequency distributions and lexical semantics

This paper addresses the relation between meaning, lexical productivity, and frequency of use. Using density estimation as a visualization tool, we show that differences in semantic structure can be reflected in probability density functions estimated for word frequency distributions. We call attention to an example of a bimodal density, and suggest that bimodality arises when distributions of well-entrenched lexical items, which appear to be lognormal, are mixed with distributions of productively created nonce formations.     

The balance of storage and computation in morphological processing: The role of word formation type, affixal homonymy, and productivity.

This article is concerned with the way in which the balance of storage—storing and processing words through full-form representations—and computation—storing and processing words through morpheme-based representations—in lexical processing in the visual modality is affected by the following 3 factors: word formation type (roughly, inflection vs. derivation), productivity, and affixal homonymy. Experimental results for 5 different Dutch suffixes, combined with previous results obtained for 4 comparable Finnish suffixes (R. Bertram, M. Laine, & K. Karvinen, 1999) and 2 Dutch suffixes (R. H. Baayen, T. Dijkstra, & R. Schreuder, 1997), show that none of these factors in isolation is a reliable cross-linguistic predictor of the balance of storage and computation. The authors offer a general framework that outlines how morphological processing is influenced by the interaction of word formation type, productivity, and affixal homonymy. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Statistical models for word frequency distributions: A linguistic evaluation

Three models for word frequency distributions, the lognormal law, the generalized inverse Gauss-Poisson law and the extended generalized Zipf's law are compared and evaluated with respect to goodness of fit and rationale. Application of these models to frequency distributions of a text, a corpus and morphological data reveals that no model can lay claim to exclusive validity, while inspection of the extrapolated theoretical vocabulary sizes raises doubts as to whether the urn scheme with independent trials is the correct underlying model for word frequency data. The role of morphology in shaping word frequency distributions is discussed, as well as parallelisms between vocabulary richness in literary studies and morphological productivity in linguistics.R. Harald Baayen received his PhD at the Free University, Amsterdam, where he was involved in research on morphological productivity. He is now at the Max-Planck Institute for Psycholinguistics, Nijmegen, participating in a project on computational modelling of lexical representation and process.     

An amorphous model for morphological processing in visual comprehension based on naive discriminative learning.

A 2-layer symbolic network model based on the equilibrium equations of the Rescorla–Wagner model (Danks, 2003) is proposed. The study first presents 2 experiments in Serbian, which reveal for sentential reading the inflectional paradigmatic effects previously observed by Milin, Filipovi? ?ur?evi?, and Moscoso del Prado Martín (2009) for unprimed lexical decision. The empirical results are successfully modeled without having to assume separate representations for inflections or data structures such as inflectional paradigms. In the next step, the same naive discriminative learning approach is pitted against a wide range of effects documented in the morphological processing literature. Frequency effects for complex words as well as for phrases (Arnon & Snider, 2010) emerge in the model without the presence of whole-word or whole-phrase representations. Family size effects (Moscoso del Prado Martín, Bertram, H?iki?, Schreuder, & Baayen, 2004; Schreuder & Baayen, 1997) emerge in the simulations across simple words, derived words, and compounds, without derived words or compounds being represented as such. It is shown that for pseudo-derived words no special morpho-orthographic segmentation mechanism, as posited by Rastle, Davis, and New (2004), is required. The model also replicates the finding of Plag and Baayen (2009) that, on average, words with more productive affixes elicit longer response latencies; at the same time, it predicts that productive affixes afford faster response latencies for new words. English phrasal paradigmatic effects modulating isolated word reading are reported and modeled, showing that the paradigmatic effects characterizing Serbian case inflection have crosslinguistic scope. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Native language influences on word recognition in a second language: A megastudy.

Many studies have reported that word recognition in a second language (L2) is affected by the native language (L1). However, little is known about the role of the specific language combination of the bilinguals. To investigate this issue, the authors administered a word identification task (progressive demasking) on 1,025 monosyllabic English (L2) words to native speakers of French, German, and Dutch. A regression approach was adopted, including a large number of within- and between-language variables as predictors. A substantial overlap of reaction time patterns was found across the groups of bilinguals, showing that word recognition results obtained for one group of bilinguals generalize to bilinguals with different mother tongues. Moreover, among the set of significant predictors, only one between-language variable was present (cognate status); all others reflected characteristics of the target language. Thus, although influences across languages exist, word recognition in L2 by proficient bilinguals is primarily determined by within-language factors, whereas cross-language effects appear to be limited. An additional comparison of the bilingual data with a native control group showed that there are subtle but significant differences between L1 and L2 processing. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Computing Historical Consciousness. A Quantitative Inquiry into the Presence of the Past in Newspaper Texts

In this paper, some electronically gathered data arepresented and analyzed about the presence of the pastin newspaper texts. In ten large text corpora of sixdifferent languages, all dates in the form of yearsbetween 1930 and 1990 were counted. For six of thesecorpora this was done for all the years between 1200and 1993. Depicting these frequencies on the timeline,we find an underlying regularly declining curve,deviations at regular places and culturally determinedpeaks at irregular points. These three phenomena areanalyzed.Mathematically spoken, all the underlying curves havethe same form. Whether a newspaper gives much orlittle attention to the past, the distribution of thisattention over time turns out to be inverselyproportional to the distance between past and present.It is shown that this distribution is largelyindependent of the total number of years in a corpus,the culture in which it is published, the language andthe date of origin of the corpus. The phenomenon isexplained as a kind of forgetting: the larger thedistance between past and present, the more difficultit is to connect something of the past to an item inthe present day. A more detailed analysis of the datashows a breakpoint in the frequency vs. distance fromthe publication date of the texts. References toevents older than approximately 50 years are theresult of a forgetting process that is distinctivelydifferent from the forgetting speed of more recentevents.Pandel's classification of the dimensions ofhistorical consciousness is used to answer thequestion how these investigations elucidate thehistorical consciousness of the cultures in which thenewspapers are written and read.     

How Variable May a Constant be? Measures of Lexical Richness in Perspective

A well-known problem in the domain of quantitative linguistics and stylistics concerns the evaluation of the lexical richness of texts. Since the most obvious measure of lexical richness, the vocabulary size (the number of different word types), depends heavily on the text length (measured in word tokens), a variety of alternative measures has been proposed which are claimed to be independent of the text length. This paper has a threefold aim. Firstly, we have investigated to what extent these alternative measures are truly textual constants. We have observed that in practice all measures vary substantially and systematically with the text length. We also show that in theory, only three of these measures are truly constant or nearly constant. Secondly, we have studied the extent to which these measures tap into different aspects of lexical structure. We have found that there are two main families of constants, one measuring lexical richness and one measuring lexical repetition. Thirdly, we have considered to what extent these measures can be used to investigate questions of textual similarity between and within authors. We propose to carry out such comparisons by means of the empirical trajectories of texts in the plane spanned by the dimensions of lexical richness and lexical repetition, and we provide a statistical technique for constructing confidence intervals around the empirical trajectories of texts. Our results suggest that the trajectories tap into a considerable amount of authorial structure without, however, guaranteeing that spatial separation implies a difference in authorship.     

Morphological Family Size in a Morphologically Rich Language: The Case of Finnish Compared With Dutch and Hebrew.

Finnish has a very productive morphology in which a stem can give rise to several thousand words. This study presents a visual lexical decision experiment addressing the processing consequences of the huge productivity of Finnish morphology. The authors observed that in Finnish words with larger morphological families elicited shorter response latencies. However, in contrast to Dutch and Hebrew, it is not the complete morphological family of a complex Finnish word that codetermines response latencies but only the subset of words directly derived from the complex word itself. Comparisons with parallel experiments using translation equivalents in Dutch and Hebrew showed substantial cross-language predictivity of family size between Finnish and Dutch but not between Finnish and Hebrew, reflecting the different ways in which the Hebrew and Finnish morphological systems contribute to the semantic organization of concepts in the mental lexicon. (PsycINFO Database Record (c) 2010 APA, all rights reserved)