Gives measures of semantic transparency (plausibility) for words or compounds
plausibility(x,method, n=10,stem,tvectors=tvectors,breakdown=FALSE)a character vector of length(x) = 1 or a numeric of length=ncol(tvectors) vector with same dimensionality as LSA space
the measure of semantic transparency, can be one of n_density,length, proximity, or entropy (see Details)
the number of neighbors for the n_density method
the stem (or word) of comparison for the proximity method
the semantic space in which the computation is to be done (a numeric matrix where every row is a word vector)
if TRUE, the function breakdown is applied to the input
The semantic transparency as a numeric
The format of x should be of the kind x <- "word1 word2 word3" instead ofx <- c("word1", "word2", "word3") if phrases of more than one word are used as input. Simple vector addition of the constituent vectors is then used to compute the phrase vector.
Since x can also be chosen to be any vector of the active LSA Space, this function can be combined with compose() to compute semantic transparency measures of complex expressions (see examples). Since semantic transparency methods were developed as measures for composed vectors, applying them makes most sense for those.
The methods are defined as follows:
method = "n_density" The average cosine between a (word or phrase) vector and its n nearest neighbors (see neighbors)
method = "length" The length of a vector (as computed by the standard Euclidean norm)
method = "proximity" The cosine similarity between a compound vector and its stem word (for example between mad hatter and hatter or between objectify and object)
method = "entropy" The entropy of the K-dimensional vector with the vector components \(t_1,...,t_K \), as computed by
$$entropy = \log{K} - \sum{t_i * \log{t_i}} $$
Lazaridou, A., Vecchi, E., & Baroni, M. (2013). Fish transporters and miracle homes: How compositional distributional semantics can help NP parsing. In Proceedings of EMNLP 2013 (pp. 1908 - 1913). Seattle, WA.
Marelli, M., & Baroni, M. (in press). Affixation in semantic space: Modeling morpheme meanings with compositional distributional semantics. Psychological Review.
Vecchi, E. M., Baroni, M., & Zamparelli, R. (2011). (Linear) maps of the impossible: Capturing semantic anomalies in distributional space. In Proceedings of the ACL Workshop on Distributional Semantics and Compositionality (pp. 1-9). Portland, OR.
# NOT RUN {
data(wonderland)
plausibility("cheshire cat",method="n_density",n=10,tvectors=wonderland)
plausibility(compose("mad","hatter",method="Multiply",tvectors=wonderland),
method="proximity",stem="hatter",tvectors=wonderland)
# }
Run the code above in your browser using DataLab