wordStem: Get the stem of words

Description

This function extracts the stems of each of the given words in the vector.

Usage

wordStem(words, language = "porter")

Value

A character vector with as many elements as there are in the input vector with the corresponding elements being the stem of the word. Elements of the vector are converted to UTF-8 encoding before the stemming is performed, and the returned elements are marked as such when they contain non-ASCII characters.

Arguments

words: a character vector of words whose stems are to be extracted.
language: the name of a recognized language, as returned by getStemLanguages, or a two- or three-letter ISO-639 code corresponding to one of these languages (see references for the list of codes).

Author

Milan Bouchet-Valat

Details

This uses Dr. Martin Porter's stemming algorithm and the C libstemmer library generated by Snowball.

References

http://snowball.tartarus.org/

http://www.loc.gov/standards/iso639-2/php/code_list.php for a list of ISO-639 language codes.

Examples

Run this code

  # Simple example
  wordStem(c("win", "winning", "winner"))

  # Test some of the vocabulary supplied at https://github.com/snowballstem/snowball-data
  for(lang in getStemLanguages()) {
      load(system.file("words", paste0(lang, ".RData"), package="SnowballC"))

      stopifnot(all(wordStem(dat$words, lang) == dat$stem))
  }

  stopifnot(is.na(wordStem(NA)))

Run the code above in your browser using DataCamp Workspace