quanteda package - RDocumentation

Learn R Programming

⚠️There's a newer version (4.2.0) of this package.Take me there.

About

An R package for managing and analyzing text, created by Kenneth Benoit. Supported by the European Research Council grant ERC-2011-StG 283794-QUANTESS.

For more details, see https://quanteda.io.

How to Install

The normal way from CRAN, using your R GUI or

install.packages("quanteda")

Or for the latest development version:

# devtools package required to install quanteda from Github 
devtools::install_github("quanteda/quanteda")

Because this compiles some C++ and Fortran source code, you will need to have installed the appropriate compilers.

If you are using a Windows platform, this means you will need also to install the Rtools software available from CRAN.

If you are using macOS, you should install the macOS tools, namely the Clang 6.x compiler and the GNU Fortran compiler (as quanteda requires gfortran to build). If you are still getting errors related to gfortran, follow the fixes here.

How to Use

See the quick start guide to learn how to use quanteda.

How to cite

Benoit, Kenneth, Kohei Watanabe, Haiyan Wang, Paul Nulty, Adam Obeng, Stefan Müller, and Akitaka Matsuo. (2018) “quanteda: An R package for the quantitative analysis of textual data”. Journal of Open Source Software. 3(30), 774. https://doi.org/10.21105/joss.00774.

For a BibTeX entry, use the output from citation(package = "quanteda").

Leaving Feedback

If you like quanteda, please consider leaving feedback or a testimonial here.

Contributing

Contributions in the form of feedback, comments, code, and bug reports are most welcome. How to contribute:

Fork the source code, modify, and issue a pull request through the project GitHub page. See our Contributor Code of Conduct and the all-important quanteda Style Guide.
Issues, bug reports, and wish lists: File a GitHub issue.
Usage questions: Submit a question on the quanteda channel on StackOverflow.
Contact the maintainer by email.

Copy Link

Version

Install

install.packages('quanteda')

Monthly Downloads

14,820

Version

2.1.2

License

GPL-3

Maintainer

Kenneth Benoit

Last Published

September 23rd, 2020

Functions in quanteda (2.1.2)

Coercion and checking functions for fcm objects

Coercion and checking functions for dictionary objects

View methods for quanteda

Convert the case of character objects

coerce a compressed corpus to a standard corpus

Coerce a dfm to a matrix or data.frame

Convert an fcm to an igraph object

Check if font is available on the system

Coercion, checking, and combining functions for tokens objects

Compute the Moving-Average Type-Token Ratio (MATTR)

Convert quanteda dictionary objects to the YAML format

Randomly sample documents from a corpus

compute_lexdiv_stats

Compute lexical diversity from a dfm or tokens

as.data.frame.dfm

Convert a dfm to a data.frame

Replace features in dfm

data_char_sampletext

A paragraph of text for testing various text-based functions

convert-wrappers

Convenience wrappers for dfm convert

Match the feature set of a dfm to given feature names

data_char_ukimmig2010

Immigration-related sections of 2010 UK party manifestos

Segment texts on a pattern match

Coercion and checking functions for dfm objects

Compute the Mean Segmental Type-Token Ratio (MSTTR)

data_dictionary_LSD2015

Lexicoder Sentiment Dictionary (2015)

Virtual class "dfm" for a document-feature matrix

as.matrix,textstat_simil_sparse-method

as.matrix method for textstat_simil_sparse

Create a feature co-occurrence matrix

Convert a dfm to an lsa "textmatrix"

Recombine a dfm or fcm by combining identical dimension elements

Sort a dfm by frequency of one or more margins

Select or remove elements from a character vector

Combine dfm objects by Rows or Columns

Virtual class "fcm" for a feature co-occurrence matrix

flatten_dictionary

Flatten a hierarchical dictionary into a list of character vectors

dfm_split_hyphenated_features

Split a dfm's hyphenated features into constituent parts

dictionary2-class

dictionary class objects and functions

redefinition of network::as.network()

Convert quanteda objects to non-quanteda formats

Combine documents in a dfm by a grouping variable

Function extending base::attributes()

Extract a subset of a corpus

Apply a dictionary to a dfm

data_corpus_inaugural

US presidential inaugural address texts

data_dfm_lbgexample

dfm from data in Table 1 of Laver, Benoit, and Garry (2003)

Base method extensions for corpus objects

Construct a corpus object

Check if patterns contains glob wildcard

format_sparsity

format a sparsity value for printing

Bootstrap a dfm

Remove sentences based on their token lengths or a pattern match

dictionary_edit

Conveniently edit dictionaries

get_object_version

Get the package version that created an object

Create a dictionary

Internal function to get, set or initialize system metadata

Internal function to extract docvars

Get or set object metadata

Check if a glob pattern is indexed by index_types

Locate keywords-in-context

Convert the case of the features of a dfm and combine

corpus_trimsentences

Remove sentences based on their token lengths or a pattern match

Compute the (weighted) document frequency of a feature

list2dictionary

Internal function to convert a list to a dictionary

Declare a compound character to be a sequence of separate pattern matches

Function to assign multiple slots to a S4 object

Trim a dfm using frequency threshold-based feature selection

set_fcm_slots<-

Set values to a fcm's S4 slots

set_dfm_slots<-

Set values to a dfm's S4 slots

Sample a vector by a group

reshape_docvars

Internal function to subset or duplicate docvar rows

Recast the document units of a corpus

Get or set document-level meta-data

Get or set document names

Internal functions for dfm objects

Formerly included data objects

Randomly sample documents or features from a dfm

textplot_network

Plot a network of feature co-occurrences

textplot_keyness

Plot word keyness

Select features from a dfm or fcm

Get the feature labels from a dfm

Get or set document-level variables

Extract a subset of a dfm

Internal data sets

Sort an fcm in alphabetical order of the features

Shortcut functions to access or assign metadata

Create a document-feature matrix

Compute the frequencies of features

Weight a dfm by tf-idf

Grouping variable(s) for various functions

Weight the feature frequencies in a dfm

Count syllables in a text

Count the number of tokens or types

remove_empty_keys

Utility function to remove empty keys

textstat_lexdiv

Calculate lexical diversity

replace_dictionary_values

Internal function to replace dictionary values

textstat_keyness

Calculate keyness statistics

Recombine documents tokens by groups

Special handling for names of quanteda objects

Return the first or last part of a corpus

Apply a dictionary to a tokens object

convert same-value pairs to NA in a textstat_proxy object

Internal function for special handling of multi-word dictionary values

Internal function for select_types() to check if a string is a regular expression

Summarize a corpus

Internal function for select_types() to escape regular expressions

Get or assign corpus texts

Simpler and faster version of expand.grid() in base package

Unlist a list of integer vectors safely

textstat_collocations

Identify and score multi-word expressions

textstat_proxy-class

textstat_simil/dist classes

Compute keyness (internal functions)

[Experimental] Compute document/feature proximity

friendly_class_undefined_message

Print friendly object class not defined message

Converts a Matrix to a dfm

Converts a Matrix to a fcm

Convert regex and glob patterns to type IDs or fixed patterns

Raise warning of unused dots

generate_groups

Generate a grouping vector from docvars

Return the first or last part of a dfm

Convert various input as pattern to a vector used in tokens_select, tokens_compound and kwic.

head.textstat_proxy

Return the first or last part of a textstat_proxy object

tokens_compound

Convert token sequences into compound tokens

Print methods for quanteda core objects

Segment tokens object by chunks of a given size

Internal functions to create a list for the meta attribute

lowercase_dictionary_values

Internal function to lowercase dictionary values

merge_dictionary_values

Internal function to merge values of duplicated keys

Count the number of documents or features

Count the Scrabble letter values of text

Count the number of sentences

Get word types from a tokens object

nest_dictionary

Utility function to generate a nested list

Print a phrase object

serialize_tokens

Function to serialize list-of-character tokens

set_dfm_dimnames<-

Internal functions to set dimnames

Return an error message

quanteda-package

An R package for the quantitative analysis of textual data

Objects exported from other packages

Pattern for feature, token and keyword matching

Extensions for and from spacy_parse objects

read_dict_functions

Internal functions to import dictionary files

object-builders

Object compilers

quanteda_options

Get or set package options for quanteda

wordcloud_comparison

Internal function for textplot_wordcloud

unlist_character

Unlist a list of character vectors safely

Compute the sparsity of a document-feature matrix

textplot_wordcloud

Plot features as a wordcloud

Plot the dispersion of key word(s)

tokenize_internal

quanteda tokenizers

Construct a tokens object

textstat_entropy

Compute entropies of documents or features

Internal function for select_types to search the index using fastmatch.

textstat_summary

Summarize documents

Select types without performing slow regex search

Similarity and distance computation between documents or features

textstat_frequency

Tabulate feature frequencies

Segment tokens object by patterns

Replace tokens in a tokens object

Select or remove tokens from a tokens object

tokens_wordstem

Stem the terms in an object

Split tokens by a separator pattern

Extract a subset of a tokens

Randomly sample documents from a tokens object

Identify the most frequent features in a dfm

summary_metadata

Functions to add or retrieve corpus summary metadata

Models for scaling and classification of textual data

textstat_readability

Calculate readability

textstat_select

Select rows of textstat objects by glob, regex or fixed patterns

Create ngrams and skipgrams from tokens

Convert the case of tokens

[Experimental] Change direction of words in tokens

Pattern matching using valuetype

Internal function for textplot_wordcloud

tokens_recompile

recompile a serialized tokens object