Generic tokenization function for splitting a given input text into single words
(chains of characters delimited by spaces or punctuation marks).
Usage
txt.to.words(input.text)
Arguments
input.text
a string of characters or text.
Details
The generic tokenization function for splitting a given input text into single words
(chains of characters delimited with spaces or punctuation marks).
Alternatively, the function can be another tokenization rules.
ATTENTION: this is the only piece of coding in this script collection that
depends on the operating system used.