urltools v1.5.0

0

0th

Percentile

Vectorised Tools for URL Handling and Parsing

A toolkit for handling URLs that so far includes functions for URL encoding and decoding, parsing, and parameter extraction. All functions are designed to be both fast and entirely vectorised. It is intended to be useful for people dealing with web-related datasets, such as server-side logs, although may be useful for other situations involving large sets of URLs.

##urltools A package for elegantly handling and parsing URLs from within R.

Author: Oliver Keyes, Jay Jacobs
Status: Stable

###Description

URLs in R are often treated as nothing more than part of data retrieval - they're used for making connections and reading data. With web analytics and research, however, URLs can be the data, and R's default handlers are not best suited to handle vectorised operations over large datasets. urltools is intended to solve this.

It contains drop-in replacements for R's URLdecode and URLencode functions, along with new functionality such as a URL parser and parameter value extractor. In all cases, the functions are designed to be content-safe (not breaking on unexpected values) and fully vectorised, resulting in a dramatic speed improvement over existing implementations - crucial for large datasets. For more information, see the urltools vignette.

Please note that this project is released with a Contributor Code of Conduct. By participating in this project you agree to abide by its terms.

###Installation

The latest CRAN version can be obtained via:

install.packages("urltools")


To get the development version:

devtools::install_github("ironholds/urltools")


###Dependencies

Functions in urltools

 Name Description param_get get the values of a URL's parameters url_decode Encode or decode a URI param_set Set the value associated with a parameter in a URL's query. parameters Get or set a URL's parameters domain Get or set a URL's domain path Get or set a URL's path fragment Get or set a URL's fragment tld_refresh Retrieve a TLD dataset url_compose Recompose Parsed URLs suffix_extract extract the suffix from domain names suffix_refresh Retrieve a public suffix dataset tld_extract Extract TLDs tld_dataset Dataset of top-level domains (TLDs) url_parse split URLs into their component parts urltools Tools for handling URLs scheme Get or set a URL's scheme suffix_dataset Dataset of public suffixes param_remove Remove key-value pairs from query strings host_extract Extract hosts port Get or set a URL's port No Results!