sanitize_permission_values

<p>the value column of permissions (the paths)</p>

permission_value

<p>transforming permissions into regular expressions (values)</p>

internal

Provides functions to download and parse 'robots.txt' files.
Ultimately the package makes it easy to check if bots
(spiders, crawler, scrapers, ...) are allowed to access specific
resources on a domain.

Peter Meissner

sanitize_permission_values: transforming permissions into regular expressions (values)

Description

Usage

Arguments