textpress (version 1.1.0)

fetch_urls: Fetch URLs from a search engine

Description

Queries DuckDuckGo Lite and returns result URLs (no local text search). Use read_urls to get content from these URLs.

Usage

fetch_urls(query, n_pages = 1, date_filter = "w")

Value

A data.table with columns search_engine, url, is_excluded.

Arguments

query

Search query string.

n_pages

Number of DDG Lite pages to fetch (default 1). ~30 results per page.

date_filter

Recency filter: "d" (day), "w" (week), "m" (month), or "none" (default "w").

Examples

if (FALSE) {
urls_dt <- fetch_urls("R programming nlp", n_pages = 1)
urls_dt$url
}