textpress (version 1.0.0)

web_search: Process search results from multiple search engines

Description

This function allows you to query different search engines (DuckDuckGo, Bing, Yahoo News), retrieve search results, and filter them based on predefined patterns.

Usage

web_search(
  search_term,
  search_engine,
  num_pages = 1,
  time_filter = NULL,
  insite = NULL,
  intitle = FALSE
)

Value

A `data.table` containing search engine results with columns `search_engine` and `raw_url`.

Arguments

search_term

The search query as a string.

search_engine

The search engine to use: "DuckDuckGo", "Bing", or "Yahoo News".

num_pages

The number of result pages to retrieve (default: 1).

time_filter

Optional time filter ("week", "month", "year").

insite

Restrict search to a specific domain (not supported for Yahoo).

intitle

Search within the title (relevant for DuckDuckGo and Bing).