get_search_urls

Page 2+ require POST; only page 1 is a direct browser URL.

A lightweight toolkit for text retrieval and NLP with a consistent and
predictable API organized around four actions: fetching, reading,
processing, and searching. Functions cover the full pipeline from web
data acquisition to text processing and indexing. Multiple search
strategies are supported including regex, BM25 keyword ranking, cosine
similarity, and dictionary matching. Pipe-friendly with no heavy
dependencies and all outputs are plain data frames. Also useful as a
building block for retrieval-augmented generation pipelines and
autonomous agent workflows.

Jason Timm

textpress

A Lightweight and Versatile NLP Toolkit

get_search_urls function

<dl><dt>query</dt>
<dd>Search query string.</dd>
<dt>n_pages</dt>
<dd>Number of pages (informational for page 2+).</dd>
<dt>date_filter</dt>
<dd>Recency filter: <code>"d"</code>, <code>"w"</code>, <code>"m"</code>, or <code>"none"</code> (default <code>"w"</code>).</dd></dl>

Arguments

Get the search URL(s) used by fetch_urls (for debugging or browser use) — get_search_urls

<dl>

<dt>query</dt>
<dd>Search query string.</dd>


<dt>n_pages</dt>
<dd>Number of pages (informational for page 2+).</dd>


<dt>date_filter</dt>
<dd>Recency filter: <code>"d"</code>, <code>"w"</code>, <code>"m"</code>, or <code>"none"</code> (default <code>"w"</code>).</dd>

</dl>

get_search_urls: Get the search URL(s) used by fetch_urls (for debugging or browser use)

Description

Usage

Value

Arguments