check_lang

Many, if not all, large language models are biased to English 
terms and sentence constructions. This function performs a quick check with
<code>cld2</code> over every element of a string of
characters and returns whether it is mostly (75

A Python based pipeline for extraction of species occurrence data through the usage of large language models. Includes validation tools designed to handle model hallucinations for a scientific, rigorous use of LLM. Currently supports usage of GPT with more planned, including local and non-proprietary models. For more details on the methodology used please consult the references listed under each function, such as Kent, A. et al. (1995) <doi:10.1002/asi.5090060209>, van Rijsbergen, C.J. (1979, ISBN:978-0408709293, Levenshtein, V.I. (1966) <https://nymity.ch/sybilhunting/pdf/Levenshtein1966a.pdf> and Klaus Krippendorff (2011) <https://repository.upenn.edu/handle/20.500.14332/2089>.

Vasco V. Branco

arete

Automated REtrieval from TExt

Vaughn Shirey

Thomas Merrien

Pedro Cardoso

check_lang function

<dl><dt>strings</dt>
<dd>character. Vector of strings containing document sentences.</dd>
<dt>detailed</dt>
<dd>bool. If TRUE, the full cld2 report is returned as well.</dd></dl>

Arguments

Check if text is language-appropriate — check_lang

<dl>

<dt>strings</dt>
<dd>character. Vector of strings containing document sentences.</dd>


<dt>detailed</dt>
<dd>bool. If TRUE, the full cld2 report is returned as well.</dd>

</dl>

check_lang: Check if text is language-appropriate

Description

Usage

Value

Arguments

Examples