vitals

vitals-package

<img src="figures/logo.png?package=vitals&version=0.1.0" style="float: right" alt="logo" width="120">
A port of 'Inspect', a widely adopted 'Python' framework for large language model evaluation. Specifically aimed at 'ellmer' users who want to measure the effectiveness of their large language model-based products, the package supports prompt engineering, tool usage, multi-turn dialog, and model graded evaluations.

internal

A port of 'Inspect', a widely adopted 'Python' framework for
large language model evaluation. Specifically aimed at 'ellmer' users
who want to measure the effectiveness of their large language model-based
products, the package supports prompt engineering, tool usage,
multi-turn dialog, and model graded evaluations.

Simon Couch

Large Language Model Evaluation

Max Kuhn

Hadley Wickham

Mine Cetinkaya-Rundel

Posit Software, PBC 

vitals-package function

Maintainer: Simon Couch <a href="/link/simon.couch%40posit.co?package=vitals&version=0.1.0" data-mini-rdoc="vitals::simon.couch@posit.co">simon.couch@posit.co</a> (<a href="https://orcid.org/0000-0001-5676-5107">ORCID</a>)
Other contributors:<ul>
<li>Max Kuhn <a href="/link/max%40posit.co?package=vitals&version=0.1.0" data-mini-rdoc="vitals::max@posit.co">max@posit.co</a> [contributor]</li>
<li>Hadley Wickham <a href="/link/hadley%40posit.co?package=vitals&version=0.1.0" data-mini-rdoc="vitals::hadley@posit.co">hadley@posit.co</a> (<a href="https://orcid.org/0000-0003-4757-117X">ORCID</a>) [contributor]</li>
<li>Mine Cetinkaya-Rundel <a href="/link/mine%40posit.co?package=vitals&version=0.1.0" data-mini-rdoc="vitals::mine@posit.co">mine@posit.co</a> (<a href="https://orcid.org/0000-0001-6452-2420">ORCID</a>) [contributor]</li>
<li>Posit Software, PBC (03wc8by49) [copyright holder, funder]</li>
</ul>

Author

<img src='figures/logo.png' style='float: right' alt='logo' width='120' />
A port of 'Inspect', a widely adopted 'Python' framework for large language model evaluation. Specifically aimed at 'ellmer' users who want to measure the effectiveness of their large language model-based products, the package supports prompt engineering, tool usage, multi-turn dialog, and model graded evaluations.

vitals: Large Language Model Evaluation — vitals-package

Maintainer: Simon Couch <a href='mailto:simon.couch@posit.co'>simon.couch@posit.co</a> (<a href='https://orcid.org/0000-0001-5676-5107'>ORCID</a>)
Other contributors:<ul>
<li>Max Kuhn <a href='mailto:max@posit.co'>max@posit.co</a> [contributor]</li>
<li>Hadley Wickham <a href='mailto:hadley@posit.co'>hadley@posit.co</a> (<a href='https://orcid.org/0000-0003-4757-117X'>ORCID</a>) [contributor]</li>
<li>Mine Cetinkaya-Rundel <a href='mailto:mine@posit.co'>mine@posit.co</a> (<a href='https://orcid.org/0000-0001-6452-2420'>ORCID</a>) [contributor]</li>
<li>Posit Software, PBC (03wc8by49) [copyright holder, funder]</li>
</ul>

vitals-package: vitals: Large Language Model Evaluation

Description

Arguments

Author

See Also