resultstest

Example Results Retrieved from Mturk

datasets

By creating crowd-sourcing tasks that can be easily posted and results retrieved using Amazon's Mechanical Turk (MTurk) API, researchers can use this solution to validate the quality of topics obtained from unsupervised or semi-supervised learning methods, and the relevance of topic labels assigned. This helps ensure that the topic modeling results are accurate and useful for research purposes. See Ying and others (2022) <doi:10.1101/2023.05.02.538599>. For more information, please visit <https://github.com/Triads-Developer/Topic_Model_Validation>.

Luwei Ying

validateIt

Validating Topic Coherence and Topic Labels

Jacob Montgomery

Brandon Stewart

resultstest function

A data frame of ten example tasks retrieved from the Mturk with or without 
online workers' answers.
<dl>
<dt><code>assignment_id</code></dt>
<dd>Assignment id. Mturk assigned. If 0, then the task hasn't been completed.</dd><dt><code>batch_id</code></dt>
<dd>User specified batch id.</dd><dt><code>completed_at</code></dt>
<dd>Timestamp when the task was completed. If 0, then the task hasn't been completed.</dd><dt><code>local_task_id</code></dt>
<dd>Local task id.</dd><dt><code>mturk_hit_id</code></dt>
<dd>Mturk HIT id. Mturk assigned.</dd><dt><code>result</code></dt>
<dd>Choice made by the worker. 1-4. If 0, then the task hasn't been completed.</dd><dt><code>worker_id</code></dt>
<dd>Mturk worker id. If 0, then the task hasn't been completed.</dd>
</dl>

Format

Example Results Retrieved from Mturk — resultstest

A data frame of ten example tasks retrieved from the Mturk with or without 
online workers' answers.
<dl>
<dt><code>assignment_id</code></dt>
<dd>Assignment id. Mturk assigned. If 0, then the task hasn't been completed.</dd>

<dt><code>batch_id</code></dt>
<dd>User specified batch id.</dd>

<dt><code>completed_at</code></dt>
<dd>Timestamp when the task was completed. If 0, then the task hasn't been completed.</dd>

<dt><code>local_task_id</code></dt>
<dd>Local task id.</dd>

<dt><code>mturk_hit_id</code></dt>
<dd>Mturk HIT id. Mturk assigned.</dd>

<dt><code>result</code></dt>
<dd>Choice made by the worker. 1-4. If 0, then the task hasn't been completed.</dd>

<dt><code>worker_id</code></dt>
<dd>Mturk worker id. If 0, then the task hasn't been completed.</dd>


</dl>

resultstest: Example Results Retrieved from Mturk

Description

Usage

Arguments

Format