{"Package":"cometr","Title":"'Comet' API for R","Version":"0.4.0","Authors@R":"c(\nperson(given = \"Dean\",\nfamily = \"Attali\",\nrole = c(\"aut\"),\nemail = \"daattali@gmail.com\"),\nperson(given = \"Doug\",\nfamily = \"Blank\",\nrole = c(\"aut\"),\nemail = \"doug@comet.com\"),\nperson(given = \"Iaroslav\",\nfamily = \"Omelianenko\",\nrole = c(\"aut\"),\nemail = \"iaroslav@comet.com\",\ncomment = c(ORCID = \"0000-0002-2190-5664\")),\nperson(given = \"Nimrod\",\nfamily = \"Lahav\",\nrole = c(\"cre\"),\nemail = \"nimrod@comet.com\"),\nperson(\"Comet ML, Inc.\", role = c(\"cph\", \"fnd\")))","Description":"A convenient 'R' wrapper to the 'Comet' API, which is a cloud\nplatform allowing you to track, compare, explain and optimize machine\nlearning experiments and models. Experiments can be viewed on the 'Comet'\nonline dashboard at .","URL":"https://github.com/comet-ml/cometr","BugReports":"https://github.com/comet-ml/cometr/issues","Imports":"callr, httr, jsonlite, R.utils, R6 (>= 2.4.0), utils, yaml,\ndigest","Suggests":"covr, curl, git2r (>= 0.22.1), httptest, ps, testthat, withr","Depends":"R (>= 3.5.0)","License":"MIT + file LICENSE","Encoding":"UTF-8","RoxygenNote":"7.2.3","NeedsCompilation":"no","Packaged":"2023-10-19 11:59:43 UTC; iaroslavomelianenko","Author":"Dean Attali [aut],\nDoug Blank [aut],\nIaroslav Omelianenko [aut] (),\nNimrod Lahav [cre],\nComet ML, Inc. [cph, fnd]","Maintainer":"Nimrod Lahav ","Repository":"CRAN","Date/Publication":"2023-10-19 12:10:08 UTC","repoType":"cran","tarballUrl":"ftp://cran.r-project.org/pub/R/src/contrib/cometr_0.4.0.tar.gz","jsonAuthors":[{"name":"Dean Attali","email":"daattali@gmail.com","maintainer":false},{"name":"Doug Blank","email":"doug@comet.com","maintainer":false},{"name":"Iaroslav Omelianenko","email":"iaroslav@comet.com","maintainer":false},{"name":"Nimrod Lahav","email":"nimrod@comet.com","maintainer":true},{"name":"Comet ML, Inc. ","email":null,"maintainer":false}],"readme":"# cometr - Comet API for R\n\n[![CRAN version](https://www.r-pkg.org/badges/version/cometr)](https://cran.r-project.org/package=cometr)\n[![R](https://github.com/comet-ml/cometr/actions/workflows/r.yml/badge.svg?branch=master)](https://github.com/comet-ml/cometr/actions/workflows/r.yml)\n\n[Comet](https://www.comet.com/) is a cloud platform allowing you to track, compare, explain and optimize machine learning experiments and models. If you perform any machine learning in R, you can use the `cometr` R package to create and track Comet experiments. All experiment data is available for retrieval through `cometr` or can be viewed on the [Comet dashboard](https://www.comet.com/).\n\nYou can read more about Comet to see its full capabilities on [Comet's website](https://www.comet.com/). The package currently supports Comet's REST API v2.\n\n## Installation\n\nTo install the stable CRAN version:\n\n```\ninstall.packages(\"cometr\")\n```\n\nTo install the latest development version from GitHub:\n\n```\ninstall.packages(\"remotes\")\nremotes::install_github(\"comet-ml/cometr\")\n```\n\n## One-time setup\n\nTo use `cometr`, you must first have a [Comet](https://www.comet.com/) account (you can sign up for a free account) and obtain your personal API key from the 'Settings' page on Comet's website. The API key can either be passed into every `cometr` function call as an argument, or it can be defined as a configuration variable as described later in the 'Configuration variables' section.\n\n## How to use\n\n`cometr` is most useful when used in an R script that is run using the `Rscript` tool. It can also be used in interactive environments (such as the R shell or RStudio). To use Comet in your R script, you need to first load `cometr` and create a Comet Experiment by calling `create_experiment()`.\n\n```\nlibrary(cometr)\nAPI_KEY <- \"\"\nexp <- create_experiment(experiment_name = \"my-first-experiment\",\n project_name = \"project1\",\n workspace_name = \"daattali\",\n api_key = API_KEY)\n```\n\nYou'll see a message displayed with a URL where you can view this newly created Experiment online.\n\n```\nExperiment created: https://www.comet.com/daattali/project1/46d53bbce4e14fb692585b6e73da6e0c\n```\n\nBy default, creating an experiment will log your system's details to Comet's servers, keep track of how long your experiment is running for, log any output that gets generated, and perform a few more house-keeping tasks automatically. You can run `?cometr::create_experiment` to see all the supported features and turn them on or off. \n\nNow that an Experiment object has been created, you can run your machine learning code as usual. The `exp` variable you created is an Experiment object (which is an R6 object--if you don't know what that means then don't worry about it!), and we can use it to set parameters of the experiment and to retrieve information from it. To see all the methods that are supported on Experiment objects, run `?cometr::Experiment`.\n\nHere is an example of how you can use the `exp` object to set or retrieve experiment information:\n\n```\n> exp$get_key()\n[1] \"46d53bbce4e14fb692585b6e73da6e0c\"\n> exp$log_metric(\"metric1\", 5, step = 1)\n> exp$log_metric(\"metric1\", 10, step = 2)\n> exp$log_graph('{\"nodes\":[[\"a\"],[\"b\"],[\"c\"]],\"edges\":[[\"a,b\"],[\"c,a\"]]}')\n> str(exp$get_metrics_summary())\nList of 1\n $ values:List of 1\n ..$ :List of 10\n .. ..$ name : chr \"metric1\"\n .. ..$ valueMax : chr \"10.0\"\n .. ..$ valueMin : chr \"5.0\"\n .. ..$ valueCurrent : chr \"10.0\"\n .. ..$ timestampMax : num 1.59e+12\n .. ..$ timestampMin : num 1.59e+12\n .. ..$ timestampCurrent: num 1.59e+12\n .. ..$ stepMax : int 2\n .. ..$ stepMin : int 1\n .. ..$ stepCurrent : int 2\n> exp$get_graph()\n$graph\n[1] \"{\\\"nodes\\\":[[\\\"a\\\"],[\\\"b\\\"],[\\\"c\\\"]],\\\"edges\\\":[[\\\"a,b\\\"],[\\\"c,a\\\"]]}\"\n```\n\nA Comet Experiment will automatically end when the R script that created it finishes running. However, it's recommended to explicitly stop the experiment with `exp$stop()`.\n\nWhile the Experiment object and its associated functions are the cornerstone of `cometr`, there are other functions that aren't directly related to a specific experiment, such as `get_workspaces()`, `get_projects()`, `get_experiments()`, `create_project()`, `delete_project()`.\n\n```\n> get_workspaces(api_key = API_KEY)\n$workspaceNames\n$workspaceNames[[1]]\n[1] \"cometrtestws\"\n\n$workspaceNames[[2]]\n[1] \"daattali\"\n```\n\n### Comet Artifacts Support\n\nComet Artifacts allow you to keep track of any data associated with the ML Lifecycle. Depending on your application you might decide to either upload the dataset directly to Comet or using the Remote Artifacts feature to store a reference to it instead. No matter the option you choose, Comet will maintain the lineage between your datasets and the training runs that created or consumed them.\n\nArtifacts live at a Comet Workspace level and are identified by their name. Each Artifact can have multiple versions allowing you to keep track of exactly which dataset was used.\n\n#### Logging an Artifact\n\nLogging an Artifact has three steps:\n\n* Create an Artifact Version\n* Add files and folders to this Artifact Version\n* Logging this Artifact Version to an Experiment\n\n**Log an Artifact to Comet**\n\nWhen you are ready to send the Artifact to Comet, you will log it with `Experiment$log_artifact(ARTIFACT)`.\n\nHere is an example of how you can use the `exp` object to log Comet artifact:\n\n```\nmetadata <- list(foo=\"bar\")\ntags <- list(\"tag1\", \"tag2\")\naliases <- list(\"alias1\", \"alias2\")\nremote_uri <- \"http://localhost/dataset.dat\"\nartifact <- create_artifact(artifact_name = \"artifact-name\",\n artifact_type = \"dataset\",\n metadata = metadata,\n aliases = aliases,\n version_tags = tags)\n\n# Add remote asset to the Artifact \nartifact$add_remote(uri = remote_uri,\n logical_path = \"dataset\",\n metadata = metadata)\n\n# Add local folder to the Artifact\nartifact$add(local_path = \"./data-folder\",\n logical_path = \"data-files\",\n metadata = metadata)\n\n# Add single file to the Artifact\nartifact$add(local_path = \"./sample-script.R\",\n logical_path = \"samle-code\",\n metadata = metadata)\n \nexp$log_artifact(artifact)\n```\n\nThe code above will create new Comet Artifact. After that remote and local assets will be added to it and Artifact with all assets will be uploaded to Comet.\n\n**Access a logged Artifact version**\n\nYou can retrieve a logged Artifact from any workspace that you have permission to access, and a workspace name with the Experiment$get_artifact() method:\n\n```\nlogged_artifact <- exp$get_artifact(artifact_name=NAME,\n workspace=WORKSPACE,\n version_or_alias=VERSION_OR_ALIAS)\n```\n\nTo make it easier to access the artifact, you can retrieve a logged Artifact in three ways:\n\n* Get the latest Artifact version by leaving out the `version_or_alias` arguments.\n* Get a specific Artifact version by passing in the `version_or_alias` argument.\n* Get an aliased Artifact version by passing in the `version_or_alias` argument.\n* Get a specific Artifact version by passing in the `artifact_name` in the form of full name of the Artifact and leaving out the other arguments.\n\nThe full name of the Artifact has the following format `workspace/artifact-name:version_or_alias` and can take the following forms as an example:\n\n* `workspace\\artifact-name:2.0.0` - will get the `2.0.0` version of the artifact `artifact-name` from workspace `workspace`\n* `artifact-name:2.0.0` - will get the `2.0.0` version of the artifact `artifact-name` from default user's workspace\n* `artifact-name` - will get the latest version of the artifact `artifact-name` from default user's workspace\n\nYou can also use an alias for a specific version of the Artifact in the above examples instead of the semantic version if you prefer.\n\n**Learn more**\n\nYou can find more details about Comet Artifacts at:\n\n* [Use Artifacts](https://www.comet.com/docs/v2/guides/data-management/using-artifacts/): an overview of the Comet Artifacts feature.\n* [Artifacts UI](https://www.comet.com/docs/v2/guides/comet-dashboard/artifacts/): Artifacts pages in the Comet UI.\n\n## Configuration variables\n\nSince it can get tedious to repeat the `api_key` in different function calls, and it can also be a security concern to include the API key in your code, you can set the API key and a few other variables as `cometr` configuration variables.\n\nThe following table lists all the configuration variables that `cometr` uses. All of these variables are optional.\n\n| Variable | Description |\n|---|---|\n| `COMET_API_KEY` | Personal Comet API key to use in every function that accepts an `api_key` parameter. \\*\\*\\* |\n| `COMET_WORKSPACE` | Default workspace to use in every function that accepts a `workspace_name` parameter. \\*\\*\\* |\n| `COMET_PROJECT_NAME` | Default project to use in every function that accepts a `project_name` parameter. \\*\\*\\* |\n| `COMET_LOGGING_FILE` | File to store detailed logs produced by `cometr`. This is mostly useful for troubleshooting. |\n| `COMET_LOGGING_FILE_LEVEL` | If a logging file is provided, set the level of information to log. Must be one of \"DEBUG\", \"INFO\", \"ERROR\". |\n| `COMET_URL_OVERRIDE` | Custom Comet API URL, if you have one. |\n\n_\\*\\*\\* If this value is not provided as a configuration variable, it must be provided as an argument to the relevant functions. If a value is provided as an argument directly to the function, that argument takes precedence and the configuration value is ignored._\n\nConfiguration variables can be set either as environment variables or in a `cometr` config file.\n\nA `cometr` config file is a YAML file named `.comet.yml` that can be defined either in the current working directory or in the user's home directory. For example, a `cometr` config file that defines a default workspace and a default project could look like this:\n\n```\nCOMET_WORKSPACE: my_workspace\nCOMET_PROJECT_NAME: my_project\n```\n\nIf a configuration variable is defined in multiple places, then the order of precedence is as follows:\n\n1. Function argument, if relevant (for API keys, workspace name, project name)\n2. Environment variable\n3. `.comet.yml` config file in the local working directory\n4. `.comet.yml` config file in the home directory","jobInfo":{"package":"cometr","version":"0.4.0","parsingStatus":"success","parserVersion":2,"parsedAt":"2023-10-19T14:30:06+0000"}}

Description

Usage

Arguments