evaluations

Creates, updates, deletes, gets or lists a evaluations resource.

Overview

Name	evaluations
Type	Resource
Id	google.datalabeling.evaluations

Fields

Name	Datatype	Description
name	string	Output only. Resource name of an evaluation. The name has the following format: "projects/{project_id}/datasets/{dataset_id}/evaluations/ {evaluation_id}'
annotationType	string	Output only. Type of task that the model version being evaluated performs, as defined in the evaluationJobConfig.inputConfig.annotationType field of the evaluation job that created this evaluation.
config	object	Configuration details used for calculating evaluation metrics and creating an Evaluation.
createTime	string	Output only. Timestamp for when this evaluation was created.
evaluatedItemCount	string	Output only. The number of items in the ground truth dataset that were used for this evaluation. Only populated when the evaulation is for certain AnnotationTypes.
evaluationJobRunTime	string	Output only. Timestamp for when the evaluation job that created this evaluation ran.
evaluationMetrics	object

Methods

Name	Accessible by	Required Params	Description
projects_datasets_evaluations_get	SELECT	datasetsId, evaluationsId, projectsId	Gets an evaluation by resource name (to search, use projects.evaluations.search).
projects_evaluations_search	EXEC	projectsId	Searches evaluations within a project.

SELECT examples

Gets an evaluation by resource name (to search, use projects.evaluations.search).

SELECT
name,
annotationType,
config,
createTime,
evaluatedItemCount,
evaluationJobRunTime,
evaluationMetrics
FROM google.datalabeling.evaluations
WHERE datasetsId = '{{ datasetsId }}'
AND evaluationsId = '{{ evaluationsId }}'
AND projectsId = '{{ projectsId }}';