Evaluate Dataset

POST 
/api/2/auto_eval/evaluation/evaluate_dataset

Evaluate a metric on a dataset, returning scores for each example. Specify metric.id or metric.name to identify the metric.

Request

application/json

Body

metric

object

required

id string

name string

description string

deploymentStatus string
datasetId stringrequired

Responses

200

Successful operation

application/json

Schema

Schema

metric

object

required

id string

name string

description string

deploymentStatus string
scores number[]required

Example (from schema)

{
  "metric": {
    "id": "string",
    "name": "string",
    "description": "string",
    "deploymentStatus": "string"
  },
  "scores": [
    0
  ]
}

Loading...