Evaluate

POST 
/api/2/auto_eval/evaluation/evaluate

Compute an evaluation metric (or set of metrics) by running inference against evaluator models.

Request

application/json

Body

metric

object

required

id stringrequired

name stringrequired

description stringrequired
input string[]required
output string[]required
groundTruth string[]required

Responses

200

Successful operation

application/json

Schema

Schema

metric

object

required

id stringrequired

name stringrequired

description stringrequired
scores number[]required

Example (from schema)

{
  "metric": {
    "id": "string",
    "name": "string",
    "description": "string"
  },
  "scores": [
    0
  ]
}

Loading...