Get Pseudo Label Job Status

Get Pseudo Label Job Status

POST 
/api/2/auto_eval/pseudo_label_job/get_status

Get the status of an existing job, including any results.

Request

application/json

Body

jobId stringrequired

Responses

200

Successful operation

application/json

Schema

Schema

status JobStatus (string)required

Possible values: [JOB_STATUS_UNSPECIFIED, JOB_STATUS_QUEUED, JOB_STATUS_RUNNING, JOB_STATUS_COMPLETED, JOB_STATUS_CANCELLED, JOB_STATUS_FAILED]

pseudoLabelJobResult

object

required

Configuration for LLM Judge labeling job.

name string

Optional name for the job.

description string

Optional description for the job.

datasetId stringrequired

ID of the main dataset to be pseudo-labeled

fewShotDatasetId string

ID of the dataset containing few-shot examples. Optional.

activeLabeledDatasetId string

ID of the actively labeled dataset. Optional. If null, this job is for active learning.

selectedColumns string[]required

promptTemplate

object

required

id stringrequired

template stringrequired

The template string that defines the prompt

baseEvaluationMetric BaseEvaluationMetric (string)required

Reserved field. Do not use at the moment.

Possible values: [BASE_EVALUATION_METRIC_UNSPECIFIED, BASE_EVALUATION_METRIC_FAITHFULNESS, BASE_EVALUATION_METRIC_RELEVANCE, BASE_EVALUATION_METRIC_TOXICITY, BASE_EVALUATION_METRIC_QA, BASE_EVALUATION_METRIC_SUMMARIZATION]

skipActiveLabeling booleanrequired

If true, skip active labeling, which involves an intermediate Dataset created for human labeling.

Example (from schema)

{
  "status": "JOB_STATUS_UNSPECIFIED",
  "pseudoLabelJobResult": {
    "name": "string",
    "description": "string",
    "datasetId": "string",
    "fewShotDatasetId": "string",
    "activeLabeledDatasetId": "string",
    "selectedColumns": [
      "string"
    ],
    "promptTemplate": {
      "id": "string",
      "template": "string"
    },
    "baseEvaluationMetric": "BASE_EVALUATION_METRIC_UNSPECIFIED",
    "skipActiveLabeling": true
  }
}

Loading...