Skip to main content

Submit Pseudo Label Job

Submit Pseudo Label Job

POST 
/api/2/auto_eval/pseudo_label_job/submit

Step 2 of 2: Submit the job configuration created by CreatePseudoLabelJob to initiate an LLM Judge labeling job.

Request​

Body

    jobId stringrequired

    pseudoLabelJobConfig

    object

    required

    The pseudo-labeling job configuration.

    name string

    Optional name for the job.

    description string

    Optional description for the job.

    datasetId stringrequired

    ID of the main dataset to be pseudo-labeled

    fewShotDatasetId string

    ID of the dataset containing few-shot examples. Optional.

    activeLabeledDatasetId string

    ID of the actively labeled dataset. Optional. If null, this job is for active learning.

    selectedColumns string[]required

    promptTemplate

    object

    required

    id stringrequired
    template stringrequired

    The template string that defines the prompt

    baseEvaluationMetric BaseEvaluationMetric (string)required

    Reserved field. Do not use at the moment.

    Possible values: [BASE_EVALUATION_METRIC_UNSPECIFIED, BASE_EVALUATION_METRIC_FAITHFULNESS, BASE_EVALUATION_METRIC_RELEVANCE, BASE_EVALUATION_METRIC_TOXICITY, BASE_EVALUATION_METRIC_QA, BASE_EVALUATION_METRIC_SUMMARIZATION]

    skipActiveLabeling booleanrequired

    If true, skip active labeling, which involves an intermediate Dataset created for human labeling.

Responses​

Successful operation

Schema

    jobId stringrequired
Loading...