Skip to main content

Create Pseudo Label Job

Create Pseudo Label Job

POST 
/api/2/auto_eval/pseudo_label_job/create

Step 1 of 2: Create a new job configuration for LLM Judge labeling, to be subsequently submitted by calling SubmitPseudoLabelJob.

Request​

Body

    pseudoLabelJobConfig

    object

    required

    Partial configuration containing updates via its non-null fields.

    name string

    Optional name for the job.

    description string

    Optional description for the job.

    datasetId stringrequired

    ID of the main dataset to be pseudo-labeled

    fewShotDatasetId string

    ID of the dataset containing few-shot examples. Optional.

    activeLabeledDatasetId string

    ID of the actively labeled dataset. Optional. If null, this job is for active learning.

    selectedColumns string[]required

    promptTemplate

    object

    required

    id stringrequired
    template stringrequired

    The template string that defines the prompt

    baseEvaluationMetric BaseEvaluationMetric (string)required

    Reserved field. Do not use at the moment.

    Possible values: [BASE_EVALUATION_METRIC_UNSPECIFIED, BASE_EVALUATION_METRIC_FAITHFULNESS, BASE_EVALUATION_METRIC_RELEVANCE, BASE_EVALUATION_METRIC_TOXICITY, BASE_EVALUATION_METRIC_QA, BASE_EVALUATION_METRIC_SUMMARIZATION]

    skipActiveLabeling booleanrequired

    If true, skip active labeling, which involves an intermediate Dataset created for human labeling.

Responses​

Successful operation

Schema

    jobId stringrequired
Loading...