Skip to main content

Create Pseudo Label Job

Create Pseudo Label Job

POST 
/api/2/auto_eval/pseudo_label_job/create

Step 1 of 2: Create a new job configuration for LLM Judge labeling, to be subsequently submitted by calling SubmitPseudoLabelJob.

Request​

Body

    pseudoLabelJobConfig

    object

    required

    Partial configuration containing updates via its non-null fields.

    name string

    Optional name for the job.

    description string

    Optional description for the job.

    datasetId stringrequired

    ID of the main dataset to be pseudo-labeled

    fewShotDatasetId string

    ID of the dataset containing few-shot examples. Optional.

    activeLabeledDatasetId string

    ID of the actively labeled dataset. Optional. If null, this job is for active learning.

    selectedColumns string[]required

    promptTemplate

    object

    required

    id stringrequired
    template stringrequired

    The template string that defines the prompt

    baseEvaluationMetric stringrequired

    Reserved field. Do not use at the moment.

    skipActiveLabeling booleanrequired

    If true, skip active labeling, which involves an intermediate Dataset created for human labeling.

Responses​

Successful operation

Schema

    jobId stringrequired
Loading...