Finalize Single Dataset File Upload
Finalize Single Dataset File Upload
POST/api/2/auto_eval/dataset/finalize_single_file_upload
Finalize a Dataset file upload. This call should be made after the file has been uploaded to the S3 URL returned from UploadDatasetFile.
Request
- application/json
Body
The ID of the dataset corresponding to the file
s3PresignedPost
object
required
The pre-signed S3 URL where the file was uploadeded
fields
object
required
Fields required for the S3 presigned POST request generated by s3 sdk.
Responses
- 200
Successful operation
- application/json
- Schema
- Example (from schema)
Schema
Array [
]
datasetFile
object
Information about the dataset file if the upload was successful
The ID of the dataset file.
The ID of the corresponding dataset.
columns
object[]
required
The ID of the dataset file.
Index of the column within the dataset file.
The literal name for the column.
Datatypes for a column in a dataset file. We likely don't need everything here, but it's good to be explicit, for example to avoid unknowingly coercing int64 values into int32. Encoding for text is UTF_8 unless indicated otherwise.
Possible values: [DATASET_COLUMN_D_TYPE_UNSPECIFIED
, DATASET_COLUMN_D_TYPE_INT32
, DATASET_COLUMN_D_TYPE_INT64
, DATASET_COLUMN_D_TYPE_FLOAT32
, DATASET_COLUMN_D_TYPE_FLOAT64
, DATASET_COLUMN_D_TYPE_STRING
, DATASET_COLUMN_D_TYPE_BYTES
, DATASET_COLUMN_D_TYPE_ANY
]
{
"datasetFile": {
"id": "string",
"createdAt": "2024-07-29T15:51:28.071Z",
"updatedAt": "2024-07-29T15:51:28.071Z",
"datasetId": "string",
"contentMd5Hash": "string",
"fileSizeBytes": 0,
"numRows": 0,
"numCols": 0,
"columns": [
{
"id": "string",
"createdAt": "2024-07-29T15:51:28.071Z",
"updatedAt": "2024-07-29T15:51:28.071Z",
"index": 0,
"literalName": "string",
"dtype": "DATASET_COLUMN_D_TYPE_UNSPECIFIED"
}
]
}
}