Embeddings

Learn vector representations from text pairs. This task is self-supervised (contrastive): there is no label column — the pairing is the supervision. Each sample is one .txt file with one tab-separated record:

a pair anchor<TAB>positive — two texts that should embed close together, or
a triplet anchor<TAB>positive<TAB>negative — with a hard negative that should embed far from the anchor.

Pairs and triplets may be mixed in one dataset.

Folder layout

/data/shared/stsb-embeddings/
├── labels.csv
└── texts/
    ├── emb_0000001.txt      # anchor<TAB>positive
    ├── emb_0000004.txt      # anchor<TAB>positive<TAB>negative
    └── ...

Example pair:

How do I reset my password?	What are the steps to recover my account login?

The folder is named texts and sits next to the manifest CSV.
Exactly one tab between fields, all fields non-empty, one record per file on a single line. Unlike the other self-supervised text tasks, this structure is enforced: the CLI checks it before it ingests anything, and the ingestor checks it again.
UTF-8 encoded. Every file must end in .txt. The ingestor also accepts .text, but training opens only <filename>.txt, so a .text dataset ingests and then fails to train.

Manifest CSV

filename
emb_0000001
emb_0000002
emb_0000003

Column	Required	Meaning
`filename`	yes, exactly this name	The text file, with or without extension.
`extension`	no	Present in the shipped sample (`'.txt'`); not read by the ingestor.

There is no label column. Setting label: in ingest.yaml is rejected.

Ingest with the CLI

Each split is one folder laid out as above. Ingest the training and the test split separately:

tracebloc data ingest ./stsb-embeddings-train --task embeddings --name stsb_embeddings_train --intent train
tracebloc data ingest ./stsb-embeddings-test  --task embeddings --name stsb_embeddings_test  --intent test

Do not pass --label-column: the CLI rejects it for this task because it trains on the text itself.

ingest.yaml

apiVersion: tracebloc.io/v1
kind: IngestConfig
category: embeddings
table: stsb_embeddings_train
intent: train
csv: /data/shared/stsb-embeddings/labels.csv
texts: /data/shared/stsb-embeddings/texts/

Field	Required	Meaning
`csv`	yes	Path to the manifest CSV.
`texts`	yes	The `texts/` folder.
`label`	must not be set	No label column.
`positive_definition`	no	Free text describing what makes a pair positive (for example `paraphrase`), recorded for consistency checks when datasets are combined.
`schema`	no	Extra typed columns only. Never a reserved column name such as `filename` or `extension`.
`spec.file_options.extension`	no	Leave it unset. The default `.txt` is the only extension training reads.
`language`, `normalization`	no	Dataset language and applied normalization.

What the ingestor checks

Check	Rejects
File type	Files under `texts/` with a different extension than configured, or mixed extensions.
Text content	NUL bytes or invalid UTF-8; empty files produce a warning.
Contrastive pairs	A referenced file that is missing, spans several lines, has a field count other than 2 or 3, or has an empty field.
Data types	With a `schema`: values that do not match their declared type.

Plus the checks every ingest runs, except label diversity (no label).

Sample dataset

The template ships three pairs and two triplets with a five-row manifest. The manifest ships as labels_file_sample.csv: rename it to labels.csv before you ingest the folder, because the CLI reads only that name. For the Helm chart, stage the renamed folder so that it matches the paths in the ingest.yaml above.

Score formulas

When you define a use case on this data, the platform currently accepts Perplexity only. An embeddings run does not report perplexity, so the leaderboard of an embeddings use case cannot rank submissions yet.

Next steps

Ingest the data: Prepare Data
Shared rules for every template: Dataset templates

Overview

Create a Use Case

Join a Use Case

Environment Setup

Tools & Help

Releases

Folder layout

Manifest CSV

Ingest with the CLI

ingest.yaml

What the ingestor checks

Sample dataset

Score formulas

Next steps

​Folder layout

​Manifest CSV

​Ingest with the CLI

​ingest.yaml

​What the ingestor checks

​Sample dataset

​Score formulas

​Next steps

Folder layout

Manifest CSV

Ingest with the CLI

ingest.yaml

What the ingestor checks

Sample dataset

Score formulas

Next steps