Skip to content
Repo

DatasetConfig

from modal_dojo import DatasetConfig

Dataset fields and materialization behavior shared across training frameworks.

apply_chat_template() -> bool

Whether to apply the model’s chat template to the input.

cache_key() -> str | None
input_key() -> str

Prompt column name.

label_key() -> str | None

Ground-truth column name, or None when rows carry no label.

output_format() -> str

The on-disk format written by write(), either parquet or jsonl.

rows() -> Iterable[DatasetRow]

Load raw examples.

Returns

An iterable collection of raw examples.

validate_written(path: str) -> None

Validate the materialized file format and required columns.

write(path: str) -> None

Materialize training data at path.