flair.data.ConcatFlairDataset#

class flair.data.ConcatFlairDataset(datasets, ids)View on GitHub#

Bases: Dataset

Concatenates multiple datasets, adding a multitask_id label to each sentence.

Parameters:
  • datasets (Iterable[Dataset]) – List of datasets to concatenate.

  • ids (Iterable[str]) – List of task IDs corresponding to each dataset.

__init__(datasets, ids)View on GitHub#

Methods

__init__(datasets, ids)

cumsum(sequence)

Attributes

cummulative_sizes

datasets

cumulative_sizes

static cumsum(sequence)View on GitHub#
datasets: list[Dataset]#
cumulative_sizes: list[int]#
property cummulative_sizes: list[int]#