concatenate_divisions

concatenate_divisions(partitioner: Partitioner, partition_division: List[float] | Tuple[float, ...] | Dict[str, float], division_id: int | str) → Dataset

Create a dataset by concatenation of all partitions in the same division.

The divisions are created based on the partition_division and accessed based on the division_id. It can be used to create e.g. centralized dataset from federated on-edge test sets.

Parameters:

• partitioner (Partitioner) – Partitioner object with assigned dataset.

• partition_division (Union[List[float], Tuple[float, ...], Dict[str, float]]) – Fractions specifying the division of the partitions of a partitioner. You can think of this as on-edge division of the data into multiple divisions (e.g. into train and validation). E.g. [0.8, 0.2] or {“partition_train”: 0.8, “partition_test”: 0.2}.

• division_id (Union[int, str]) – The way to access the division (from a List or DatasetDict). If your partition_division is specified as a list, then division_id represents an index to an element in that list. If partition_division is passed as a Dict, then division_id is a key of such dictionary.

Returns:

concatenated_divisions – A dataset created as concatenation of the divisions from all partitions.

Return type:

Dataset