Dataloader API

Dataloader Creation

class flexflow.core.flexflow_cffi.FFModel

create_data_loader(batch_tensor, full_array)

Create a SingleDataloader instance.

Parameters

batch_tensor (Tensor) – a batch-sized tensor. Usually it is a input tensor of the model.
full_array (Numpy Array) – the entire data.

Returns

SingleDataloader – returns a dataloader instance.

class flexflow.core.flexflow_cffi.SingleDataLoader

next_batch(ffmodel)

Ask the dataloder to load the next batch to the batch_tensor.

reset()

Reset the current position of the dataloder to 0.