Layers API

Layers are the basic building blocks of neural networks in FlexFlow. The inputs of a layer consists of a tensor or a list of tensors and some state variables, and the outputs of a layer is a tensor or a list of tensors.

Conv2D

Pool2D

Dense

Embedding

Transpose

Reverse

Concatenate

Split

Reshape

Flat

BatchNorm

BatchMatMul

Add

Subtract

Multiply

Divide

Exponential

ReLU

ELU

Sigmoid

Tanh

Softmax

Dropout

MultiheadAttention