Component | FFMod | Parameter | Value |
---|---|---|---|
Convolutional layers | 0,1,2 | Kernel size (1-Dimensional) | 5,5,5 |
Number of Kernels | 8,8,8 | ||
Strides | 1,1,1 | ||
Activation function | ReLU | ||
Pooling layers | 0,1,2 | Size (1-Dimensional) | 3,3,3 |
Strides | 1,1,1 | ||
Self-attention | 0,1,2 | Heads | 4 |
Attention-dimension | 16 | ||
Fully connected layer | 0,1,2 | Neurons | 1024 |
Neurons | 256 | ||
Neurons | 1 | ||
Activation function | ReLU,ReLU,Sigmoid | ||
DropOut rate | 0.5 |