A Keras implementation of Neural Arithmetic Logic Units
. The logic units was designed to improve a neural network’s competence to handle numerical data.
A Keras implementation Mixture of Softmaxes. MoS layer is a way getting ensemble benefits without having to train $n$-distinct ensemble member. This layer is described in Breaking the Softmax Bottleneck