1. Originally he analyzed Biblical texts, seeking to uncover hidden layers of meaning. 2. Neurode of hidden layer provides input to neurode of the output layer. 3. Neurogammon contains seven separate neural networks, each with a single hidden layer . 4. The input layer neurode connect to each neurode in the hidden layer . 5. Some other recent work has used artificial neural networks with a hidden layer . 6. The levels are the input layer, hidden layer and output layer. 7. The hidden layer is a Kohonen network which categorizes the pattern that was input. 8. The context units are however fed from the output layer instead of the hidden layer . 9. Essentially, the pre-training acted to create internal orthogonalization of the activations at the hidden layer , which reduced interference. 10. The basic idea of BRNNs is to connect two hidden layers of opposite directions to the same output.
