Convolutional Deep Belief Networks
In computer science, Convolutional Deep Belief Network (CDBN) is a type of deep artificial neural network that is composed of multiple layers of convolutional restricted Boltzmann machines stacked together.[1] Alternatively, it is a hierarchical generative model for deep learning, which is highly effective in the tasks of image processing and object recognition, though it has been used in other domains too.[2] The salient features of the model include the fact that it scales well to high-dimensional images and is translation-invariant.[3]
CDBNs use the technique of probabilistic max-pooling to reduce the dimensions in higher layers in the network. Training of the network involves a pre-training stage accomplished in a greedy layer-wise manner, similar to other deep belief networks. Depending on whether the network is to be used for discrimination or generative tasks, it is then "fine tuned" or trained with either back-propagation or the up-down algorithm (contrastive-divergence), respectively.
References
- ↑ Lee, Honglak; Grosse, Ranganath; Andrew Ng. Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical Representations. http://people.csail.mit.edu/rgrosse/icml09-cdbn.pdf.
- ↑ Lee, Honglak; Yan Largman. "Unsupervised feature learning for audio classification using convolutional deep belief networks". https://ai.stanford.edu/~ang/papers/nips09-AudioConvolutionalDBN.pdf.
- ↑ Coviello, Emanuele. "Convolutional Deep Belief Networks". http://cseweb.ucsd.edu/~dasgupta/254-deep/emanuele.pdf.
 |
