Creates a representation of a sparse autoencoder.
autoencoder_sparse(network, loss = "mean_squared_error",
high_probability = 0.1, weight = 0.2)Layer construct of class "ruta_network"
Character string specifying a loss function
Expected probability of the high value of the encoding layer. Set this to a value near zero in order to minimize activations in that layer.
The weight of the sparsity regularization
A construct of class "ruta_autoencoder"
Andrew Ng, Sparse Autoencoder. CS294A Lecture Notes
sparsity, make_sparse, is_sparse
Other autoencoder variants: autoencoder_contractive,
autoencoder_denoising,
autoencoder_robust,
autoencoder_variational,
autoencoder