learNN (version 0.2.0)

learn_do: Learn Dropout

Description

Learn Dropout

Usage

learn_do(X, y, alpha, hidden_dim, dropout_percent, do_dropout = TRUE)

Arguments

X
input data
y
output data
alpha
proportion of gradient descent
hidden_dim
dimension of the hidden layer
dropout_percent
percentage to be used for the dropout
do_dropout
should dropout be used

References

http://qua.st/handcoding-dropout/ http://iamtrask.github.io/2015/07/28/dropout/

Examples

Run this code
# construct data
X = matrix(c(0,0,1,0,1,1,1,0,1,1,1,1), nrow=4, byrow=TRUE)
y = matrix(c(0,1,1,0),nrow=4)

# set hyperparameters
alpha = 0.5
hidden_dim = 4
dropout_percent = 0.2
do_dropout = TRUE

# run 11 lines function
learn_do(X, y, alpha, hidden_dim, dropout_percent, TRUE)

# view output
synapse_0
synapse_1

Run the code above in your browser using DataCamp Workspace