initializer_glorot_normal
Glorot normal initializer, also called Xavier normal initializer.
Description
It draws samples from a truncated normal distribution centered on 0 with stddev = sqrt(2 / (fan_in + fan_out))
where fan_in
is the number of input units in the weight tensor and fan_out
is the number of output units in the weight tensor.
Usage
initializer_glorot_normal(seed = NULL)
Arguments
Arguments | Description |
---|---|
seed | Integer used to seed the random generator. |
Section
References
Glorot & Bengio, AISTATS 2010 https://proceedings.mlr.press/v9/glorot10a/glorot10a.pdf
See Also
Other initializers: initializer_constant()
, initializer_glorot_uniform()
, initializer_he_normal()
, initializer_he_uniform()
, initializer_identity()
, initializer_lecun_normal()
, initializer_lecun_uniform()
, initializer_ones()
, initializer_orthogonal()
, initializer_random_normal()
, initializer_random_uniform()
, initializer_truncated_normal()
, initializer_variance_scaling()
, initializer_zeros()