org.deeplearning4j.nn.weights.embeddings

Class WeightInitEmbedding

java.lang.Object

org.deeplearning4j.nn.weights.embeddings.WeightInitEmbedding

All Implemented Interfaces:

Serializable, IWeightInit

public class WeightInitEmbedding
extends Object
implements IWeightInit

Weight initialization for initializing the parameters of an EmbeddingLayer from a EmbeddingInitializer Note: WeightInitEmbedding supports both JSON serializable and non JSON serializable initializations. In the case of non-JSON serializable embeddings, they are a one-time only use: once they have been used to initialize the parameters, they will be removed from the WeightInitEmbedding instance. This is to prevent unnecessary references to potentially large objects in memory (i.e., to avoid memory leaks)

Author:

Alex Black

See Also:

Serialized Form

Field Summary

Fields inherited from interface org.deeplearning4j.nn.weights.IWeightInit

DEFAULT_WEIGHT_INIT_ORDER

Constructor Summary

Constructors

Modifier	Constructor and Description
	WeightInitEmbedding(@NonNull EmbeddingInitializer embeddingInitializer)
protected	WeightInitEmbedding(EmbeddingInitializer serializableInit, EmbeddingInitializer nonSerializableInit)

Method Summary

Modifier and Type	Method and Description
INDArray	init(double fanIn, double fanOut, long[] shape, char order, INDArray paramView) Initialize parameters in the given view.
long[]	shape()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WeightInitEmbedding

public WeightInitEmbedding(@NonNull
                           @NonNull EmbeddingInitializer embeddingInitializer)

WeightInitEmbedding

protected WeightInitEmbedding(EmbeddingInitializer serializableInit,
                              EmbeddingInitializer nonSerializableInit)

Method Detail

init

public INDArray init(double fanIn,
                     double fanOut,
                     long[] shape,
                     char order,
                     INDArray paramView)

Description copied from interface: IWeightInit

Initialize parameters in the given view. Double values are used for fanIn and fanOut as some layers (convolution with stride) results in a non-integer number which may be truncated to zero in certain configurations

Specified by:

init in interface IWeightInit

Parameters:

fanIn - Number of input parameters

fanOut - Number of output parameters

shape - Desired shape of array (users shall assume paramView has this shape after method has finished)

order - Order of array, e.g. Fortran ('f') or C ('c')

paramView - View of parameters to initialize (and reshape)

shape

public long[] shape()