Class AlphaDropout
- java.lang.Object
-
- org.deeplearning4j.nn.conf.dropout.AlphaDropout
-
- All Implemented Interfaces:
Serializable
,Cloneable
,IDropout
public class AlphaDropout extends Object implements IDropout
- See Also:
- Serialized Form
-
-
Field Summary
Fields Modifier and Type Field Description static double
DEFAULT_ALPHA
static double
DEFAULT_LAMBDA
-
Constructor Summary
Constructors Modifier Constructor Description AlphaDropout(double activationRetainProbability)
protected
AlphaDropout(double activationRetainProbability, ISchedule activationRetainProbabilitySchedule, double alpha, double lambda)
AlphaDropout(@NonNull ISchedule activationRetainProbabilitySchedule)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description double
a(double p)
INDArray
applyDropout(INDArray inputActivations, INDArray output, int iteration, int epoch, LayerWorkspaceMgr workspaceMgr)
double
b(double p)
INDArray
backprop(INDArray gradAtOutput, INDArray gradAtInput, int iteration, int epoch)
Perform backprop.void
clear()
Clear the internal state (for example, dropout mask) if any is presentAlphaDropout
clone()
-
-
-
Field Detail
-
DEFAULT_ALPHA
public static final double DEFAULT_ALPHA
- See Also:
- Constant Field Values
-
DEFAULT_LAMBDA
public static final double DEFAULT_LAMBDA
- See Also:
- Constant Field Values
-
-
Constructor Detail
-
AlphaDropout
public AlphaDropout(double activationRetainProbability)
- Parameters:
activationRetainProbability
- Probability of retaining an activation. SeeAlphaDropout
javadoc
-
AlphaDropout
public AlphaDropout(@NonNull @NonNull ISchedule activationRetainProbabilitySchedule)
- Parameters:
activationRetainProbabilitySchedule
- Schedule for the probability of retaining an activation. SeeAlphaDropout
javadoc
-
AlphaDropout
protected AlphaDropout(double activationRetainProbability, ISchedule activationRetainProbabilitySchedule, double alpha, double lambda)
-
-
Method Detail
-
applyDropout
public INDArray applyDropout(INDArray inputActivations, INDArray output, int iteration, int epoch, LayerWorkspaceMgr workspaceMgr)
- Specified by:
applyDropout
in interfaceIDropout
- Parameters:
inputActivations
- Input activations arrayoutput
- The result array (same as inputArray for in-place ops) for the post-dropout activationsiteration
- Current iteration numberepoch
- Current epoch numberworkspaceMgr
- Workspace manager, if any storage is required (use ArrayType.INPUT)- Returns:
- The output (resultArray) after applying dropout
-
backprop
public INDArray backprop(INDArray gradAtOutput, INDArray gradAtInput, int iteration, int epoch)
Description copied from interface:IDropout
Perform backprop. This should also clear the internal state (dropout mask) if any is present- Specified by:
backprop
in interfaceIDropout
- Parameters:
gradAtOutput
- Gradients at the output of the dropout op - i.e., dL/dOutgradAtInput
- Gradients at the input of the dropout op - i.e., dL/dIn. Use the same array as gradAtOutput to apply the backprop gradient in-placeiteration
- Current iterationepoch
- Current epoch- Returns:
- Same array as gradAtInput - i.e., gradient after backpropagating through dropout op - i.e., dL/dIn
-
clear
public void clear()
Description copied from interface:IDropout
Clear the internal state (for example, dropout mask) if any is present
-
clone
public AlphaDropout clone()
-
a
public double a(double p)
-
b
public double b(double p)
-
-