org.deeplearning4j.nn.layers.convolution.upsampling

Class Upsampling1D

java.lang.Object

org.deeplearning4j.nn.layers.AbstractLayer<Upsampling2D>

org.deeplearning4j.nn.layers.convolution.upsampling.Upsampling2D

org.deeplearning4j.nn.layers.convolution.upsampling.Upsampling1D

All Implemented Interfaces:

Serializable, Cloneable, Layer, Model, Trainable

public class Upsampling1D
extends Upsampling2D

1D Upsampling layer.

Used for upsampling a 1D convolution. Currently derived from 2D version. For forward and backward pass we add a dummy dimension, apply the 2D version and strip the extra dimension again. Eventually, we will want to migrate to a proper 1D version without this overhead.

Author:

Max Pumperla

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.deeplearning4j.nn.api.Layer

Layer.TrainingMode, Layer.Type

Field Summary

Fields inherited from class org.deeplearning4j.nn.layers.AbstractLayer

cacheMode, conf, dataType, dropoutApplied, epochCount, index, input, inputModificationAllowed, iterationCount, maskArray, maskState, preOutput, trainingListeners

Constructor Summary

Constructors

Constructor and Description
Upsampling1D(NeuralNetConfiguration conf, DataType dataType)

Method Summary

Modifier and Type	Method and Description
INDArray	activate(boolean training, LayerWorkspaceMgr workspaceMgr) Perform forward pass and return the activations array with the last set input
Pair<Gradient,INDArray>	backpropGradient(INDArray epsilon, LayerWorkspaceMgr workspaceMgr) Calculate the gradient relative to the error in the next layer
protected CNN2DFormat	getFormat()
protected int[]	getSize()
protected INDArray	preOutput(boolean training, boolean forBackprop, LayerWorkspaceMgr workspaceMgr)

Methods inherited from class org.deeplearning4j.nn.layers.convolution.upsampling.Upsampling2D

clearNoiseWeightParams, fit, fit, getParam, gradient, isPretrainLayer, numParams, params, score, setParams, type, update

Methods inherited from class org.deeplearning4j.nn.layers.AbstractLayer

activate, addListeners, allowInputModification, applyConstraints, applyDropOutIfNecessary, applyMask, assertInputSet, backpropDropOutIfPresent, batchSize, calcRegularizationScore, clear, close, computeGradientAndScore, conf, feedForwardMaskArray, getConfig, getEpochCount, getGradientsViewArray, getHelper, getIndex, getInput, getInputMiniBatchSize, getListeners, getMaskArray, getOptimizer, gradientAndScore, init, input, layerConf, layerId, numParams, paramTable, paramTable, setBackpropGradientsViewArray, setCacheMode, setConf, setEpochCount, setIndex, setInput, setInputMiniBatchSize, setListeners, setListeners, setMaskArray, setParam, setParams, setParamsViewArray, setParamTable, update, updaterDivideByMinibatch

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.deeplearning4j.nn.api.Layer

getIterationCount, setIterationCount

Constructor Detail

Upsampling1D

public Upsampling1D(NeuralNetConfiguration conf,
                    DataType dataType)

Method Detail

getFormat

protected CNN2DFormat getFormat()

Overrides:

getFormat in class Upsampling2D

backpropGradient

public Pair<Gradient,INDArray> backpropGradient(INDArray epsilon,
                                                LayerWorkspaceMgr workspaceMgr)

Description copied from interface: Layer

Calculate the gradient relative to the error in the next layer

Specified by:

backpropGradient in interface Layer

Overrides:

backpropGradient in class Upsampling2D

Parameters:

epsilon - w^(L+1)*delta^(L+1). Or, equiv: dC/da, i.e., (dC/dz)*(dz/da) = dC/da, where C is cost function a=sigma(z) is activation.

workspaceMgr - Workspace manager

Returns:

Pair where Gradient is gradient for this layer, INDArray is epsilon (activation gradient) needed by next layer, but before element-wise multiply by sigmaPrime(z). So for standard feed-forward layer, if this layer is L, then return.getSecond() == dL/dIn = (w^(L)*(delta^(L))^T)^T. Note that the returned array should be placed in the ArrayType.ACTIVATION_GRAD workspace via the workspace manager

getSize

protected int[] getSize()

Overrides:

getSize in class Upsampling2D

activate

public INDArray activate(boolean training,
                         LayerWorkspaceMgr workspaceMgr)

Description copied from interface: Layer

Perform forward pass and return the activations array with the last set input

Specified by:

activate in interface Layer

Overrides:

activate in class Upsampling2D

Parameters:

training - training or test mode

workspaceMgr - Workspace manager

Returns:

the activation (layer output) of the last specified input. Note that the returned array should be placed in the ArrayType.ACTIVATIONS workspace via the workspace manager

preOutput

protected INDArray preOutput(boolean training,
                             boolean forBackprop,
                             LayerWorkspaceMgr workspaceMgr)

Overrides:

preOutput in class Upsampling2D