gluonts.mx.activation module#

class gluonts.mx.activation.LipSwish(beta_initializer: ~mxnet.initializer.Initializer = <mxnet.initializer.Constant object>, **kwargs)[source]#

Bases: HybridBlock

Implemented LipSwish activation, i.e. LipSwish(z) := Swish(z)/ 1.1 with a learnable parameter beta.

hybrid_forward(F, x: Union[NDArray, Symbol], beta: Union[NDArray, Symbol]) → Union[NDArray, Symbol][source]#
Parameters

  • F – A module that can either refer to the Symbol API or the NDArray API in MXNet.

  • x – Input tensor

  • beta – beta parameter of activation

Returns

output of forward

Return type

Tensor

gluonts.mx.activation.deriv_elu(F, x: Union[NDArray, Symbol], alpha: float = 1.0) → Union[NDArray, Symbol][source]#

Derivative function of Elu activation computed at point x.

Parameters

  • F – A module that can either refer to the Symbol API or the NDArray API in MXNet.

  • x – Input tensor

  • alpha – alpha parameter of Elu

Returns

Derivative tensor

Return type

Tensor

gluonts.mx.activation.deriv_lipswish(F, x: Union[NDArray, Symbol], beta: Union[NDArray, Symbol]) → Union[NDArray, Symbol][source]#

Derivative function of LipSwish activation computed at point x. :param F: A module that can either refer to the Symbol API or the NDArray API in

MXNet.

Parameters

  • x – Input tensor

  • beta – beta parameter in LipSwish activation

Returns

Derivative tensor

Return type

Tensor

gluonts.mx.activation.deriv_softrelu(F, x: Union[NDArray, Symbol]) → Union[NDArray, Symbol][source]#

Derivative function of SoftRelu activation computed at point x.

Parameters

  • F – A module that can either refer to the Symbol API or the NDArray API in MXNet.

  • x – Input tensor

Returns

Derivative tensor

Return type

Tensor

gluonts.mx.activation.deriv_swish(F, x: Union[NDArray, Symbol], beta: Union[NDArray, Symbol]) → Union[NDArray, Symbol][source]#

Derivative function of Swish activation computed at point x.

Parameters

  • F – A module that can either refer to the Symbol API or the NDArray API in MXNet.

  • x – Input tensor

  • beta – beta parameter of LipSwish

Returns

Derivative tensor

Return type

Tensor

gluonts.mx.activation.deriv_tanh(F, x: Union[NDArray, Symbol]) → Union[NDArray, Symbol][source]#

Derivative function of Tanh activation computed at point x.

Parameters

  • F – A module that can either refer to the Symbol API or the NDArray API in MXNet.

  • x – Input tensor

Returns

Derivative tensor

Return type

Tensor

gluonts.mx.activation.get_activation(activation: str, **kwargs) → HybridBlock[source]#
Parameters

activation – Activation type

Returns

Activation object

Return type

mxnet.gluon.HybridBlock

gluonts.mx.activation.get_activation_deriv(act: HybridBlock) → Callable[source]#
Parameters

act – Activation object

Returns

Derivative function of associated activation

Return type

Callable