The swish function, defined by. More...

Static Public Member Functions
static double	Deriv (const double y)
	Computes the first derivative of the swish function. More...

template<typename InputVecType , typename OutputVecType >
static void	Deriv (const InputVecType &y, OutputVecType &x)
	Computes the first derivatives of the swish function. More...

static double	Fn (const double x)
	Computes the swish function. More...

template<typename eT >
static void	Fn (const arma::Mat< eT > &x, arma::Mat< eT > &y)
	Computes the swish function using a matrix as input. More...

template<typename InputVecType , typename OutputVecType >
static void	Fn (const InputVecType &x, OutputVecType &y)
	Computes the swish function. More...

Detailed Description

The swish function, defined by.

$\begin{eqnarray*} f(x) &=& x \cdot \sigma(x) \\ f'(x) &=& f(x) + \sigma(x) (1 - f(x)) \\ \sigma(x) &=& frac{1}{1 + e^{-x}} \end{eqnarray*}$

Definition at line 30 of file swish_function.hpp.

Member Function Documentation

static double Deriv ( const double y )

inlinestatic

Computes the first derivative of the swish function.

Parameters

y	Input data.

Definition at line 77 of file swish_function.hpp.

inlinestatic

Computes the first derivatives of the swish function.

Parameters

y	Input data.
x	The resulting derivatives.

Definition at line 90 of file swish_function.hpp.

static double Fn ( const double x )

inlinestatic

Computes the swish function.

Parameters

x	Input data.

Definition at line 39 of file swish_function.hpp.

inlinestatic

Computes the swish function using a matrix as input.

Parameters

x	Input data.
y	The resulting output activation.

Definition at line 51 of file swish_function.hpp.

inlinestatic

Computes the swish function.

Parameters

x	Input data.
y	The resulting output activation.

Definition at line 63 of file swish_function.hpp.

The documentation for this class was generated from the following file: