Relu

New to Analytica 6.3

Relu(x)

Returns x when x≥0, zero otherwise. Same as either of these:

• Max( [0, x] )
• If x>=0 Then x Else 0

The evaluation of Relu is slightly (but insignificantly) faster than either of these.

This exists as a convenience function since the Relu function has become so commonplace in several fields. The obscure name derives from "Rectified Linear Unit", as was first introduced in connectionist subfield of machine learning where it is commonly used as an activation function.

See Also

• Max
• If-Then-Else