Getting ready

Our response to a given input stimulus is governed by the activation function of our neurons. Sometimes our response is a binary yes or no; for example, when presented with a joke, we either laugh or do not laugh. At other times, the response seems linear, for example, crying due to pain. At times, the response seems to be bounded within a range.

Mimicking similar behavior, many different activation functions are used by artificial neurons. In this recipe, you will learn how to define and use some of the common activation functions in TensorFlow.