Rectified linear unit (ReLU)

ReLU, or Rectified Linear Unit, is a type of activation function commonly used in neural networks, especially in deep learning models. It outputs the input directly if it is positive; otherwise, it outputs zero. This function helps to introduce non-linearity in the model, making it capable of learning more complex patterns.