Welcome to My Triton Blog

Learning Triton

Activation Functions

Before we move to activation functions we will be going through the constant add kernel where we will be adding the number with constant

• Constant add

• Vector add

• ReLU

• Leaky ReLU

• GELU

• Tanh

• MatMul

• Sigmoid