Gradient clipping is used to solve Exploding Gradient issue, where the gradient is clipped to some small values when it crosses a specific threshold value.

References