Used in debugging our Neural Network in the back propagation step.

Read this -

How to Debug a Neural Network With Gradient Checking