2 vectors are orthonormal if they are orthogonal Unit Vector

So they should be perpendicual to one another and the magnitude of each of them is 1.

References

• Deep Learning by Ian Goodfellow