If you have fear, you have no need to think of punishment. Fear itself is punishment enough. Similarly with hope.
Intense hope leads easily to fear that the hope may not be realised. To feel that one possesses something may at any moment lead to fear of deprivation. Feeling that one possesses nothing is a producer of fear. If you fear, or desire, beyond a certain point, you have lost your way, perhaps completely.
Knowing How to Know