My brother says that he is going to "literally throw caution to the wind"?

I've been trying to explain to him that you can't literally throw caution to the wind. Caution is not a tangible object. Can someone explain it better so that he can understand? Please, he is driving me nuts.