Yes, this is perfectly normal. Your radio power supply can get very warm to the touch when used, but this is a perfectly normal operation. It will reach a certain operating temperature and stay there.

It is perfectly safe to leave on all the time.