Personally, IMHO, I would have to say you are being way too cautious. I carry my Glock 22 fully loaded, cocked, locked and ready to rock, condition 1. The Glock has three safeties, plus your safety (trigger finger). It is one of the safest pistols on the planet. And to my knowledge, no Glock has ever fired without someone or something pulling the trigger. Personally, you are limiting your ability to protect yourself by requiring yourself to take extra crucial seconds to rack the slide and load your weapon when you should already be shooting. You can't tell the criminal to hang on a minute any more than you can tell the police to get there faster. A gun without a round in the chamber is as good as a rock.
That said, this is America and you may do whatever you please. If it makes you feel safer, if it gives you peace of mind, I would rather you carry like that then not carry at all.
Best of luck to you! Its a crazy world out there!