I have them both. I originally had the 35mm 1.4 but when the 2.0 came out it was a perfect fit for shooting in inclement weather. It is sharp, small, fast and quiet and it rarely leaves my camera for now. Before that the 23mm 1.4 stayed on the camera almost all the time and it really is a great all around focal length for most subjects. I have been thinking of getting rid of the 23mm but won't do it because it is so good.
So I am keeping them both along with the 56mm 1.2 and the 14mm 2.8 and there really is room for all of them. When I am out and about and the weather turns foul then the 35mm will be the lens of choice. As you can see it is a struggle but other posters are right, the 23mm really is an exceptional lens. By the way, today it was announced that a new and smaller lens hood is about to come ou tfor the 23. I have asked B&H to notify me when it dan be purchased.