This does not seem a bad decision to me.
As a general rule I never take more than 2 lenses with me, and have found that outdoors the 10-24 and 18-135 are an excellent combination. Both get a lot of use, and throughout their ranges.
Indoors / low light I tend to choose 2 from the 23, 35, 56, and 90. But if I was forced to reduce the number of lenses I could lose the 35 and, if someone held a gun to my head, the 90 (which is a fantastic lens but for me a bit of an indulgence).
So my cut down lens collection that my experience shows I would be very happy with is the 10-24, 18-135, 23 and 56 (although I would cry at night thinking about the 90). Swap the 23 for the x100s and we have arrived at pretty much the same place.