It really depends on what kind of photographer you are. I had both, 23 + 14, and 10-24, loved all of them. But 10-24 was just too big for me, almost negated mirrorlessness of X mount and I felt like I was back on an DSLR, which, I felt, was an issue for me as I am a street and people photographer, and large lenses, especially wide angle ones that requires getting closer to subjects, simply wasn't right. So I ended up selling it and am happily with 23 + 14.
That said, I recommend that you keep both for a while and see which one works for you.