I have a Pen-F and an X100T. While I really enjoy the X100T, I don't think I would sell the Pen. I do own a couple of other Olympus cameras and several lenses. The Pen is a unique camera in my opinion; the colour/monochrome knob on the front sets it apart and it is also such a 'nice' camera to use.
I think both it and the X100 series are special cameras and worth keeping in my opinion.