I too went the other way around.
I took family pictures on iphone for a few years. Pics quality was quite disappointing. And the choice of lens ? None.
It all depends on the kind of pics one wants to photograph. For street photography, the phone could be an advantage as the photographer could go unnoticed. But for portraits, studio work, wedding, landscape ... i'd stick with something like the X-T3, X-T4, Xpro3. For portraits, I am looking forward to seeing what the XF 50-140mm f/2.8 can give. I read and heard a lot of good things about it.
No matter what, keep shooting.