I use a physical sim. I’m not sure it even supports eSIM, but I’d be hesitant to ditch the physical sim for precisely the reasons you mentioned. I’ve swapped sims around between phones and even borrowed them from people when I was in a new area, something that’s much harder with eSIMs.
I think out of all the things I’ve heard about Elon Musk, this might be the thing that disgusts me the most.