I had mine removed under local anaesthetic. They still need to do it in a theatre, so there seems to be a cast of thousands involved and some very bright lights that most people lying on their backs in those environments don't get to see.
Over the years I've resisted a general where ever possible. I use a deep breathing meditation technique to cope with the stress of invasive minor procedures and tell the staff they are not to interrupt that unless my life is in danger. No patting of hands, no encouragement that I'm doing really well and, please, keep the chatter between yourselves to a minimum. They think I'm a bitch. I don't care.
I can't say I enjoyed having my port removed, except that I was chuffed it was gone. There is a fair bit of stabbing involved to numb the area and mine had, typically for me, been thoroughly assaulted and encapsulated by my outraged body so the poor surgeon had to excavate a deeper than expected which became a bit uncomfortable. Still worth it IMO.
If you are generally stoical you should be fine. Mxx