I'm thinking of not doing hormone therapy

Hello, I had a masectomy and reconstruction of my left breast one week ago, originally it was thought that it was all pre cancer, but the pathologist found a very small amount of cancer.  It is the well behaved kind my doctor said. 

The doctor has said it is very unlikely to have spread (the nodes were clear) but I will still need hormone therapy.

I am trying to weigh up in my own mind whether i should go down this path although I know it is strongly recommended by my doctor.

However even they have said it is very unlikley that it would have spread, and I don't need to do chemo. So 5 years of hormones, menopause and other side effects for the very small chance it has escaped into the blood stream.  

I haven't had children and although this is unlikely to happen now as I am 40 and recently divorced, this really puts an end to that hope altogether which was also why it was very sad for me to hear I would need it.

Is there anyone out there who has chosen to not take the hormones in a similar situation of very early cancer?  It might seem strange, but although I don't want to take the hormones, I would consider a precautionary masectomy on my other breast, but I will wait longer to see how well I recover from this one and get a clearer perspective about that. 

Thanks