Ditching the 5-year sentence of hormonal therapy?

Exactly why I have given myself a 2 week half dose break from Tamoxifen. My quality of life was crap. So much so that I was thinking I may have been better off just letting the cancer take its own course. I asked my GP could I see the psychologist at the Cancer Care building but he said, 'Oh no, that's only for cancer patients actually having chemo, not for hormonal therapy patients.'