I've been worrying about prostate cancer?

It's been happening for about 3.5 years and I've been to several doctors including a urologist countless times. The thing is my urinary symptoms been on and of these years mostly frequent urination and sometimes feel weaker urine flow after sex or too much urination and the frequent urination usually happen after sex. The weaker urine flow usually last about 3-4 days to a week but seems to be longer this time. My last PSA was 2.2 when I was 39 a year ago. My MD told me that base on the symptoms I've been having, he thinks they do not represent prostate cancer and do not refer me to a urologist. I've been suffering a lot and trying to convince myself they are just prostatitis or enlarged prostate. When the symptoms went away, I was happy and believed that was just prostatitis, but when the symptoms come back, I can't stop thinking about cancer. Please help me if you had any experience with these symptoms. Thank you.