I'm going to jump the gun and give you my story for comparison's sake.
Full time TRT patient here. Diagnosed with Secondary Hypogonadism. Fancy way of saying my pituitary is broken but nobody knows why. Did hCG therapy for 6 months, worked but after cessation my natural test production near picked up. Been on TRT since then, doctor prescribed Nebido but he's cool that I self administer Cypionate.
Things to consider about my case:
1) I was lean before, and when I was diagnosed with low T.
2) Diet before TRT was nutritious, frequently used multivitamins although suffered no deficiencies.
3) No chronic medication or substance abuse (sometimes used a proton pump inhibitor because of gastric issues).
4) Gave up alcohol about two years before diagnosed with low T. Never a big drinker before that. No family history of alcohol abuse or liver problems.
5) All other bloods and tests showed healthy (if not superb) levels. This includes everything from hormones, cholesterol, prostate, spinal biopsy, thyroid etc.
6) Cardiovascular fitness was good.
7) Blood pressure and heart rate was very good.
8 ) I had a rough and stressful job, doctors (and personal) belief that I had "adrenal burnout" (probably not a medical term lol).
9) My GP at the time was an idiot. Endocrinologist was exceptional, but couldn't find any cause. Finally, my urologist understood my situation easily but could also not pinpoint cause.
10) Did one Test Prop and Var cycle a bit more than one year before diagnosed with low T. Followed PCT meticulously.
11) Got low Test in (and still am) in my twenties.
Moral of the story:
You are not alone.
Some things are unpredictable and unexplained (to us at the present at least).
Karma doesn't exist, don't blame yourself. Perhaps you didn't get it from AAS usage. Perhaps you've never hurt a fly in your life, perhaps you donate to charities, have goods morals and respect your body. It means nothing, sometimes the human body is a lottery. Infant children get leukemia and some are born into a caste system they never can escape.
Advice:
You mentioned "doctor", no mention of a specialist (endocrinologist or urologist). If you did see one of those my apologies, perhaps they did know what they were talking about; otherwise go see someone who has a clue. Give HCG therapy a go for a while, if your test elevates you know your pituitary can produce the right hormones with the right triggers being sent to it. If not, that's (likely) where the problem is. If you spend some time on HCG and come off, and test levels remain normal, I guess your "cured". If not, you've got the same issue as I do. (Disclaimer: Your specialist will obviously explain what I talked about briefly. If s/he thinks there is a better route, fuck it, there might be, I'm not claiming to hold all the answers or know what's going on in everyone's bodies.)
Hope my soliloquy helped a bit mate. Best of luck and keep us updated.
Officially sponsored by Protein™ and Caffeine™.