There's absolutely no scientific basis for that, besides that I don't think he used LSD much if at all past the hippie period. Certainly not regularly (and there are people who have used LSD weekly for years with no apparent damage)
There are also many people who've used LSD a lot and end up with mental issues caused by the drugs. But not as far as I know, not strokes or anything like that.