Perhaps if there were fewer radicals this would be less of a problem. Many thousands of characters could probably be generated from a small number of radicals.
32 radicals are enough for ~75% of characters though. My biggest problem with writing is that I default to writing fairly small so if I have to do a character with more than 12-15 strokes it's either way too big or hard to read later.