If you drop one or bang it hard you'll usually get some ink in the cap yeah. Finer or more recessed nibs reduce the effect. Pilot also has a line of retractable fountain pens that almost completely eliminate it.

The pressure changes when flying can force ink out the nib as well. I've heard people say you can prevent it by having the reservoir completely full but I fly with it empty or usually just leave it at home.