I don't think that will universally be the case. Low karma might also indicate you don't post much, so you're less likely to be annoyed.