I bought a house and run all my bills from my own mail server, so that certainly hasn't been my experience. You just need to configure it correctly and make sure your IP doesn't have a bad rep.