This is extremely context sensitive. Antitrust regulation doesn't require a "compliance" department unless you're already huge and doing things that might be considered anti-competitive. Likewise financial regulations like Glass-Steagal[1] prevent certain types of organizations (in this case hybrid commercial-investment banks) from existing - I don't see how this could result in compliance costs.

[1] https://en.wikipedia.org/wiki/Glass–Steagall_legislation