Think of it as using the ChromeOS kernel (which suits the hardware configuration perfectly) and then running the Ubuntu userspace (which co-exists with the Chrome OS userspace).

Even if you don't use the Chrome OS userspace much, removing it won't save you enough to make it worth it.