Besides its E2E, Signal has all the downsides of iMessage; it still relies on phone numbers as identity, is a centralized walled garden hostile to third-party clients and the desktop client is an Electron pile of shit.
Your list of complaints is valid, but iMessage has another major downside: it only runs on Apple hardware. Using Signal means almost everyone can participate in a group chat if they so choose.