Just solved my problem. The slowness came from using iCloud Drive. It removes my notes / unsyncs my notes when I don't use it regularly. I have to set the Obsidian folder to "Keep Downloaded" and then everything is fine!