No changes here. They are still heavily promoting this e-residency thing, but opening a bank account for your newly established Estonian company is still not possible remotely. You will need to travel to Estonia if you need a bank account in a “real” physical bank (not the fintech one). If you are not an EU citizen - you have even more problems. It’s a good chance to receive a refusal from both fintech and physical banks.
You can file Estonian vat reports which is a lot simpler than any other eu country. Completely doable without an accountant fully digital with costpocket.ee
I used to file VAT quarterly through the HMRC website when I had a small consulting business in the U.K. (back when that was still in the EU). It really wasn’t very complex.
I did use an accountant for filing my company’s annual accounts and taxes, though when I was a sole trader I just used the HMRC tax website to file. Far simpler than any of the options I’ve tried in the US, even as a regular employee (which you usually don’t have to file anything for in the U.K.)