Absolutely you give up a lot of convenience of searching email content. After using it twice, I stopped using their Bridge and instead on my laptop set search to download and index locally. On mobile I live with just searching metadata, like subject lines.

The good news is that you use your own domain and there are a lot of good alternatives that support search of content for you where you can use your domain, like Apple Mail, FastMail, etc.