https://www.makeuseof.com/reasons-why-you-dont-need-wordpress-seo-plugins/
They don't really discuss the number of times Yoast has borked someone's SEO or broken the website.
For quite some time now I have either no "SEO" plugin or just plugins to handle specific tasks that a specific site might need like managing redirects or or setting noindex tags on some pages. Some of these are literally a screen of code and can be vetted pretty quickly.