Hello,
There is no such option by default. So, you may look for a third-party plugin to implement this. For example https://wordpress.org/plugins/empty-cart-button-for-woocommerce/ or https://wordpress.org/plugins/woo-empty-cart-button/
Regards