Hello,
Go to Appearance > Widgets > Shop sidebar > WooCommerce Categories widget > there you’ll find all the available options for the category widget.
Regards