Hello,
Custom sidebar can be created via Appearance > Widgets. It can be associated with a page via layout options – http://prntscr.com/t2r4sz
Note that woocommerce widgets, like Product categories, work on default WC pages only (Shop, page of product category).
Regards