Try to change the previous code to:
.single-product .pswp {
display: none;
}
Or you can activate the Single product page builder in Theme Options > WooCommerce (Shop), then you will be able to build the desired layout from scratch. The gallery element has option to disable Lightbox there.
Regards