Hey ajayonnet,
I use a product WP All Import as well for my site http://www.designbykathryn.com/shop
If you need a hand, I can help you out. As long as the csv file is set up correctly, you shouldn’t have to import each one individually. WP All import will create new products and pages automatically.
Send me a message if you want me to walk you through it.