Here is an example – http://prntscr.com/1s5hcj4 , “draft” products can’t be shown there, so you need to publish products or select other Upsells
Regards