Hello,
Go to Products > Attributes > edit the color attribute terms and change the term thumbnail.
Regards