In the Royal theme it looks little different. Navigate to Theme Options->Shop->Enable “Out of stock” icon
Regards, Robert Hall.