variation images load slow

My variation images load very slow. Every time I click on a new option, it says “loading” for a few seconds before it shows. If you go back to an option, it loads quickly. I imagine it would really try the patience of customers. Any suggestions? I am already running smart optimizer.