If it's hot outside shouldn't you also raise the price you pay for labor? If it's "harder" for you to deliver ice cream, then it's certainly "harder" for your workers to operate your store.
Night shift premiums have been a thing for a long time. You'd need another mechanism to make labour market effective at per-hour basis to adjust for the weather.
I'm sure that will all trickle down.