There are lots of corner cases where the difference matters, like when integrals with finite bounds can go to infinity where a finite sum cannot. Boundary cases and surprise infinities seem to be a common problem problem the theoretical physicists have battled in their theories for the last century.