You could play around with the Three.js camera object. We made a separate viewer for the video team that had more complicated camera controls (and higher max frame + zoom level).
... and you wouldn't release that separate viewer, would you?
I'm planing on using a hyperlapse for a recent roadtrip through the US, including photos. I also want to create a video from the hyperlapse and add the photos via AfterEffects.
