Pan and scan
That's the way to do this. Fortunately I shot it on my EX1 XDCam in Full HD 1080 30p, which allows me to zoom in on sections of the video without degrading the quality too much. At a certain point the resolution is degraded but no where near as bad as when you try zooming in on footage in SD. When I'm done with the re-edit I'll see if it's not too big to upload in HD to youtube.