Most issues are solvable.
You can make an Orion vehicle robust enough that vibration isn't that much of an issue. Maybe you'd have to develop new boosters. Personally, launching under nuclear power, using properly-designed bombs from a sufficiently isolated area (the middle of the southern ocean), would not create that much damage. Attention would have to be paid to neutron emissions, EMP effects (this might be a problem even in near-earth space), and a few other issues.
Extending those arms and spinning them up would obviously require applying thrusters of some kind to the system, unless somebody spun up one hell of a flywheel beforehand (the thrusters are easier.)