Speed vs Power
Speed needs power and currently we don't have enough of that which doesn't mass too many tons. That's the real brakes on getting to the Outer Planets. And don't invoke "Orion" or Gas-Core Reactor rockets - both are decidedly unfriendly for ground-testing.
