A balance between risks
Spacewalking towards the belly (where the astronaut who manipulates the arm can't see what he does, other than through a TV screen) where tiles cannot be touched (otherwise they're damaged), is more risky than the consequences of the damaged tiles to the integrity of the shuttle.