The LT's axiom explains your observation about rank
When I was a lieutenant, we used to say "Rank times IQ equals a constant."
I still believe there's some truth to that. Lower ranking officers are busy day to day with the gory details of their mission. As they get promoted, they have to step back to see the big picture. In doing so, they lose sight of the critical details.
Two of the most dangerous things are a geek with a screwdriver and a boss with a technical journal. Neither really understands the damage they can do.