Tell that to the victims of escaped convicts.
"Why else would you want to kill someone other than for revenge? When you can keep the perpetrator in prison until he dies, you're still protecting society as a whole. The only point in killing him I see is revenge."
Violent prisoners escape all the time to commit even more mayhem. The chance of that happening when they're dead is greatly reduced.