No, they should keep it
It really does show one's devotion to a cause. There are already plenty
of other religions and organizations that allow marriage and sex. Plus
it's not like one gets drafted into becoming a priest. You have to go
through a lot to become one.
As with politics, for the few who mess up and make the headlines, there
are plenty who are good people who follow their oaths and of course
never get public recognition of this.