No...
If the libertarian wins, he will have to pay for the same services in other ways, and he will have to pay for many, many more security devices. (I wonder what private food inspectors' fees would be?) Some of those will be cheaper and more efficient. Some of them will be frauds, some of them will be overpriced. All of the costs will be passed on to the customer, and since there would be no government oversight, the possibility of monopolies, price-fixing and collusion would replicate as it did in the late 1800s.
Being left alone in the romantic libertarian sense went away with the loss of the frontier at the beginning of the 20th Century. Get over it.