If he would be big enough to shoot, I'd shoot him. 2/3 if he isn't up to par, give him more time.
I had a property full of 80-120" deer last year. Could have waxed many, but passed them. This year big boy is around 160 and multiple bucks between 140-150. Rumors there are bigger ones in neighborhood.