I had great success with interline (liberty generic) on marestail which is my problematic weed. Most herbicides will harm fruit trees, certainly gly. So, you need to pick very calm days and control your spray very well no matter what you use.
It gets back to balance. It makes no sense to focus on deer alone without considering what you have to work with. The combination of herbicide resistant weeds, fruit trees, erosion tendency, and probably more seem to make this location less than ideal for a food plot.
I've been converting some of my small harvest plots to something I'll call "Wildlife Openings". I start with a good perennial clover base. I then planted low maintenance fruit trees. After the first year or two, these trees will get zero maintenance. Then I just let them go. I'll mow to get the clover established and once or twice a year for the first 4 or 5 years. They work great as harvest plots with the mix of weeds and clover. Because of my marestail problem, I time my mowing so that the marestail and grown large but has not quite gone to seed. If I get the timing right, it won't have enough time left in the growing season to produce seed when it rebounds. Yes, a lot of it will grow back from the roots the next year but it is better than millions of seeds. This doesn't get rid of it, but it doesn't dominate.
After that first 4 or 5 years, the clover is diminishing but the trees are beginning to produce fruit and that becomes the long-term primary food source. At that point, I restrict my mowing to every 3 years or so. Nature will let the field revert back to a diverse mix of weeds and clover rather than having one noxious weed like marestail dominate. My only reason to mow is to keep it in herbaceous growth and not allow woody stuff to take it from early succession. Between the fruit and beneficial weeds, these remain great harvest plots and are often used more than a green field because of the mix of food and cover.
Thanks,
Jack