I planted American plum in zone 3 sandy soils and the only ones that have grown are the ones that are protected with fence. They grow pretty slowly for me, but they are forming thickets.
The fruit on mine is gone months before deer hunting, but I believe that it provides cover & summer food for small game.
I prefer crabapples, better for deer hunting, and some crabs provide wildlife food in winter, when it is really needed.