They have seriously stunted some of the smaller apple trees that I have planted.
when I plant apple trees in the environs where these big ant hills exist, I throw the extra pieces of sod or XS dirt well away from the apple tree. I feel any high spot tends to attract ants and a new colony.