Excellent comment and I have observations quite similar.
Whitetails, at their core, are prey animals with highly evolved predator avoidance instincts. And they are good at what they do.
Pressure - its presence, the type of it, the lack of it - is everything.
They are very sensitive to pressure and sensing what sort of human activity is threatening or non-threatening to them. When I make rounds around my property doing chores, running tractors, UTV's, chainsaws or whatever, making plenty of noise, they're aware of it, move off, give me a wide berth, let me go about my business - and when I depart, they come right back to munch on buds from trees I've felled our feed or even bed in food plots I just traipsed across. Knowing where you're at, I believe, gives them a sense of prey-animal control of the situation.
But tip-toe silently into their bedroom and spook them...can freak them the F out right now and put them in a more cautionary, nocturnal mode, and even encourage them to relocate.
I've had older bucks on trailcams with nighttime pics only for years, that no one has ever seen in daylight.
An old lady down the road had a 90 acre parcel that she sold two years ago. In the 60+ years she lived there, no hunting or trespassing was allowed on it, right smack dab in an area with lotsa lotsa hunting pressure. Much of her property was park-effect woods that you could see right through. In spite of it being some of the poorest deer habitat in the neighborhood, you could literally drive by on the road which bounded it and see deer, even older bucks, walking around in the open timber throughout the day...during hunting season. She sold the land to guys that hunt and those same woods are now mostly devoid of deer.
In the deer world, pressure is a pretty big deal.