Heavy clay is a problem in parts of NY. My backyard plot included.
You rotate soil, you get new weed seed. However, I believe there is plenty of worth to truning hard clay into increased organic matter coneent. Use fertilizer to build organic matter. Turn the soil over after a few years to mix it in deeper, but not too deep.
Run that no till method for a few years, then mix that top layer of organic matter a few inches down with a set of discs. Let the soil alone for a week or two, until fresh weed seed is sprouting. Lightly disturb the soil with a set of discs or a harrow or drag. You can do that one more time, or let the weeds come back young, spray them dead, and plant. make this your spring cleaning, plant a summer plot, then your fall of rye n clover. Turning down deep can take your hard work of improved organic matter and hde it on you. Much of no-till is the top 3-4 inches.
A tree farm down the road does this rotation....... When he's done with a run of trees, he cuts the trees and either chips them up or burn some of it with the stumps. He lets the place goes to weeds for about 2 years, then runs subsoiler in there. Sprays the weeds dead, lightly discs and put orchardgrass and clover down.
The old me...... I'd clover up a field until the clover got choked out, then make something more attractve, then go back to clover.
Using some more diesel and fertilizer is much cheaper than starting from scratch again. IF you move, you might not like the neighbors and a host of other things. you know what you got.
One majot philosphy of no-till, always have something growing. Simple fix, always have some clover seed on hand....... A few years of cereal grains and clover, them give it a disc and make it soybeans turnips corn or whatever makes your eyes dazzle..... After that glory year, give the soil a break with some cereal grains again. However, have the clover growing underneath your corn or beans or turnips. Possibly using exclusively ladino clover, because it wont compete as much as other clovers. My brother in laws finds it worthwhile and profitable to have an airplane seed rye into his soybean fields a few weeks before harvest. It's been a dry NY summer, he thinks ahead not behind. I'm guessing he'll hit the rye hard this fall. Likely just to preserve that expensive fertilizer he put down on more or less failed crops. Insurance for his bad crop year is a bunch of dairy cows....... His best AG field is the 450 acre spot he lets me hunt in. Might backfire. Last opening day I get there and he's running 2 combine trains in there. 2 combines, 2 jockey tractors with wagons, (4) 18 wheelers, and a repair and refueling rig too.
Not sure what you have far as plot sizes, but you could plant soybeans and have someone harvest them for you. Same with corn. Generate a few dollars, or motivate someone to help you with your land for their profit......