No problem grafting onto them, but I wouldn't do anything drastic yet. Do you water or fertilize them? If not, try a little fertilizer and a lot of water this year, but don't use anything high in nitrogen. If you do fertilize them, hold off on it this year.