After cleaning up the rocker arms, how was the vacuum, steadier?
As long as the lash hasn't changed, I don't see how the cam and lifters would be ruined.
If any damage would be done, I'd think the valve guides would have taken the brunt of it due to the valve spring being pushed over before the valve was pressed straight down. *shrugs* Dunno tho.
I'd think the fluctuating vacuum would have been caused by the valves not fully seating perfectly every time.
and not to be telling you something that you do not currently know..... but proper engine assembly is putting everything together, checking everything, turning the engine, checking for interactions between parts, adjusting as needed, rechecking, measuring, putting it all back together, rechecking because you weren't 100% sure, taking it all apart, etc. This is all the more critical when dealing with a host of parts from a handful of different suppliers. It took me probably an entire day to get my factoryish rocker set up to where I was happy they would do the job well.
Anyway, good luck, hope this is the last of your issues.