I agree with Brent and Jay. That vacuum seems about right for the cam. I have about the same vacuum in my 427 with a 260/264 cam, stock stroke though. You can get away with a low cruise RPM like that in 1st or maybe 2nd gear, but under a load in 3rd (or 4th, you didn't mention auto or manual) the engine won't like it much and will likely surge a bit. Also, on the idle, with an MSD distributor, I've found that if the springs are light, or there's any slop in them with no advance, the weights can bounce or move around a bit and contribute to an erratic idle. Once a little RPM is engaged, and the springs steady under tension, that usually goes away. You can check this at idle by watching the timing mark on the balancer and see if it's moving at all.
Also, I'm a bit confused why you had to jet higher? Usually, if anything, these carbs usually need to be jetted down. And since the jets really have no bearing on idle quality, if it made a difference in idle, it's possible the primary butterflies may be opened too far, making the problem even more noticeable. When you shut off the secondaries, did you open the primaries more to gain back your idle RPM? If so, you may be exposing the transfer slot and that won't help any.
My engine is also very sensitive to idle adjustment, but with a lot of playing around, I've found the "sweet spot" where everything seems to work together to keep it at or around 850 RPM. The mixture screws are very sensitive combined with the idle speed adjuster; just a small adjustment makes a big difference. Kind of the nature of the beast when trying to get a fairly radical cam to play nice at low RPM.