I think likely too, like I said we went 1.70 and the cam was actually over .630 before deflection, but a couple of thoughts
Depending on the head, you start losing real estate between valves, and of course the ability to shed/absorb heat. Less of a concern on a naturally aspirated motor than an un-natural one LOL, but an exhaust valve cools itself when closed, so losing material between the valves is never optimal.
Also, the clay isn't really as much for the wall, best to do that with the block bare. The clay would be best to check the pistons, radial clearance can vanish quickly and often is not intuitive where/when it gets tight.