When I was running factory adjustable rockers with the lock nut instead of the thread retention I had the same thing happen. I was down right frightening because it sounded like a rod until you lifted the hood. I have Dove rollers currently. They clear the cover with factory iron or Edelbrocks. Improvise, overcome and adapt!
-Keith