Final Update:
I narrowed the problem down to the rear bearing. This "nudging" of the cam against the bearings got me thinking and I realized this cam is a billet steel piece. It wouldn't take a ton of abuse, but certainly more than a cast cam. Anyway, I pulled the cam out slightly so I could line up a long drift against the core itself while leveraging from the oil drain hole below it. While rotating the cam back and forth, I applied pressure to one side, then inserted the drift on the opposite side and did the same.
Cam turns nice and easy! Thanks.