Ask yourself a question:
What am I trying to achieve by "to do a light skim pass of the outside of the action while I have it chucked up for truing the face."
And after thinking about that question, fill in the details about just what action face and how deep is a skim pass, and over what part of the outside of the action?
Are you truing the face on a M94 lever gun?