Hardness testing files are basicly a set of sharp to dull files.
If you have a rockwell tester, get out some old files and some heat treated scrap in the range you want to test and see what files will cut at what hardness. Mark them and see if the part in question is in the ball park.
Rebound and other portable testers can be excelent or they can be random number generators. Most rebound types need parts in the 20 lb class or larger. Smaller parts deflect and bounce away giving reduced readings.
If you use a portable unit, check it against parts that fit in your standard tester.
Hopefuly you specified on the print where to hardness test the part. If the part is not uniform in thickness, it did not heat uniformely when it was tempered and you will have some variation in hardness accross the part. This can be a complication if you have a bad part and try to take it up with your heat treater.
Another issue I have seen on bar stock is the heat treater not holding the part at temperature long enough to raise the core above critical temperature. ASTM requires the tensile bar be pulled at mid radius, so they heat it long enough to get the tensile bar to pass and no more. Same alloy from the same mill, and one outfit wont get it hard to the core, the other does it every time.