BillPSU: You wrote: If your gage had a resolution of .0002 your gage error would be .0001 and the reading error .0001. The combined error is the square root of the squared sum of the errors which calculated to .00014.
I guess don't know what I'm doing because if I add .0001 to .0001 and...
Thank you Tunalover, but I guess I wasn't completely clear. Rounding numbers isn't what I'm having difficulty with, it's a debate over inspection readings. If the drawing says 1.105 +/- .001 and the instument reads 1.1068 I would automatically round up. However, other engineers here believe...
If I have a drawing that reads 1.105 +/- .001 and the inspection is done with a precision instrument that shows the result to be 1.1063 is this nonconforming?
What if the result is 1.1065, or 1.1069. Where is the line drawn? Do you stop at the 3rd decimal place as the drawing shows or if you...