Eng-Tips is the largest engineering community on the Internet

Intelligent Work Forums for Engineering Professionals

a +/- 0.1% meter, reading "100.00"

Status
Not open for further replies.

WhyDoYouAsk

Electrical
Nov 20, 2008
42
0
0
US
The likelihood of the true value of what you're measuring actually being 100.00 is virtually zero.
There's a 95% chance the true value is between 100.10 and 99.90.
There's a 68% chance the true value is between 100.05 and 99.95.

Agreed?
 
Replies continue below

Recommended for you

Your estimate of "virtually zero" would actually be about 1-in-21 (about 5%), given an even distribution of the possible counts within that stated error range.

And, lacking any evidence to the contrary, you'd have to assume an even distribution. The error might be quite systematic and primarily composed of an unknown fixed offset guaranteed to be within the specified limits. Of the total error budget, it's likely that only a small part is made up of natural variations where bell curve math would apply.
 
Thanks.
This may come up a lot for me, so aside from the uniform distribution assumption do you have a link for this kind of not-very-well-known info (interpreting meter tolerance specs)?
 
If this is going to come up a lot, consider selecting test instrumentation with greater precision.

Bill
--------------------
"Why not the best?"
Jimmy Carter
 
There are other reasons for that last decimal point other than for makng exact measurements. Afterall, the world is dynamic, not static. That extra decimal place serves to show slow drift or variations in the readings.
 
Status
Not open for further replies.
Back
Top