Eng-Tips is the largest engineering community on the Internet

Intelligent Work Forums for Engineering Professionals

Register Log in
  • Congratulations waross on being selected by the Tek-Tips community for having the most helpful posts in the forums last week. Way to Go!

Search results for query: *

  • Users: jn196
  • Order by date
  1. jn196

    floor w/ and w/o units gives different results

    Because of this type of rounding issues, well known in programming, when trimming a number, say X, we use X + epsilon instead. Mathcad's TOL = 0.001 works as epsilon, and to simplify consider the alternative function jfloor(X) = floor(abs(X) + TOL)* sign(X) We keep these sort of things in a...
Back
Top