MATLAB Answers

Calculation error for floor function floor(1.4/0.025)

3 views (last 30 days)
Shahar on 20 May 2013
if x = floor(1.4/0.025) is 55 in Matlab, how does y = 1.4/0.025 is 56?

Accepted Answer

Iain on 20 May 2013
1.4/0.025 actually evaluates to 55.9999999999999928946.
The error is in the FIFTEENTH decimal place, which is an extremely small error, however, it is less than 56, and will "floor" to 55.

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!