Clear Filters
Clear Filters

利用Matlab计算小数除法时,计算结果出现问题

8 views (last 30 days)
远东 谢
远东 谢 on 13 Mar 2023
Answered: Abhijeet on 6 Apr 2023
计算2.47/0.01时,输出247.0000,此时对结果使用ceil函数,得到的结果是278。但是计算2.471/0.001和24.7/0.1时均直接得到整数结果。

Answers (1)

Abhijeet
Abhijeet on 6 Apr 2023
Hi,
You have encountered a round-off error that demonstrates a fundamental problem with the way computers deal with fractional numbers. Some numbers (in fact, "most" of them) cannot be represented exactly in binary form -- specifically, fractional numbers that are not powers of two. This will occur in any computer program using ANSI/IEEE standard math.
You can refer to this answer for the same.
Thanks

Products


Release

R2018a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!