How to keep precision of Math Operations?
3 views (last 30 days)
Show older comments
Hi,
I am working with pressure and temprature sensor values in a Simulink project where I need to have higher precision than the one I am getting now which is just only two decimal points. How can I increase precision of the output from basic Math operations such as +-%* blocks. I keep getting two decimal points even if I change the output data type of the blocks to double.
Thanks in advance for the help.
0 Comments
Answers (3)
Henok Mentamo
on 1 Oct 2014
1 Comment
Stephen23
on 1 Oct 2014
Is this an answer to your own question? Please use the comments under the question text.
Iain
on 1 Oct 2014
You are probably getting more than 2 decimal places of "accuracy". You're probably getting 15 or 16 significant figures worth of accuracy, but only displaying 2 decimal places...
0 Comments
See Also
Products
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!