Quantcast
Channel: Andrew Bell's Activities
Viewing all articles
Browse latest Browse all 4948

number of digits readout

$
0
0

when the answer is zero,

the readout says

0.0

If I have specified readout to be 0.00000001, when the value is zero, the readout is

0.0

Nobody who is degree qualified, or experienced in the physical sciences, would

interpret 0.0 to mean 0.00000000

When there is slight misalignment of things, in PD, I have seen angle deltas of 0.0000456 deg,

for example.  '0.0' is supposed to tell me I have not that?

PD has decided that '0.0' is a special value, and overrides user specified readout resolution.

In some contexts, 0.0 could mean 0.00000000000000000000000000000000000000...

But when I have specified 8 digits, can I please have 8?  As requested?

Jim


Viewing all articles
Browse latest Browse all 4948

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>