Talk:High precision analog

From sigrok
Revision as of 06:07, 3 January 2015 by Ivan747 (talk | contribs) (Corrected formatting -sorry!)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

I can't understand the first proposal, can the author provide us with examples please? I don know if you are thinking what I am thinking.

I'm thinking about a solution along the lines of a BCD value, with around 10 digits of precision (the highest resolution multimeters in existance have 8 and a half digits of resolution), with a base 10 exponent. Math is possible, but slower than normal and for complex operations, a conversion to floating point might be convenient. Ivan747 (talk) 04:06, 3 January 2015 (UTC)

Retrieved from "https://sigrok.org/w/index.php?title=Talk:High_precision_analog&oldid=10425"