Login  Register

Difference in decimal values for variance in Presto.

Posted by Jatin Demla on Jun 28, 2017; 5:22am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Difference-in-decimal-values-for-variance-in-Presto-tp16496.html

Hi community,

I was working on presto bug 995 (
https://issues.apache.org/jira/browse/CARBONDATA-995) in which variance of
decimal values is calculated. When there is lesser number of decimal values
to calculate variance in carbondata and presto then there being no
difference in result. But when the dataset become large the result value
varies to minor difference (in my case i am calculating it with 2000
bigdecimal values the result difference between presto and carbondata is
0.1938... ). So, should i continue looking into this issue or this much
difference is fine.


--
Thanks & Regards
Jatin