[jira] [Created] (CARBONDATA-3753) optimize double/float stats collector

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-3753) optimize double/float stats collector

Akash R Nilugal (Jira)
Ajantha Bhat created CARBONDATA-3753:
----------------------------------------

             Summary: optimize double/float stats collector
                 Key: CARBONDATA-3753
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3753
             Project: CarbonData
          Issue Type: Improvement
            Reporter: Ajantha Bhat
            Assignee: Ajantha Bhat


Problem:

For every double/float column's every value. we call 

*PrimitivePageStatsCollector.getDecimalCount(double value)*

problem is, here we create new bigdecimal object and  plain string object every time.

Which leads in huge memory usage during insert

 

Solution:

Create only Bigdecimal object and use scale from that.

 

 

 

 

 

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)