Ravindra Pesala created CARBONDATA-757:
------------------------------------------
Summary: Big decimal optimization in store and processing
Key: CARBONDATA-757
URL:
https://issues.apache.org/jira/browse/CARBONDATA-757 Project: CarbonData
Issue Type: Improvement
Reporter: Ravindra Pesala
Assignee: Ravindra Pesala
Currently Decimal is converted to bytes and using LV (length + value) format to write to store. And while getting back read the bytes in LV format and convert back the bigdecimal.
We can do following operations to improve storage and processing.
1. if decimal precision is less than 9 then we can fit in int (4 bytes)
2. if decimal precision is less than 18 then we can fit in long (8 bytes)
3. if decimal precision is more than 18 then we can fit in fixed length bytes(the length bytes can vary depends on precision but it is always fixed length)
So in this approach we no need store bigdecimal in LV format, we can store in fixed format.It reduces the memory.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)