[jira] [Created] (CARBONDATA-2760) Reduce Memory footprint and store size for local dictionary encoded columns

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-2760) Reduce Memory footprint and store size for local dictionary encoded columns

Akash R Nilugal (Jira)
kumar vishal created CARBONDATA-2760:
----------------------------------------

             Summary: Reduce Memory footprint and store size for local dictionary encoded columns
                 Key: CARBONDATA-2760
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2760
             Project: CarbonData
          Issue Type: Improvement
            Reporter: kumar vishal
            Assignee: kumar vishal


*Problem*
 # Local dictionary encoded page is using unsafevarlenghtcolumn column page which internally maintains offset of each value in another column page because of this memory footprint is high.
 # for complex primitive string data type column page while compressing, it is converting to LV even if it is encoded with dictionary values, because of this store size is high.

*Solution:*
 # Use UnsafeFixedLength Column page for local dictionary encoded columns
 # No need to convert to LV during query if local dictionary is present so use UnsafeFixLength Column page



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)