[jira] [Created] (CARBONDATA-2325) Page level uncompress and Query performance improvement for Unsafe No Dictionary

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-2325) Page level uncompress and Query performance improvement for Unsafe No Dictionary

Akash R Nilugal (Jira)
kumar vishal created CARBONDATA-2325:
----------------------------------------

             Summary: Page level uncompress and Query performance improvement for Unsafe No Dictionary
                 Key: CARBONDATA-2325
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2325
             Project: CarbonData
          Issue Type: Improvement
            Reporter: kumar vishal


*Page Level Decoder for query*
Add page level on demand decoding, in current code, all pages of blocklet is getting uncompressed, because of this memory footprint is too high and causing OOM, Now added code to support page level decoding, one page will be decoding when all the records are processed next page data will be decoded. It will improve query performance for example limit query.
*Unsafe No Dictionary(Unsafe variable length)*
Optimized getRow(for Vector processing) And putArray method



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)