[jira] [Updated] (CARBONDATA-1328) Refactoring unsafe code and added new property

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Updated] (CARBONDATA-1328) Refactoring unsafe code and added new property

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

kumar vishal updated CARBONDATA-1328:
-------------------------------------
    Description:
refactoring unsafe memory manager and unsafe sort
Removed Sort memory manager and added Single memory manager
Deprecated old property: sort.inmemory.size.inmb, enable.offheap.sort
Added new property: carbon.sort.storage.inmemory.size.inmb, carbon.unsafe.working.memory.in.mb, enable.offheap
Removed copying of block from working memory to sort storage memory
Now all the unsafe flow must use CarbonUnsfeMemoryManager for allocating/ removing unsafe memory
If user has configured old property then internally it will be converted to new property
for ex: If user has configured sort.inmemory.size.inmb then 20% memory will be used as working memory and rest for storage memory

  was:Add unsafe property validation + handle old unsafe parameter for backward compatibility

     Issue Type: Improvement  (was: Bug)
        Summary: Refactoring unsafe code and added new property  (was: Carbon Unsafe Property validation)

> Refactoring unsafe code and added new property
> ----------------------------------------------
>
>                 Key: CARBONDATA-1328
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1328
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: kumar vishal
>            Assignee: kumar vishal
>
> refactoring unsafe memory manager and unsafe sort
> Removed Sort memory manager and added Single memory manager
> Deprecated old property: sort.inmemory.size.inmb, enable.offheap.sort
> Added new property: carbon.sort.storage.inmemory.size.inmb, carbon.unsafe.working.memory.in.mb, enable.offheap
> Removed copying of block from working memory to sort storage memory
> Now all the unsafe flow must use CarbonUnsfeMemoryManager for allocating/ removing unsafe memory
> If user has configured old property then internally it will be converted to new property
> for ex: If user has configured sort.inmemory.size.inmb then 20% memory will be used as working memory and rest for storage memory



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)