[jira] [Created] (CARBONDATA-471) Optimize no kettle flow and fix issues in cluster

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-471) Optimize no kettle flow and fix issues in cluster

Akash R Nilugal (Jira)
Ravindra Pesala created CARBONDATA-471:
------------------------------------------

             Summary: Optimize no kettle flow and fix issues in cluster
                 Key: CARBONDATA-471
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-471
             Project: CarbonData
          Issue Type: Bug
            Reporter: Ravindra Pesala


1. In non kettle flow memory usage is very high in sort step, because it keeps lots of per every thread, it leads to GC issue.

2. Close all record readers which are opened while loading data.

3. Carbontable cannot found during data load because it is not loaded in executor, so add the carbon table in executor side to memory.

4. Prefetch the data in inputprocessor step to avoid IO waiting.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)