[jira] [Created] (CARBONDATA-471) Optimize no kettle flow and fix issues in cluster

Posted by Akash R Nilugal (Jira) on Nov 29, 2016; 6:01pm
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/jira-Created-CARBONDATA-471-Optimize-no-kettle-flow-and-fix-issues-in-cluster-tp3394.html

Ravindra Pesala created CARBONDATA-471:
------------------------------------------

             Summary: Optimize no kettle flow and fix issues in cluster
                 Key: CARBONDATA-471
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-471
             Project: CarbonData
          Issue Type: Bug
            Reporter: Ravindra Pesala


1. In non kettle flow memory usage is very high in sort step, because it keeps lots of per every thread, it leads to GC issue.

2. Close all record readers which are opened while loading data.

3. Carbontable cannot found during data load because it is not loaded in executor, so add the carbon table in executor side to memory.

4. Prefetch the data in inputprocessor step to avoid IO waiting.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)