Login  Register

[jira] [Created] (CARBONDATA-558) Load performance bad when use_kettle=false

Posted by Akash R Nilugal (Jira) on Dec 23, 2016; 9:17am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/jira-Created-CARBONDATA-558-Load-performance-bad-when-use-kettle-false-tp4926.html

Gin-zhj created CARBONDATA-558:
----------------------------------

             Summary: Load performance bad when use_kettle=false
                 Key: CARBONDATA-558
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-558
             Project: CarbonData
          Issue Type: Bug
            Reporter: Gin-zhj
            Assignee: Gin-zhj


When you import a data file, the measure column contains many empty strings, if use_kettle=false, the load performance has a sharp decline

I checked the logs of executor, many warnnings printed like below:
 16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-6 Cant not convert :  to Numeric type value. Value considered as null.
16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-1 Cant not convert :  to Numeric type value. Value considered as null.
16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-6 Cant not convert :  to Numeric type value. Value considered as null.
16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-1 Cant not convert :  to Numeric type value. Value considered as null.
16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-2 Cant not convert :  to Numeric type value. Value considered as null.
16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-3 Cant not convert :  to Numeric type value. Value considered as null.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)