[jira] [Created] (CARBONDATA-558) Load performance bad when use_kettle=false

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-558) Load performance bad when use_kettle=false

Akash R Nilugal (Jira)
Gin-zhj created CARBONDATA-558:
----------------------------------

             Summary: Load performance bad when use_kettle=false
                 Key: CARBONDATA-558
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-558
             Project: CarbonData
          Issue Type: Bug
            Reporter: Gin-zhj
            Assignee: Gin-zhj


When you import a data file, the measure column contains many empty strings, if use_kettle=false, the load performance has a sharp decline

I checked the logs of executor, many warnnings printed like below:
 16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-6 Cant not convert :  to Numeric type value. Value considered as null.
16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-1 Cant not convert :  to Numeric type value. Value considered as null.
16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-6 Cant not convert :  to Numeric type value. Value considered as null.
16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-1 Cant not convert :  to Numeric type value. Value considered as null.
16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-2 Cant not convert :  to Numeric type value. Value considered as null.
16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-3 Cant not convert :  to Numeric type value. Value considered as null.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)