Gin-zhj created CARBONDATA-558:
----------------------------------
Summary: Load performance bad when use_kettle=false
Key: CARBONDATA-558
URL:
https://issues.apache.org/jira/browse/CARBONDATA-558 Project: CarbonData
Issue Type: Bug
Reporter: Gin-zhj
Assignee: Gin-zhj
When you import a data file, the measure column contains many empty strings, if use_kettle=false, the load performance has a sharp decline
I checked the logs of executor, many warnnings printed like below:
16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-6 Cant not convert : to Numeric type value. Value considered as null.
16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-1 Cant not convert : to Numeric type value. Value considered as null.
16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-6 Cant not convert : to Numeric type value. Value considered as null.
16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-1 Cant not convert : to Numeric type value. Value considered as null.
16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-2 Cant not convert : to Numeric type value. Value considered as null.
16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-3 Cant not convert : to Numeric type value. Value considered as null.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)