[jira] [Resolved] (CARBONDATA-558) Load performance bad when use_kettle=false

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Resolved] (CARBONDATA-558) Load performance bad when use_kettle=false

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jacky Li resolved CARBONDATA-558.
---------------------------------
       Resolution: Fixed
    Fix Version/s: 1.0.0-incubating

> Load performance bad when use_kettle=false
> ------------------------------------------
>
>                 Key: CARBONDATA-558
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-558
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: Gin-zhj
>            Assignee: Gin-zhj
>             Fix For: 1.0.0-incubating
>
>          Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> When you import a data file, the measure column contains many empty strings, if use_kettle=false, the load performance has a sharp decline
> I checked the logs of executor, many warnnings printed like below:
>  16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-6 Cant not convert :  to Numeric type value. Value considered as null.
> 16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-1 Cant not convert :  to Numeric type value. Value considered as null.
> 16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-6 Cant not convert :  to Numeric type value. Value considered as null.
> 16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-1 Cant not convert :  to Numeric type value. Value considered as null.
> 16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-2 Cant not convert :  to Numeric type value. Value considered as null.
> 16/12/22 07:03:12 WARN MeasureFieldConverterImpl: pool-22-thread-3 Cant not convert :  to Numeric type value. Value considered as null.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)