[
https://issues.apache.org/jira/browse/CARBONDATA-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jacky Li resolved CARBONDATA-2110.
----------------------------------
Resolution: Fixed
Assignee: (was: xuchuanyin)
Fix Version/s: 1.3.0
> option of TempCsv should be removed since the default delimiter may conflicts with field value
> ----------------------------------------------------------------------------------------------
>
> Key: CARBONDATA-2110
> URL:
https://issues.apache.org/jira/browse/CARBONDATA-2110> Project: CarbonData
> Issue Type: Bug
> Components: data-load
> Reporter: xuchuanyin
> Priority: Major
> Fix For: 1.3.0
>
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> Currently in carbondata, an option named ‘tempCSV’ is available during loading dataframe.
>
> After enabling this option, Carbondata will write the dataframe to a *standard* csv file at first and then load the data files.
>
> The delimiters of the standard csv file, such as field delimiter / escape char/ quote char/ multi-line/ line separator and so on may conflict with the actual field value. For example, if a field contains ',', then it will cause problem in further data loading if we save the tempCSV using ',' as field separator.
>
> Since we are not sure about the content of dataframe, I think it's better to deprecate this option. To make forward compatible, user can still use this option but will get warning about it.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
Locked
