[
https://issues.apache.org/jira/browse/CARBONDATA-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravindra Pesala updated CARBONDATA-833:
---------------------------------------
Fix Version/s: (was: 1.1.0-incubating)
(was: 1.0.0-incubating)
> load data from dataframe,generater data row may be error when delimiterLevel1 or delimiterLevel2 is special character
> ---------------------------------------------------------------------------------------------------------------------
>
> Key: CARBONDATA-833
> URL:
https://issues.apache.org/jira/browse/CARBONDATA-833> Project: CarbonData
> Issue Type: Bug
> Components: spark-integration
> Affects Versions: 1.0.0-incubating, 1.1.0-incubating
> Reporter: tianli
> Assignee: tianli
> Original Estimate: 4h
> Time Spent: 40m
> Remaining Estimate: 3h 20m
>
> load data from dataframe,generater data row may be error by delimiterLevel1 or delimiterLevel2 is special character
> because delimiterLevel1 and delimiterLevel2 when carbonLoadModel is create by CarbonUtil.delimiterConverter(), CarbonScalaUtil.getString direct use carbonLoadModel.getComplexDelimiterLevel1 and carbonLoadModel.getComplexDelimiterLevel2
> val delimiter = if (level == 1) {
> delimiterLevel1
> } else {
> delimiterLevel2
> }
> val builder = new StringBuilder()
> s.foreach { x =>
> builder.append(getString(x, serializationNullFormat, delimiterLevel1,
> delimiterLevel2, timeStampFormat, dateFormat, level + 1)).append(delimiter)
> }
> make primitive data added a more char \ when datatype is complex
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Locked
