[jira] [Updated] (CARBONDATA-3820) Fix CDC failure when sort columns present in source dataframe

[Akash R Nilugal (Jira)]

     [ https://issues.apache.org/jira/browse/CARBONDATA-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xingjun Hao updated CARBONDATA-3820:
------------------------------------
    Summary: Fix CDC failure when sort columns present in source dataframe  (was: Support GlobalSort in the CDC)

> Fix CDC failure when sort columns present in source dataframe
> -------------------------------------------------------------
>
>                 Key: CARBONDATA-3820
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3820
>             Project: CarbonData
>          Issue Type: New Feature
>            Reporter: Xingjun Hao
>            Priority: Major
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> If there is GloabalSort table in the CDC Flow. The following exception will
> be throwed:
> Exception in thread "main" java.lang.RuntimeException: column: id specified
> in sort columns does not exist in schema
>         at
> org.apache.carbondata.sdk.file.CarbonWriterBuilder.buildTableSchema(CarbonWriterBuilder.java:828)
>         at
> org.apache.carbondata.sdk.file.CarbonWriterBuilder.buildCarbonTable(CarbonWriterBuilder.java:794)
>         at
> org.apache.carbondata.sdk.file.CarbonWriterBuilder.buildLoadModel(CarbonWriterBuilder.java:720)
>         at
> org.apache.spark.sql.carbondata.execution.datasources.CarbonSparkDataSourceUtil$.prepareLoadModel(CarbonSparkDataSourceUtil.scala:281)
>         at
> org.apache.spark.sql.carbondata.execution.datasources.SparkCarbonFileFormat.prepareWrite(SparkCarbonFileFormat.scala:141)
>         at
> org.apache.spark.sql.execution.command.mutation.merge.CarbonMergeDataSetCommand.processIUD(CarbonMergeDataSetCommand.scala:269)
>         at
> org.apache.spark.sql.execution.command.mutation.merge.CarbonMergeDataSetCommand.processData(CarbonMergeDataSetCommand.scala:152)

--
This message was sent by Atlassian Jira
(v8.3.4#803005)