[jira] [Updated] (CARBONDATA-2864) Carbon Update not supported in Spark2.x

[Akash R Nilugal (Jira)]

     [ https://issues.apache.org/jira/browse/CARBONDATA-2864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

anand updated CARBONDATA-2864:
------------------------------
    Description:
Carbon update statement was not working in Spark2.x.

 

Error Log

carbon.sql("UPDATE test_table t SET(name)='T' where t.id = 10"); 

org.apache.spark.sql.AnalysisException: Detected cartesian product for INNER join between logical plans

Project [name#5]

+- Filter (isnotnull(id#4) && (cast(id#4 as double) = 101.0))

   +- Relation[id#4,name#5,city#6,age#7] CarbonDatasourceHadoopRelation [ Database name :default, Table name :test_table, Schema :Some(StructType(StructField(id,StringType,true), StructField(name,StringType,true), StructField(city,StringType,true), StructField(age,IntegerType,true))) ]

and

Project [id#365, name#366, city#367, age#368, UDF() AS tupleId#363]

+- Filter (isnotnull(id#365) && (cast(id#365 as double) = 10.0))

  ... 50 elided

  was:
Carbon update statement was not working in Spark2.x.

 

Error Log

carbon.sql("UPDATE test_table t SET(name)='T' where t.id = 10");

org.apache.spark.sql.AnalysisException: == Parse1 ==

 

mismatched input 'UPDATE' expecting \{'(', 'SELECT', 'FROM', 'ADD', 'DESC', 'WITH', 'VALUES', 'CREATE', 'TABLE', 'INSERT', 'DELETE', 'DESCRIBE', 'EXPLAIN', 'SHOW', 'USE', 'DROP', 'ALTER', 'MAP', 'SET', 'RESET', 'START', 'COMMIT', 'ROLLBACK', 'REDUCE', 'REFRESH', 'CLEAR', 'CACHE', 'UNCACHE', 'DFS', 'TRUNCATE', 'ANALYZE', 'LIST', 'REVOKE', 'GRANT', 'LOCK', 'UNLOCK', 'MSCK', 'EXPORT', 'IMPORT', 'LOAD'}(line 1, pos 0)

 

== SQL ==

UPDATE test_table t SET(name)='T' where t.id = 10

^^^

 

== Parse2 ==

Parsing error, missing bracket;

  at org.apache.spark.sql.util.CarbonException$.analysisException(CarbonException.scala:23)

  at org.apache.spark.sql.parser.CarbonSparkSqlParser.parsePlan(CarbonSparkSqlParser.scala:71)

  at org.apache.spark.sql.CarbonSession.withProfiler(CarbonSession.scala:144)

  at org.apache.spark.sql.CarbonSession.sql(CarbonSession.scala:95)

  ... 50 elided

> Carbon Update not supported in Spark2.x
> ----------------------------------------
>
>                 Key: CARBONDATA-2864
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2864
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: anand
>            Priority: Major
>
> Carbon update statement was not working in Spark2.x.
>  
> Error Log
> carbon.sql("UPDATE test_table t SET(name)='T' where t.id = 10"); 
> org.apache.spark.sql.AnalysisException: Detected cartesian product for INNER join between logical plans
> Project [name#5]
> +- Filter (isnotnull(id#4) && (cast(id#4 as double) = 101.0))
>    +- Relation[id#4,name#5,city#6,age#7] CarbonDatasourceHadoopRelation [ Database name :default, Table name :test_table, Schema :Some(StructType(StructField(id,StringType,true), StructField(name,StringType,true), StructField(city,StringType,true), StructField(age,IntegerType,true))) ]
> and
> Project [id#365, name#366, city#367, age#368, UDF() AS tupleId#363]
> +- Filter (isnotnull(id#365) && (cast(id#365 as double) = 10.0))
>   ... 50 elided

--
This message was sent by Atlassian JIRA
(v7.6.3#76005)