sravya created CARBONDATA-4047:
----------------------------------
Summary: Datediff datatype is not working with spark-2.4.5. even in spark-sql its showing as null. .Either the query might be wrong or the versions don't support datatypes.
Key: CARBONDATA-4047
URL:
https://issues.apache.org/jira/browse/CARBONDATA-4047 Project: CarbonData
Issue Type: Task
Components: spark-integration
Affects Versions: 2.0.0
Environment: Hadoop - 3.2.1
Hive - 3.1.2
Spark - 2.4.5
carbon data-2.0
mysql connector jar - mysql-connector-java-8.0.19.jar
Reporter: sravya
Attachments: carbon error.PNG, sparksql.PNG
1.scala> carbon.sql("CREATE TABLE IF NOT EXISTS vestedlogs3 as (select * , intck ("Hours", 'StartTimestamp', 'CompleteTimestamp') as Hours FROM vestedlogs) STORED AS carbondata").show()
<console>:1: error: ')' expected but string literal found.
carbon.sql("CREATE TABLE IF NOT EXISTS vestedlogs3 as (select * , intck ("Hours", 'StartTimestamp', 'CompleteTimestamp') as Hours FROM vestedlogs) STORED AS carbondata").show()
2.scala> carbon.sql("CREATE TABLE IF NOT EXISTS vestedlogs3 (SELECT *,DATEDIFF(HOUR,StartTimestamp GETDATE(),CompleteTimestamp GETDATE() AS "Hours" FROM vestedlogs) STORED AS carbondata").show()
<console>:1: error: ')' expected but string literal found.
carbon.sql("CREATE TABLE IF NOT EXISTS vestedlogs3 (SELECT *,DATEDIFF(HOUR,StartTimestamp GETDATE(),CompleteTimestamp GETDATE() AS "Hours" FROM vestedlogs) STORED AS carbondata").show()
--
This message was sent by Atlassian Jira
(v8.3.4#803005)