Login  Register

[jira] [Created] (CARBONDATA-4047) Datediff datatype is not working with spark-2.4.5. even in spark-sql its showing as null. .Either the query might be wrong or the versions don't support datatypes.

Posted by Akash R Nilugal (Jira) on Nov 03, 2020; 7:04am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/jira-Created-CARBONDATA-4047-Datediff-datatype-is-not-working-with-spark-2-4-5-even-in-spark-sql-its-tp103049.html

sravya created CARBONDATA-4047:
----------------------------------

             Summary: Datediff datatype is not working with spark-2.4.5. even in spark-sql its showing as null. .Either the query might be wrong or the versions don't support datatypes.
                 Key: CARBONDATA-4047
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-4047
             Project: CarbonData
          Issue Type: Task
          Components: spark-integration
    Affects Versions: 2.0.0
         Environment: Hadoop - 3.2.1
Hive - 3.1.2
Spark - 2.4.5
carbon data-2.0
mysql connector jar - mysql-connector-java-8.0.19.jar
            Reporter: sravya
         Attachments: carbon error.PNG, sparksql.PNG

1.scala> carbon.sql("CREATE TABLE IF NOT EXISTS vestedlogs3 as (select * , intck ("Hours", 'StartTimestamp', 'CompleteTimestamp') as Hours FROM vestedlogs) STORED AS carbondata").show()
<console>:1: error: ')' expected but string literal found.
carbon.sql("CREATE TABLE IF NOT EXISTS vestedlogs3 as (select * , intck ("Hours", 'StartTimestamp', 'CompleteTimestamp') as Hours FROM vestedlogs) STORED AS carbondata").show()

 

2.scala> carbon.sql("CREATE TABLE IF NOT EXISTS vestedlogs3 (SELECT *,DATEDIFF(HOUR,StartTimestamp GETDATE(),CompleteTimestamp GETDATE() AS "Hours" FROM vestedlogs) STORED AS carbondata").show()
<console>:1: error: ')' expected but string literal found.
carbon.sql("CREATE TABLE IF NOT EXISTS vestedlogs3 (SELECT *,DATEDIFF(HOUR,StartTimestamp GETDATE(),CompleteTimestamp GETDATE() AS "Hours" FROM vestedlogs) STORED AS carbondata").show()

 

 

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)