[jira] [Commented] (CARBONDATA-1657) Partition column is empty when insert from a hive table

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-1657) Partition column is empty when insert from a hive table

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-1657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16233948#comment-16233948 ]

Babulal commented on CARBONDATA-1657:
-------------------------------------

Hi
if possible please provide  create statement for hive_table  and dm_trd_wide_carbondata .
also  please check whether date format in carbon.properties is in yyyy-MM-dd format .
Thanks
Babu

> Partition column is empty when insert from a hive table
> -------------------------------------------------------
>
>                 Key: CARBONDATA-1657
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1657
>             Project: CarbonData
>          Issue Type: Bug
>          Components: data-load
>    Affects Versions: 1.2.0
>         Environment: carbonata1.2.0 spark 2.1.1
>            Reporter: cen yuhai
>            Priority: Critical
>
> I create table a carbon table, the schema is like a hive table(dt is the partition column).
> And then
> {code}
> insert overwrite table dm_test.dm_trd_wide_carbondata select * from hive_table where dt='2017-10-10';
> insert overwrite table dm_test.dm_trd_wide_parquet select * from hive_table where dt='2017-10-10';
> {code}
> {code}
> spark-sql> select dt from dm_test.dm_trd_wide_parquet limit 10;
> 2017-10-10
> 2017-10-10
> 2017-10-10
> 2017-10-10
> 2017-10-10
> 2017-10-10
> 2017-10-10
> 2017-10-10
> 2017-10-10
> 2017-10-10
> Time taken: 1.259 seconds, Fetched 10 row(s)
> spark-sql> select dt from dm_test.dm_trd_wide_carbondata limit 10;
> NULL
> NULL
> NULL
> NULL
> NULL
> NULL
> NULL
> NULL
> NULL
> NULL
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)