[jira] [Updated] (CARBONDATA-3643) Insert array('')/array() into Struct<Array> column will result in array(null), which is inconsist with Parquet

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Updated] (CARBONDATA-3643) Insert array('')/array() into Struct<Array> column will result in array(null), which is inconsist with Parquet

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-3643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xingjun Hao updated CARBONDATA-3643:
------------------------------------
        Fix Version/s: 2.0.0
    Affects Version/s: 2.0.0
                       1.6.1
          Description:
sql("create table datatype_struct_parquet(price struct<b:array<string>>) stored as parquet")
sql("insert into table datatype_struct_parquet values(named_struct('b', array('')))")
sql("create table datatype_struct_carbondata(price struct<b:array<string>>) stored as carbondata")
sql("insert into datatype_struct_carbondata select * from datatype_struct_parquet")

 
{code:java}
//
!== Correct Answer - 1 == == Spark Answer - 1 ==
![[WrappedArray()]] [[WrappedArray(null)]]
{code}
 

> Insert array('')/array() into Struct<Array> column will result in array(null), which is inconsist with Parquet
> --------------------------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-3643
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3643
>             Project: CarbonData
>          Issue Type: Bug
>    Affects Versions: 1.6.1, 2.0.0
>            Reporter: Xingjun Hao
>            Priority: Minor
>             Fix For: 2.0.0
>
>
> sql("create table datatype_struct_parquet(price struct<b:array<string>>) stored as parquet")
> sql("insert into table datatype_struct_parquet values(named_struct('b', array('')))")
> sql("create table datatype_struct_carbondata(price struct<b:array<string>>) stored as carbondata")
> sql("insert into datatype_struct_carbondata select * from datatype_struct_parquet")
>  
> {code:java}
> //
> !== Correct Answer - 1 == == Spark Answer - 1 ==
> ![[WrappedArray()]] [[WrappedArray(null)]]
> {code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)