[jira] [Updated] (CARBONDATA-3643) Insert array('')/array() into Struct<Array> column will result in array(null), which is inconsist with Parquet

Posted by Akash R Nilugal (Jira) on Mar 17, 2021; 7:24am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/jira-Updated-CARBONDATA-3643-Insert-array-array-into-Struct-Array-column-will-result-in-array-null-wt-tp106934.html


     [ https://issues.apache.org/jira/browse/CARBONDATA-3643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ajantha Bhat updated CARBONDATA-3643:
-------------------------------------
    Fix Version/s:     (was: 2.1.1)
                   2.2.0

> Insert array('')/array() into Struct<Array> column will result in array(null), which is inconsist with Parquet
> --------------------------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-3643
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3643
>             Project: CarbonData
>          Issue Type: Bug
>    Affects Versions: 1.6.1, 2.0.0
>            Reporter: Xingjun Hao
>            Priority: Minor
>             Fix For: 2.2.0
>
>
>  
> {code:java}
> //
> sql("create table datatype_struct_parquet(price struct<b:array<string>>) stored as parquet")
> sql("insert into table datatype_struct_parquet values(named_struct('b', array('')))")
> sql("create table datatype_struct_carbondata(price struct<b:array<string>>) stored as carbondata")
> sql("insert into datatype_struct_carbondata select * from datatype_struct_parquet")
> checkAnswer( sql("SELECT * FROM datatype_struct_carbondata"), sql("SELECT * FROM datatype_struct_parquet"))
> !== Correct Answer - 1 == == Spark Answer - 1 ==
> ![[WrappedArray()]] [[WrappedArray(null)]]
> {code}
>  

--
This message was sent by Atlassian Jira
(v8.3.4#803005)