Vandana Yadav created CARBONDATA-1143:
-----------------------------------------
Summary: Incorrect Data load while loading data into struct of struct
Key: CARBONDATA-1143
URL:
https://issues.apache.org/jira/browse/CARBONDATA-1143 Project: CarbonData
Issue Type: Bug
Components: data-load
Affects Versions: 1.2.0
Environment: spark 2.1
Reporter: Vandana Yadav
Priority: Minor
Attachments: structinstructnull.csv
Incorrect Data load while loading data into struct of struct
Steps to reproduce:
1) Create table:
create table structinstruct(id int, structelem struct<id1:int, structelem: struct<id2:int, name:string>>)stored by 'carbondata';
2)Load data:
load data inpath 'hdfs://localhost:54310/structinstructnull.csv' into table structinstruct options('delimiter'=',' , 'fileheader'='id,structelem','COMPLEX_DELIMITER_LEVEL_1'='#', 'COMPLEX_DELIMITER_LEVEL_2'='|');
3)Query executed:
select * from structinstruct;
4) Actual result:
+-------+------------------------------------------------------+--+
| id | structelem |
+-------+------------------------------------------------------+--+
| 1 | {"id1":111,"structelem":{"id2":1001,"name":"abc"}} |
| 2 | {"id1":222,"structelem":{"id2":2002,"name":"xyz"}} |
| NULL | {"id1":333,"structelem":{"id2":3003,"name":"def"}} |
| 4 | {"id1":null,"structelem":{"id2":4004,"name":"pqr"}} |
| 5 | {"id1":555,"structelem":{"id2":null,"name":"ghi"}} |
| 6 | {"id1":666,"structelem":{"id2":6006,"name":"null"}} |
| 7 | {"id1":null,"structelem":{"id2":1001,"name":null}} |
+-------+------------------------------------------------------+--+
7 rows selected (1.023 seconds)
5) Expected Result: In last row "id2" should be null as there is no such value(1001) provided in csv for that
6) Data in CSV:
1,111#1001|abc
2,222#2002|xyz
null,333#3003|def
4,null#4004|pqr
5,555#null|ghi
6,666#6006|null
7,null
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Locked
