[jira] [Created] (CARBONDATA-4135) insert in partition table should fail from presto side but insert into select * in passing in partition table with single column partition table from presto side

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-4135) insert in partition table should fail from presto side but insert into select * in passing in partition table with single column partition table from presto side

Akash R Nilugal (Jira)
Chetan Bhat created CARBONDATA-4135:
---------------------------------------

             Summary: insert in partition table should fail from presto side  but insert into select * in passing in partition table with single column partition table from presto side
                 Key: CARBONDATA-4135
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-4135
             Project: CarbonData
          Issue Type: Bug
          Components: presto-integration
    Affects Versions: 2.1.0
         Environment: Spark 2.4.5, Presto 316
            Reporter: Chetan Bhat


Presto 316 version used.

*Steps :-* 

From Spark beeline execute the queries - 

0: jdbc:hive2://10.20.254.208:23040/default> drop table uniqdata_Partition_single;
+---------+
| Result |
+---------+
+---------+
No rows selected (0.454 seconds)
0: jdbc:hive2://10.20.254.208:23040/default> CREATE TABLE uniqdata_Partition_single (CUST_ID int,CUST_NAME String, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 decimal(36,36),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 int) partitioned by (ACTIVE_EMUI_VERSION string)stored as carbondata tblproperties('COLUMN_META_CACHE'='CUST_ID,CUST_NAME,DECIMAL_COLUMN2,DOJ,Double_COLUMN2,BIGINT_COLUMN2','local_dictionary_enable'='true','local_dictionary_threshold'='1000','local_dictionary_include'='ACTIVE_EMUI_VERSION') ;
+---------+
| Result |
+---------+
+---------+
No rows selected (0.202 seconds)
0: jdbc:hive2://10.20.254.208:23040/default> LOAD DATA INPATH 'hdfs://hacluster/chetan/2000_UniqData_partition.csv' into table uniqdata_Partition_single OPTIONS('FILEHEADER'='CUST_ID,CUST_NAME ,ACTIVE_EMUI_VERSION,DOB,DOJ, BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1, Double_COLUMN2,INTEGER_COLUMN1','BAD_RECORDS_ACTION'='FORCE');
+---------+
| Result |
+---------+
+---------+
No rows selected (3.471 seconds)
0: jdbc:hive2://10.20.254.208:23040/default>

 

From prestocli the query is executed - 

presto:ranjan> insert into uniqdata_Partition_single select * from uniqdata_Partition_single;

 

*Issue : - insert in partition table should fail from presto side but insert into select * in passing in partition table with single column partition table from presto side.*

presto:ranjan> insert into uniqdata_Partition_single select * from uniqdata_Partition_single;
INSERT: 2002 rows

Query 20210223_044320_00000_ggkxh, FINISHED, 1 node
Splits: 45 total, 45 done (100.00%)
0:05 [2K rows, 206KB] [431 rows/s, 44.4KB/s]

presto:ranjan> desc uniqdata_Partition_single;
 Column | Type | Extra | Comment
---------------------+----------------+---------------+---------
 cust_id | integer | |
 cust_name | varchar | |
 dob | timestamp | |
 doj | timestamp | |
 bigint_column1 | bigint | |
 bigint_column2 | bigint | |
 decimal_column1 | decimal(30,10) | |
 decimal_column2 | decimal(36,36) | |
 double_column1 | double | |
 double_column2 | double | |
 integer_column1 | integer | |
 active_emui_version | varchar | partition key |
(12 rows)

Query 20210223_044344_00001_ggkxh, FINISHED, 1 node
Splits: 19 total, 19 done (100.00%)
0:00 [12 rows, 1.07KB] [50 rows/s, 4.53KB/s]

presto:ranjan>



--
This message was sent by Atlassian Jira
(v8.3.4#803005)