[jira] [Updated] (CARBONDATA-417) [Bad Records] Not created and not writen log file when logger is True and action as Fail

[Akash R Nilugal (Jira)]

     [ https://issues.apache.org/jira/browse/CARBONDATA-417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

MAKAMRAGHUVARDHAN updated CARBONDATA-417:
-----------------------------------------
    Description:
Steps:

1. Create Table:

CREATE TABLE truefail (ID int,CUST_ID int,cust_name string) STORED BY 'org.apache.carbondata.format';

2. Load Data having Logger as True and Action as False

LOAD DATA INPATH 'hdfs://hacluster/Raghu/test2.csv' into table truefail OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', 'BAD_RECORDS_ACTION'='FAIL','FILEHEADER'='ID,CUST_ID,cust_name');

0: jdbc:hive2://ha-cluster/default>  CREATE TABLE truefail (ID int,CUST_ID int,cust_name string) STORED BY 'org.apache.carbondata.format';
+---------+--+
| result  |
+---------+--+
+---------+--+
No rows selected (0.679 seconds)
0: jdbc:hive2://ha-cluster/default>  LOAD DATA INPATH 'hdfs://hacluster/Raghu/test2.csv' into table truefail OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', 'BAD_RECORDS_ACTION'='FAIL','FILEHEADER'='ID,CUST_ID,cust_name');
Error: java.lang.Exception: DataLoad failure: Data load failed due to bad record ,The value  "987654321010111213141516171819101122334455667788990012131415161718191909192939495969798" with column name CUST_ID and column data type INT is not a valid Record (state=,code=0)
0: jdbc:hive2://ha-cluster/default>


Actual Result: Not Creating and not written log file for bad records when BAD_RECORDS_LOGGER_ENABLE'='TRUE', 'BAD_RECORDS_ACTION'='FAIL'


Expected Result: Should create and write log file when BAD_RECORDS_LOGGER_ENABLE'='TRUE', 'BAD_RECORDS_ACTION'='FAIL' for Bad records

  was:
Steps:

1. Create Table:

CREATE TABLE truefail (ID int,CUST_ID int,cust_name string) STORED BY 'org.apache.carbondata.format';

2. Load Data having Logger as True and Action as False

LOAD DATA INPATH 'hdfs://hacluster/Raghu/test2.csv' into table truefail OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', 'BAD_RECORDS_ACTION'='FAIL','FILEHEADER'='ID,CUST_ID,cust_name');


Actual Result: Not Creating and not written log file for bad records when BAD_RECORDS_LOGGER_ENABLE'='TRUE', 'BAD_RECORDS_ACTION'='FAIL'


Expected Result: Should create and write log file when BAD_RECORDS_LOGGER_ENABLE'='TRUE', 'BAD_RECORDS_ACTION'='FAIL' for Bad records

> [Bad Records] Not created and not writen log file when logger is True and action as Fail
> ----------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-417
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-417
>             Project: CarbonData
>          Issue Type: Bug
>          Components: data-load
>    Affects Versions: 0.1.1-incubating
>         Environment: 3 node Cluster
>            Reporter: MAKAMRAGHUVARDHAN
>            Priority: Minor
>
> Steps:
> 1. Create Table:
> CREATE TABLE truefail (ID int,CUST_ID int,cust_name string) STORED BY 'org.apache.carbondata.format';
> 2. Load Data having Logger as True and Action as False
> LOAD DATA INPATH 'hdfs://hacluster/Raghu/test2.csv' into table truefail OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', 'BAD_RECORDS_ACTION'='FAIL','FILEHEADER'='ID,CUST_ID,cust_name');
> 0: jdbc:hive2://ha-cluster/default>  CREATE TABLE truefail (ID int,CUST_ID int,cust_name string) STORED BY 'org.apache.carbondata.format';
> +---------+--+
> | result  |
> +---------+--+
> +---------+--+
> No rows selected (0.679 seconds)
> 0: jdbc:hive2://ha-cluster/default>  LOAD DATA INPATH 'hdfs://hacluster/Raghu/test2.csv' into table truefail OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', 'BAD_RECORDS_ACTION'='FAIL','FILEHEADER'='ID,CUST_ID,cust_name');
> Error: java.lang.Exception: DataLoad failure: Data load failed due to bad record ,The value  "987654321010111213141516171819101122334455667788990012131415161718191909192939495969798" with column name CUST_ID and column data type INT is not a valid Record (state=,code=0)
> 0: jdbc:hive2://ha-cluster/default>
> Actual Result: Not Creating and not written log file for bad records when BAD_RECORDS_LOGGER_ENABLE'='TRUE', 'BAD_RECORDS_ACTION'='FAIL'
> Expected Result: Should create and write log file when BAD_RECORDS_LOGGER_ENABLE'='TRUE', 'BAD_RECORDS_ACTION'='FAIL' for Bad records

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)