[jira] [Created] (CARBONDATA-646) Bad record handling is not correct for Int data type

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-646) Bad record handling is not correct for Int data type

Akash R Nilugal (Jira)
Ramakrishna created CARBONDATA-646:
--------------------------------------

             Summary: Bad record handling is not correct for Int data type
                 Key: CARBONDATA-646
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-646
             Project: CarbonData
          Issue Type: Bug
            Reporter: Ramakrishna
            Priority: Minor


With Bad record handling as default,
If Char value is given for Int data type, that is handled properly(moving NULL).
If Decimal values is given for Int Data type, it is stripping the decimal, where it should consider this as bad record and move NULL.

Bad record csv:
TRUE,2.7,423.0,A,200000000003454300, 121.5,4.99,2.44,SE3423ee,asfdsffdfg,EtryTRWT,2012-01-12 03:14:05.123456729,2012-01-20

0: jdbc:hive2://172.168.100.212:23040> select * from t_carbn01 where qty_total is NULL;
+----------------+---------------+--------------+------------+---------------------+--------------+-----------------+---------+------------+-------------+--------------+------------------------+--------------+--+
| active_status  | item_type_cd  | qty_day_avg  | qty_total  |     sell_price      | sell_pricep  | discount_price  | profit  | item_code  |  item_name  | outlet_name  |      update_time       | create_date  |
+----------------+---------------+--------------+------------+---------------------+--------------+-----------------+---------+------------+-------------+--------------+------------------------+--------------+--+
| TRUE           | 2             | 423          | NULL       | 200000000003454304  | 121.5        | 4.99            | 2.44    | SE3423ee   | asfdsffdfg  | EtryTRWT     | 2012-01-12 03:14:05.0  | 2012-01-20   |
+----------------+---------------+--------------+------------+---------------------+--------------+-----------------+---------+------------+-------------+--------------+------------------------+----------

0: jdbc:hive2://172.168.100.212:23040> desc t_carbn01;
+-----------------+---------------+----------+--+
|    col_name     |   data_type   | comment  |
+-----------------+---------------+----------+--+
| active_status   | string        |          |
| item_type_cd    | bigint        |          |
| qty_day_avg     | bigint        |          |
| qty_total       | bigint        |          |
| sell_price      | bigint        |          |
| sell_pricep     | double        |          |
| discount_price  | double        |          |
| profit          | decimal(3,2)  |          |
| item_code       | string        |          |
| item_name       | string        |          |
| outlet_name     | string        |          |
| update_time     | timestamp     |          |
| create_date     | string        |          |
+-----------------+---------------+----------+--+
 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)