Babulal created CARBONDATA-691:
----------------------------------
Summary: After Compaction records count are mismatched.
Key: CARBONDATA-691
URL:
https://issues.apache.org/jira/browse/CARBONDATA-691 Project: CarbonData
Issue Type: Bug
Components: data-load, data-query, docs
Affects Versions: 1.0.0-incubating
Reporter: Babulal
Attachments: createLoadcmd.txt, driverlog.txt
Spark version - Spark 1.6.2 and spark2.1
After Compaction data showing is wrong.
create table and load 4 times s( compaction threshold is 4,3)
Load 4 times same data .each load 105 records as attached in file .
--+--+
| SegmentSequenceId | Status | Load Start Time | Load End Time |
+--------------------+------------+--------------------------+--------------------------+--+
| 3 | Compacted | 2017-02-01 14:07:51.922 | 2017-02-01 14:07:52.591 |
| 2 | Compacted | 2017-02-01 14:07:33.481 | 2017-02-01 14:07:34.443 |
| 1 | Compacted | 2017-02-01 14:07:23.495 | 2017-02-01 14:07:24.167 |
| 0.1 | Success | 2017-02-01 14:07:52.815 | 2017-02-01 14:07:57.201 |
| 0 | Compacted | 2017-02-01 14:07:07.541 | 2017-02-01 14:07:11.983 |
+--------------------+------------+--------------------------+--------------------------+--+
5 rows selected (0.021 seconds)
0: jdbc:hive2://8.99.61.4:23040> select count(*) from Comp_VMALL_DICTIONARY_INCLUDE_7;
+-----------+--+
| count(1) |
+-----------+--+
| 1680 |
+-----------+--+
1 row selected (4.468 seconds)
0: jdbc:hive2://8.99.61.4:23040> select count(imei) from Comp_VMALL_DICTIONARY_INCLUDE_7;
+--------------+--+
| count(imei) |
+--------------+--+
| 1680 |
+--------------+--+
Expected :- total records should be 420 .
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Locked
