> After Compaction records count are mismatched.
> ----------------------------------------------
>
> Key: CARBONDATA-691
> URL:
https://issues.apache.org/jira/browse/CARBONDATA-691> Project: CarbonData
> Issue Type: Bug
> Components: data-load, data-query, docs
> Affects Versions: 1.0.0-incubating
> Reporter: Babulal
> Assignee: sounak chakraborty
> Fix For: 1.0.1-incubating
>
> Attachments: createLoadcmd.txt, driverlog.txt
>
> Time Spent: 3.5h
> Remaining Estimate: 0h
>
> Spark version - Spark 1.6.2 and spark2.1
> After Compaction data showing is wrong.
> create table and load 4 times s( compaction threshold is 4,3)
> Load 4 times same data .each load 105 records as attached in file .
> --+--+
> | SegmentSequenceId | Status | Load Start Time | Load End Time |
> +--------------------+------------+--------------------------+--------------------------+--+
> | 3 | Compacted | 2017-02-01 14:07:51.922 | 2017-02-01 14:07:52.591 |
> | 2 | Compacted | 2017-02-01 14:07:33.481 | 2017-02-01 14:07:34.443 |
> | 1 | Compacted | 2017-02-01 14:07:23.495 | 2017-02-01 14:07:24.167 |
> | 0.1 | Success | 2017-02-01 14:07:52.815 | 2017-02-01 14:07:57.201 |
> | 0 | Compacted | 2017-02-01 14:07:07.541 | 2017-02-01 14:07:11.983 |
> +--------------------+------------+--------------------------+--------------------------+--+
> 5 rows selected (0.021 seconds)
> 0: jdbc:hive2://8.99.61.4:23040> select count(*) from Comp_VMALL_DICTIONARY_INCLUDE_7;
> +-----------+--+
> | count(1) |
> +-----------+--+
> | 1680 |
> +-----------+--+
> 1 row selected (4.468 seconds)
> 0: jdbc:hive2://8.99.61.4:23040> select count(imei) from Comp_VMALL_DICTIONARY_INCLUDE_7;
> +--------------+--+
> | count(imei) |
> +--------------+--+
> | 1680 |
> +--------------+--+
> Expected :- total records should be 420 .
Locked
