[jira] [Commented] (CARBONDATA-691) After Compaction records count are mismatched.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-691) After Compaction records count are mismatched.

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15859080#comment-15859080 ]

anubhav tarar commented on CARBONDATA-691:
------------------------------------------

[~Bjangir] can you please attached the csv

> After Compaction records count are mismatched.
> ----------------------------------------------
>
>                 Key: CARBONDATA-691
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-691
>             Project: CarbonData
>          Issue Type: Bug
>          Components: data-load, data-query, docs
>    Affects Versions: 1.0.0-incubating
>            Reporter: Babulal
>         Attachments: createLoadcmd.txt, driverlog.txt
>
>
> Spark version - Spark 1.6.2 and spark2.1
> After Compaction data showing is wrong.
> create table and load 4 times s( compaction threshold is 4,3)
> Load 4 times same data .each load 105 records as attached in file .
> --+--+
> | SegmentSequenceId  |   Status   |     Load Start Time      |      Load End Time       |
> +--------------------+------------+--------------------------+--------------------------+--+
> | 3                  | Compacted  | 2017-02-01 14:07:51.922  | 2017-02-01 14:07:52.591  |
> | 2                  | Compacted  | 2017-02-01 14:07:33.481  | 2017-02-01 14:07:34.443  |
> | 1                  | Compacted  | 2017-02-01 14:07:23.495  | 2017-02-01 14:07:24.167  |
> | 0.1                | Success    | 2017-02-01 14:07:52.815  | 2017-02-01 14:07:57.201  |
> | 0                  | Compacted  | 2017-02-01 14:07:07.541  | 2017-02-01 14:07:11.983  |
> +--------------------+------------+--------------------------+--------------------------+--+
> 5 rows selected (0.021 seconds)
> 0: jdbc:hive2://8.99.61.4:23040> select count(*) from Comp_VMALL_DICTIONARY_INCLUDE_7;
> +-----------+--+
> | count(1)  |
> +-----------+--+
> | 1680      |
> +-----------+--+
> 1 row selected (4.468 seconds)
> 0: jdbc:hive2://8.99.61.4:23040> select count(imei) from Comp_VMALL_DICTIONARY_INCLUDE_7;
> +--------------+--+
> | count(imei)  |
> +--------------+--+
> | 1680         |
> +--------------+--+
> Expected :-  total records should be 420 .



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)