Posted by
Akash R Nilugal (Jira) on
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/jira-Created-CARBONDATA-3072-Show-segment-data-size-and-index-size-does-not-display-correctly-for-tan-tp67622.html
Chetan Bhat created CARBONDATA-3072:
---------------------------------------
Summary: Show segment data size and index size does not display correctly for table created in older version upgraded to latest version
Key: CARBONDATA-3072
URL:
https://issues.apache.org/jira/browse/CARBONDATA-3072 Project: CarbonData
Issue Type: Bug
Components: data-query
Affects Versions: 1.5.0, 1.5.1
Environment: Spark 2.1
Reporter: Chetan Bhat
Steps :
Create table in version older than 1.5.0 and load data to table.
Create a database in 1.5.0 or 1.5.1.
Copy the older version store to HDFS path of 1.5.0 or 1.5.1.
Refresh the table using the refresh table command.
Execute show segment command for the table.
Issue : Show segment data size and index size displays incorrectly as 0.0B and 0.0B.
0: jdbc:hive2://10.18.98.225:22550/default> show segments for table brinjal;
+--------------------+--------------------+--------------------------+--------------------------+------------+--------------+------------+-------------+--+
| SegmentSequenceId | Status | Load Start Time | Load End Time | Merged To | File Format | Data Size | Index Size |
+--------------------+--------------------+--------------------------+--------------------------+------------+--------------+------------+-------------+--+
| 3 | Marked for Delete | 2017-12-27 19:27:43.471 | 2017-12-27 19:27:50.737 | NA | COLUMNAR_V3 | 0.0B | 0.0B |
| 2 | Success | 2017-12-26 20:18:22.775 | 2017-12-26 20:18:23.793 | NA | COLUMNAR_V3 | 0.0B | 0.0B |
| 1 | Success | 2017-12-26 20:18:19.822 | 2017-12-26 20:18:20.371 | NA | COLUMNAR_V3 | 0.0B | 0.0B |
| 0 | Success | 2017-12-26 20:18:09.392 | 2017-12-26 20:18:16.024 | NA | COLUMNAR_V3 | 0.0B | 0.0B |
+--------------------+--------------------+--------------------------+--------------------------+------------+--------------+------------+-------------+--+
4 rows selected (0.56 seconds)
Expected : Show segment data size and index size should display correct size as shown below.
0: jdbc:hive2://10.18.98.225:22550/default> show segments for table brinjal;
+--------------------+----------+--------------------------+--------------------------+------------+--------------+------------+-------------+--+
| SegmentSequenceId | Status | Load Start Time | Load End Time | Merged To | File Format | Data Size | Index Size |
+--------------------+----------+--------------------------+--------------------------+------------+--------------+------------+-------------+--+
| 1 | Success | 2018-11-02 22:31:34.103 | 2018-11-02 22:31:34.77 | NA | COLUMNAR_V3 | 6.52KB | 1.63KB |
| 0 | Success | 2018-11-02 22:31:20.54 | 2018-11-02 22:31:21.273 | NA | COLUMNAR_V3 | 6.52KB | 1.63KB |
+--------------------+----------+--------------------------+--------------------------+------------+--------------+------------+-------------+--+
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)