[jira] [Created] (CARBONDATA-2530) [MV] Wrong data displayed when parent table data are loaded

[Akash R Nilugal (Jira)]

Babulal created CARBONDATA-2530:
-----------------------------------

             Summary: [MV] Wrong data displayed when parent table data are loaded
                 Key: CARBONDATA-2530
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2530
             Project: CarbonData
          Issue Type: Bug
            Reporter: Babulal


Spark Release:- Spark2.2.1

Create table and load data to it 

create MV 

rebuild datamap

run query (used during mv creation) which hits MV and get data

Now load data to main table 

again run query (used during mv creation) which hits MV and get data

Result:- data shown is from MV which is wrong  if increament load happens then data should get from Main table(parent table) 

Commands

0: jdbc:hive2://10.18.222.231:23040> create table tt13 ( name string, age int) stored by 'carbondata';

0: jdbc:hive2://10.18.222.231:23040> insert into tt13 select 'babu',12;
+---------+--+
| Result |
+---------+--+
+---------+–+

0: jdbc:hive2://10.18.222.231:23040> create datamap datamap43 using 'mv' as select name from tt13 ;
+---------+--+
| Result |
+---------+--+
+---------+--+
No rows selected (0.51 seconds)
0: jdbc:hive2://10.18.222.231:23040> rebuild datamap datamap43;
+---------+--+
| Result |
+---------+--+
+---------+--+
No rows selected (8.747 seconds)
0: jdbc:hive2://10.18.222.231:23040> explain select name from tt13;
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
| plan |
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
| == CarbonData Profiler ==
Table Scan on datamap43_table
 - total blocklets: 1
 - filter: none
 - pruned by Main DataMap
 - skipped blocklets: 0
 |
| == Physical Plan ==
*BatchedScan CarbonDatasourceHadoopRelation [ Database name :default, Table name :datamap43_table, Schema :Some(StructType(StructField(tt13_name,StringType,true))) ] default.datamap43_table[tt13_name#1311] |
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
2 rows selected (0.525 seconds)
0: jdbc:hive2://10.18.222.231:23040> select name from tt13;
+------------+--+
| tt13_name |
+------------+--+
| babu |
+------------+--+
1 row selected (0.483 seconds)

0: jdbc:hive2://10.18.222.231:23040> insert into tt13 select 'lal',13;
+---------+--+
| Result |
+---------+--+
+---------+--+
No rows selected (11.819 seconds)
0: jdbc:hive2://10.18.222.231:23040> select name from tt13;
+------------+--+
| tt13_name |
+------------+--+
| babu |
+------------+--+
1 row selected (0.349 seconds)
0: jdbc:hive2://10.18.222.231:23040> explain select name from tt13;
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
| plan |
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
| == CarbonData Profiler ==
Table Scan on datamap43_table
 - total blocklets: 1
 - filter: none
 - pruned by Main DataMap
 - skipped blocklets: 0
 |
| == Physical Plan ==
*BatchedScan CarbonDatasourceHadoopRelation [ Database name :default, Table name :datamap43_table, Schema :Some(StructType(StructField(tt13_name,StringType,true))) ] default.datamap43_table[tt13_name#1311] |
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
2 rows selected (0.391 seconds)

 

 

Expected 

output should display 2 records . (check insert into command)

 

 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)