[jira] [Created] (CARBONDATA-2563) Explain query with Order by operator is fired Spark Job which is increase explain query time

[Akash R Nilugal (Jira)]

Babulal created CARBONDATA-2563:
-----------------------------------

             Summary: Explain query with Order by operator is fired Spark Job which is increase explain query time
                 Key: CARBONDATA-2563
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2563
             Project: CarbonData
          Issue Type: Bug
            Reporter: Babulal
         Attachments: image-2018-05-29-20-02-58-129.png

Create Table (hive or carbon )

create table justtesthive( name string,age int)

insert into justtesthive select 'babu',12;

 

WithCarbonSession means startCarbonThriftserver

 

 

Without CarbonSession (with SparkSession)

0: jdbc:hive2://10.18.222.231:23040> explain select name from justtesthive order by name;
+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
| plan |
+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
| == Physical Plan ==
*Sort [name#15 ASC NULLS FIRST], true, 0
+- Exchange rangepartitioning(name#15 ASC NULLS FIRST, 200)
 +- HiveTableScan [name#15], HiveTableRelation `default`.`justtesthive`, org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, [name#15, age#16] |
+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
1 row selected (0.089 seconds)
0: jdbc:hive2://10.18.222.231:23040> 

 

 

 

With CarbonSession.

 

0: jdbc:hive2://10.18.222.231:23040> explain select name from justtesthive order by name;
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
| plan |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
| == CarbonData Profiler ==
 |
| == Physical Plan ==
*Sort [name#1867 ASC NULLS FIRST], true, 0
+- Exchange rangepartitioning(name#1867 ASC NULLS FIRST, 200)
 +- HiveTableScan [name#1867], HiveTableRelation `default`.`justtesthive`, org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, [name#1867, age#1868] |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
2 rows selected (11.609 seconds)

 

Time taken by explain is 10 sec for CarbonSession because SparkJob is fired , but for Explain Job should not fired .

!image-2018-05-29-20-02-58-129.png!

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)