[jira] [Resolved] (CARBONDATA-2563) Explain query with Order by operator is fired Spark Job which is increase explain query time

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Resolved] (CARBONDATA-2563) Explain query with Order by operator is fired Spark Job which is increase explain query time

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

kumar vishal resolved CARBONDATA-2563.
--------------------------------------
    Resolution: Fixed
      Assignee: Sujith

> Explain query with Order by operator is fired Spark Job which is increase explain query time
> --------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-2563
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2563
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: Babulal
>            Assignee: Sujith
>            Priority: Minor
>         Attachments: image-2018-05-29-20-02-58-129.png
>
>          Time Spent: 5h 20m
>  Remaining Estimate: 0h
>
> Create Table (hive or carbon )
> create table justtesthive( name string,age int)
> insert into justtesthive select 'babu',12;
>  
> WithCarbonSession means startCarbonThriftserver
>  
>  
> Without CarbonSession (with SparkSession)
> 0: jdbc:hive2://10.18.222.231:23040> explain select name from justtesthive order by name;
> +----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
> | plan |
> +----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
> | == Physical Plan ==
> *Sort [name#15 ASC NULLS FIRST], true, 0
> +- Exchange rangepartitioning(name#15 ASC NULLS FIRST, 200)
>  +- HiveTableScan [name#15], HiveTableRelation `default`.`justtesthive`, org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, [name#15, age#16] |
> +----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
> 1 row selected (0.089 seconds)
> 0: jdbc:hive2://10.18.222.231:23040> 
>  
>  
>  
> With CarbonSession.
>  
> 0: jdbc:hive2://10.18.222.231:23040> explain select name from justtesthive order by name;
> +--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
> | plan |
> +--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
> | == CarbonData Profiler ==
>  |
> | == Physical Plan ==
> *Sort [name#1867 ASC NULLS FIRST], true, 0
> +- Exchange rangepartitioning(name#1867 ASC NULLS FIRST, 200)
>  +- HiveTableScan [name#1867], HiveTableRelation `default`.`justtesthive`, org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, [name#1867, age#1868] |
> +--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
> 2 rows selected (11.609 seconds)
>  
> Time taken by explain is 10 sec for CarbonSession because SparkJob is fired , but for Explain Job should not fired .
> !image-2018-05-29-20-02-58-129.png!
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)