[jira] [Resolved] (CARBONDATA-2137) Delete query is taking more time while processing the carbondata.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Resolved] (CARBONDATA-2137) Delete query is taking more time while processing the carbondata.

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-2137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ravindra Pesala resolved CARBONDATA-2137.
-----------------------------------------
       Resolution: Fixed
    Fix Version/s: 1.3.1

> Delete query is taking more time while processing the carbondata.
> -----------------------------------------------------------------
>
>                 Key: CARBONDATA-2137
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2137
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: Rahul Kumar
>            Assignee: Rahul Kumar
>            Priority: Major
>             Fix For: 1.3.1
>
>          Time Spent: 1h 50m
>  Remaining Estimate: 0h
>
> *Expected Output* : Delete query should take less time
> *Actual Output* : Delete Query is taking 20min
> *Following the steps to reproduce :*
>  * create table and load 500 million records
>  * create hive table with 10% of data
>  * delete the data in main-table using hive table
>  * check the performance
> *Following is the configuration used :*
>  * SPARK_EXECUTOR_MEMORY : 200G
>  * SPARK_DRIVER_MEMORY : 20G
>  * SPARK_EXECUTOR_CORES : 32
>  * SPARK_EXECUTOR_INSTANCEs : 3



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)