[jira] [Created] (CARBONDATA-2134) Prevent implicit column filter list from getting serialized while submitting task to executor

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-2134) Prevent implicit column filter list from getting serialized while submitting task to executor

Akash R Nilugal (Jira)
Manish Gupta created CARBONDATA-2134:
----------------------------------------

             Summary: Prevent implicit column filter list from getting serialized while submitting task to executor
                 Key: CARBONDATA-2134
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2134
             Project: CarbonData
          Issue Type: Bug
            Reporter: Manish Gupta
            Assignee: Manish Gupta


**Problem**
In the current store blocklet pruning in driver and no further pruning takes place in the executor side. But still the implicit column filter list being sent to executor. As the size of list grows the cost of serializing and deserializing the list is increasing which can impact the query performance.

**Solution**
Remove the list from the filter expression before submitting the task to executor.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)