[jira] [Created] (CARBONDATA-3551) NPE in multi-thread pruning on NonTransactional tables

[Akash R Nilugal (Jira)]

Ajantha Bhat created CARBONDATA-3551:
----------------------------------------

             Summary: NPE in multi-thread pruning on NonTransactional tables
                 Key: CARBONDATA-3551
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3551
             Project: CarbonData
          Issue Type: Bug
            Reporter: Ajantha Bhat
            Assignee: Ajantha Bhat


problem: NPE in multi-thread pruning on NonTransactional tables

Scenario:

Have a NonTransactional table with more than 0.1 million files and multi thread pruning is used at the driver side. with this query the table with filter condition. 

NPE is observed in below line. 

DimColumnResolvedFilterInfo.populateFilterInfoBasedOnColumnType

this.setColumnIndex(metadata.getColumnExpression().getDimension().getOrdinal());

here getDimension() is null

 

cause: When multithread pruning is used for nonTransactional table, filter is resolved for each segment again, during which each thread works on same ColumnExpression. Chances that ColumnExpression.reset() is called by other thread, which can impact the current thread

 

solution: For multithread pruning use separate Expression object for each thread. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)