[jira] [Created] (CARBONDATA-3919) Improve concurrent query performance

[Akash R Nilugal (Jira)]

Ajantha Bhat created CARBONDATA-3919:
----------------------------------------

             Summary: Improve concurrent query performance
                 Key: CARBONDATA-3919
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3919
             Project: CarbonData
          Issue Type: Improvement
            Reporter: Ajantha Bhat
            Assignee: Ajantha Bhat


problem1: when 500 queries executed concurrently. 

checkIfRefreshIsNeeded method was synchronized. so only one thread was working at time.

But actually synchronization is required only when schema modified to drop tables. Not for whole function

 

solution: synchronize only remove table part. Observed 500 query total performance improved from 10s to 3 seconds in cluster.

 

problem2:  

TokenCache.obtainTokensForNamenodes was causing a performance bottleneck for concurrent queries. so, removed it

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)