[jira] [Created] (CARBONDATA-876) Clear segment access count ASAP

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-876) Clear segment access count ASAP

Akash R Nilugal (Jira)
Weizhong created CARBONDATA-876:
-----------------------------------

             Summary: Clear segment access count ASAP
                 Key: CARBONDATA-876
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-876
             Project: CarbonData
          Issue Type: Improvement
          Components: hadoop-integration
         Environment: Spark 2.1 + CarbonData 1.1.0
            Reporter: Weizhong
            Assignee: Weizhong
            Priority: Minor


Currently, we will clear access count for all segments after getSplits finished, this will keep the index in memory more time, but if we don't have enough memory, then will query failed, so clear access count after getSplits for each segment, then we can remove the index tree if we don't have enough memory to load index tree for other segments.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)