Re: [DISCUSS]Query performance Multiple and possible memory leaks

Posted by mohdshahidkhan on Jan 17, 2019; 6:12am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/DISCUSS-Query-performance-Multiple-and-possible-memory-leaks-tp73608p73659.html

@xuchuanyin
Count star on carbon rely over the carbon index and carbonindexmerge so it
will load the index files into the driver LRU cache.

@litao
If there is no other query and executing the same sql again then increasing
memory footprint from 14g to 20g really looks like a memory leak.

-Regards,
Shahid


On Thu 17 Jan, 2019, 6:29 AM litao <[hidden email] wrote:

> Do you mean for the same query, even if the memory configured for LRU is
> big
> enough, some of the cached entries for index still get purged?
> --yes i think it is.
>
> However, since your query is purely count-star without any conditions, I
> suppose the query may not use the index are all, which means the LRU cache
> may donot work for your query.
> --but by logs we can see the carbonindexmerge file load to LRUCache.
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>