[jira] [Created] (CARBONDATA-3879) Filtering Segmets Optimazation

[Akash R Nilugal (Jira)]

Xingjun Hao created CARBONDATA-3879:
---------------------------------------

             Summary: Filtering Segmets Optimazation
                 Key: CARBONDATA-3879
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3879
             Project: CarbonData
          Issue Type: Improvement
          Components: data-query
    Affects Versions: 2.0.0
            Reporter: Xingjun Hao
             Fix For: 2.0.2


During filter segments flow, there are a lot of LIST.CONTAINS, which has heavy time overhead when there are tens of thousands segments.

For example, if there are 50000 segments. it will trigger LIST.CONTAINS  for each segment, the LIST also has about 50000 elements. so the time complexity will be O（50000 * 50000 ）



--
This message was sent by Atlassian Jira
(v8.3.4#803005)