[jira] [Updated] (CARBONDATA-2853) Add file-level min/max index for streaming segment

[Akash R Nilugal (Jira)]

     [ https://issues.apache.org/jira/browse/CARBONDATA-2853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

QiangCai updated CARBONDATA-2853:
---------------------------------
    Description: Streaming index file in stream segment adds file-level min/max meta index for each streaming file during streaming ingestion. So the filter query can use the file-level min/max index to prune the streaming files to reduce the number of the spark tasks.

> Add file-level min/max index for streaming segment
> --------------------------------------------------
>
>                 Key: CARBONDATA-2853
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2853
>             Project: CarbonData
>          Issue Type: Sub-task
>    Affects Versions: 1.5.0
>            Reporter: QiangCai
>            Assignee: QiangCai
>            Priority: Major
>         Attachments: streaming_minmax.pdf
>
>          Time Spent: 2h 40m
>  Remaining Estimate: 0h
>
> Streaming index file in stream segment adds file-level min/max meta index for each streaming file during streaming ingestion. So the filter query can use the file-level min/max index to prune the streaming files to reduce the number of the spark tasks.

--
This message was sent by Atlassian JIRA
(v7.6.3#76005)