[
https://issues.apache.org/jira/browse/CARBONDATA-2625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Venkata Ramana G updated CARBONDATA-2625:
-----------------------------------------
Description:
CarbonReader is very slow for many files, including build carbonReader and read data, it's more than 8 minutes when there are 140 files and more than 10 million rows data.
Reason is BlockletDataMap lists files of folder while loading each segment.
was:CarbonReader is very slow for many files, including build carbonReader and read data, it's more than 8 minutes when there are 140 files and more than 10 million rows data
> CarbonReader is very slow for many files
> ----------------------------------------
>
> Key: CARBONDATA-2625
> URL:
https://issues.apache.org/jira/browse/CARBONDATA-2625> Project: CarbonData
> Issue Type: Bug
> Reporter: xubo245
> Assignee: xubo245
> Priority: Major
> Time Spent: 24h 40m
> Remaining Estimate: 0h
>
> CarbonReader is very slow for many files, including build carbonReader and read data, it's more than 8 minutes when there are 140 files and more than 10 million rows data.
> Reason is BlockletDataMap lists files of folder while loading each segment.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)