[jira] [Updated] (CARBONDATA-2625) CarbonReader is very slow for many files

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Updated] (CARBONDATA-2625) CarbonReader is very slow for many files

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-2625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Venkata Ramana G updated CARBONDATA-2625:
-----------------------------------------
    Description:
CarbonReader is very slow for many files, including build carbonReader and read data, it's more than 8 minutes when there are 140 files and more than 10 million rows data.

Reason is BlockletDataMap lists files of folder while loading each segment. 

  was:CarbonReader is very slow for many files, including build carbonReader and read data, it's more than 8 minutes when there are 140 files and more than 10 million rows data


> CarbonReader is very slow for many files
> ----------------------------------------
>
>                 Key: CARBONDATA-2625
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2625
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: xubo245
>            Assignee: xubo245
>            Priority: Major
>          Time Spent: 24h 40m
>  Remaining Estimate: 0h
>
> CarbonReader is very slow for many files, including build carbonReader and read data, it's more than 8 minutes when there are 140 files and more than 10 million rows data.
> Reason is BlockletDataMap lists files of folder while loading each segment. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)