[jira] [Created] (CARBONDATA-3678) optimize list files during insert stage

[Akash R Nilugal (Jira)]

ZHANGSHUNYU created CARBONDATA-3678:
---------------------------------------

             Summary: optimize list files during insert stage
                 Key: CARBONDATA-3678
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3678
             Project: CarbonData
          Issue Type: Improvement
            Reporter: ZHANGSHUNYU


currentlly, all the files will be listed during insert stage, it is time costly on s3/obs when there are many stage files listed even you set the insert batch cout, we need to optimize it using iterator to list the limited files.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)