[jira] [Created] (CARBONDATA-1337) Problem while intermediate merging

[Akash R Nilugal (Jira)]

Zhichao  Zhang created CARBONDATA-1337:
------------------------------------------

             Summary: Problem while intermediate merging
                 Key: CARBONDATA-1337
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1337
             Project: CarbonData
          Issue Type: Bug
          Components: data-load
    Affects Versions: 1.2.0
            Reporter: Zhichao  Zhang
            Priority: Critical
             Fix For: 1.2.0


With PR-1198(CARBONDATA-1281), when loading data, there was error occuring, as following:

{code:java}
2017-07-28 13:10:49,443 - ERROR - org.apache.carbondata.common.logging.impl.StandardLogService.logErrorMessage(StandardLogService.java:143) - pool-17-thread-1 -pool-17-thread-1 Problem while intermediate merging
org.apache.carbondata.processing.sortandgroupby.exception.CarbonSortKeyAndGroupByException: Problem while getting the file
        at org.apache.carbondata.processing.sortandgroupby.sortdata.IntermediateFileMerger.initialize(IntermediateFileMerger.java:168)
        at org.apache.carbondata.processing.sortandgroupby.sortdata.IntermediateFileMerger.call(IntermediateFileMerger.java:110)
        at org.apache.carbondata.processing.sortandgroupby.sortdata.IntermediateFileMerger.call(IntermediateFileMerger.java:37)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.FileNotFoundException: [Ljava.lang.String;@54218780/carbondata_hundred_million_pr11987419814281939480.merge (No such file or directory)
        at java.io.FileOutputStream.open0(Native Method)
        at java.io.FileOutputStream.open(FileOutputStream.java:270)
        at java.io.FileOutputStream.<init>(FileOutputStream.java:213)
        at java.io.FileOutputStream.<init>(FileOutputStream.java:162)
        at org.apache.carbondata.processing.sortandgroupby.sortdata.IntermediateFileMerger.initialize(IntermediateFileMerger.java:163)
        ... 6 more
{code}

According to xuchuanyin's suggestion, it needs to fix the code of method  SortIntermediateFileMerger.startIntermediateMerging.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)