[ https://issues.apache.org/jira/browse/CARBONDATA-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Chen resolved CARBONDATA-1337. ------------------------------------ Resolution: Fixed > Problem while intermediate merging > ---------------------------------- > > Key: CARBONDATA-1337 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1337 > Project: CarbonData > Issue Type: Bug > Components: data-load > Affects Versions: 1.2.0 > Reporter: Zhichao Zhang > Assignee: Zhichao Zhang > Priority: Minor > Fix For: 1.2.0 > > Time Spent: 1h 50m > Remaining Estimate: 0h > > With PR-1198(CARBONDATA-1281), when loading data, there was error occuring, as following: > {code:java} > 2017-07-28 13:10:49,443 - ERROR - org.apache.carbondata.common.logging.impl.StandardLogService.logErrorMessage(StandardLogService.java:143) - pool-17-thread-1 -pool-17-thread-1 Problem while intermediate merging > org.apache.carbondata.processing.sortandgroupby.exception.CarbonSortKeyAndGroupByException: Problem while getting the file > at org.apache.carbondata.processing.sortandgroupby.sortdata.IntermediateFileMerger.initialize(IntermediateFileMerger.java:168) > at org.apache.carbondata.processing.sortandgroupby.sortdata.IntermediateFileMerger.call(IntermediateFileMerger.java:110) > at org.apache.carbondata.processing.sortandgroupby.sortdata.IntermediateFileMerger.call(IntermediateFileMerger.java:37) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.io.FileNotFoundException: [Ljava.lang.String;@54218780/carbondata_hundred_million_pr11987419814281939480.merge (No such file or directory) > at java.io.FileOutputStream.open0(Native Method) > at java.io.FileOutputStream.open(FileOutputStream.java:270) > at java.io.FileOutputStream.<init>(FileOutputStream.java:213) > at java.io.FileOutputStream.<init>(FileOutputStream.java:162) > at org.apache.carbondata.processing.sortandgroupby.sortdata.IntermediateFileMerger.initialize(IntermediateFileMerger.java:163) > ... 6 more > {code} > According to xuchuanyin's suggestion, it needs to fix the code of method SortIntermediateFileMerger.startIntermediateMerging. -- This message was sent by Atlassian JIRA (v6.4.14#64029) |
Free forum by Nabble | Edit this page |