[jira] [Commented] (CARBONDATA-2279) presto handle empty carbondata file

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-2279) presto handle empty carbondata file

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433679#comment-16433679 ]

Geetika Gupta commented on CARBONDATA-2279:
-------------------------------------------

@zhangwei please provide more details to replicate your scenario as I tried it on my machine, it works there.

> presto handle empty carbondata file
> ------------------------------------
>
>                 Key: CARBONDATA-2279
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2279
>             Project: CarbonData
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 1.3.0
>            Reporter: zhangwei
>            Assignee: Geetika Gupta
>            Priority: Major
>             Fix For: 1.3.0
>
>         Attachments: outofindex.patch
>
>
> Caused by: java.lang.RuntimeException: Error creating Splits from CarbonTableInputFormat
> at org.apache.carbondata.presto.impl.CarbonTableReader.getInputSplits2(CarbonTableReader.java:433)
> at org.apache.carbondata.presto.CarbondataSplitManager.getSplits(CarbondataSplitManager.java:75)
> ... 22 more
> Caused by: java.io.IOException: Problem in loading segment blocks.
> at org.apache.carbondata.core.indexstore.BlockletDataMapIndexStore.getAll(BlockletDataMapIndexStore.java:153)
> at org.apache.carbondata.core.indexstore.blockletindex.BlockletDataMapFactory.getDataMaps(BlockletDataMapFactory.java:76)
> at org.apache.carbondata.core.datamap.TableDataMap.prune(TableDataMap.java:95)
> at org.apache.carbondata.hadoop.api.CarbonTableInputFormat.getDataBlocksOfSegment(CarbonTableInputFormat.java:748)
> at org.apache.carbondata.hadoop.api.CarbonTableInputFormat.getSplits(CarbonTableInputFormat.java:679)
> at org.apache.carbondata.hadoop.api.CarbonTableInputFormat.getSplits(CarbonTableInputFormat.java:439)
> at org.apache.carbondata.presto.impl.CarbonTableReader.getInputSplits2(CarbonTableReader.java:417)
> ... 23 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 0
> at org.apache.carbondata.core.datastore.filesystem.AbstractDFSCarbonFile.getLocations(AbstractDFSCarbonFile.java:514)
> at org.apache.carbondata.core.indexstore.BlockletDataMapIndexStore.getAll(BlockletDataMapIndexStore.java:142)
> ... 29 more



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)