[jira] [Commented] (CARBONDATA-2913) BufferOverflowException when use varchar data of length 10000000

[Akash R Nilugal (Jira)]

    [ https://issues.apache.org/jira/browse/CARBONDATA-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16602772#comment-16602772 ]

Ajantha Bhat commented on CARBONDATA-2913:
------------------------------------------

!image-2018-09-04-14-19-00-708.png!

 

 

That could be the reason. Need to analyze more

> BufferOverflowException when use varchar data of length 10000000
> ----------------------------------------------------------------
>
>                 Key: CARBONDATA-2913
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2913
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: Ajantha Bhat
>            Priority: Major
>         Attachments: image-2018-09-04-14-19-00-708.png
>
>
> SDKwriterTestCase has a test case "Test sdk with longstring"
>  
> use 
> RandomStringUtils.randomAlphabetic(10000000).
>  
> we get below exception during sort.
>  
> java.nio.BufferOverflowException
>  at java.nio.HeapByteBuffer.put(HeapByteBuffer.java:189)
>  at java.nio.ByteBuffer.put(ByteBuffer.java:859)
>  at org.apache.carbondata.processing.loading.sort.SortStepRowHandler.packNoSortFieldsToBytes(SortStepRowHandler.java:585)
>  at org.apache.carbondata.processing.loading.sort.SortStepRowHandler.writeRawRowAsIntermediateSortTempRowToUnsafeMemory(SortStepRowHandler.java:548)
>  at org.apache.carbondata.processing.loading.sort.unsafe.UnsafeCarbonRowPage.addRow(UnsafeCarbonRowPage.java:82)
>  at org.apache.carbondata.processing.loading.sort.unsafe.UnsafeCarbonRowPage.addRow(UnsafeCarbonRowPage.java:68)
>  at org.apache.carbondata.processing.loading.sort.unsafe.UnsafeSortDataRows.addBatch(UnsafeSortDataRows.java:203)
>  at org.apache.carbondata.processing.loading.sort.unsafe.UnsafeSortDataRows.addRowBatch(UnsafeSortDataRows.java:179)
>  at org.apache.carbondata.processing.loading.sort.impl.UnsafeParallelReadMergeSorterImpl$SortIteratorThread.run(UnsafeParallelReadMergeSorterImpl.java:205)
>  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>  at java.lang.Thread.run(Thread.java:748)
> 2018-09-04 14:06:55 ERROR CarbonTableOutputFormat:442 - Error while loading data
> java.util.concurrent.ExecutionException: java.lang.RuntimeException: org.apache.carbondata.processing.loading.exception.CarbonDataLoadingException:
>  

--
This message was sent by Atlassian JIRA
(v7.6.3#76005)